pat98's always & forever

EM 12.1.0.4 설치시 나는 에러 에러 처리법

아래와 같이 처리하고 Retry 하니 잘됨.

=======================================

1. 본인의 경우 MGMT_TABLESPACE 가 autoextend 임에도 불구하고 100% 여서 일단 늘여주었음

직접적인 에러의 원인은 아니라고 봄..예방차원

TABLESPACE_NAME      FILE_NAME                                           TOT_KB      FREE_KB USAGE_P
-------------------- --------------------------------------------- ------------ ------------ -------
MGMT_AD4J_TS         /u01/oradata/EMREP/mgmt_ad4j.dbf                   204,800      203,072      .8
MGMT_ECM_DEPOT_TS    /u01/oradata/EMREP/mgmt_depot.dbf                   40,960       19,008    53.6
MGMT_TABLESPACE      /u01/oradata/EMREP/mgmt.dbf                      1,126,400       78,784    93.0
SYSAUX               /u01/oradata/EMREP/sysaux01.dbf                    614,400      193,152    68.6
SYSTEM               /u01/oradata/EMREP/system01.dbf                    716,800        1,408    99.8
UNDOTBS1             /u01/oradata/EMREP/undotbs01.dbf                   952,320            0   100.0
USERS                /u01/oradata/EMREP/users01.dbf                       5,120        4,096    20.0

2. 파티션 추가 (요게 중요. 파티션 없음)

SQL> conn sysman/welcome1
Connected.
SQL> exec gc_interval_partition_mgr.partition_maintenance;
SQL> exec mgmt_audit_admin.add_audit_partition;

=======================================

EM 12c: Enterprise Manager Cloud Control OMS Installation Fails At OMS Configuration Stage With Message 'ORA-14400: inserted partition key does not map to any partition' Reported In CfmLogger*.log (문서 ID 1663277.1)

Applies to:
Enterprise Manager Base Platform - Version 12.1.0.1.0 and later
Information in this document applies to any platform.

Symptoms
OMS installation fails at oms configuration

From <OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log:
=======================
INFO: oracle.sysman.top.oms:java.sql.SQLException: ORA-14400: inserted partition key does not map to any partition
INFO: oracle.sysman.top.oms:ORA-06512: at "SYSMAN.EM_SELF_UPDATE", line 1537
INFO: oracle.sysman.top.oms:ORA-06512: at line 1
INFO: oracle.sysman.top.oms:

INFO: oracle.sysman.top.oms:OMSCA-ERR:Post deploy operations failed. Check the trace file:/u01/app/em/middleware/oms/cfgtoollogs/omsca/omsca_20140402160051.log
INFO: oracle.sysman.top.oms:
Check the OMS Configuration Assistant logs at: /u01/app/em/middleware/oms/cfgtoollogs/omsca

INFO: oracle.sysman.top.oms:The plug-in OMS Configuration has failed its perform method
=======================

Cause
The Partitions are not created in the Database used as Repository and hence oms configuration fail due to missing partitions. This issue is documented in following bug:
BUG 18307758 - AUDIT PARTITIONS NOT CREATED ON EM INSTALL, WHEN DB TEMPLATE IS USED

Solution
1. Run the query below as SYSMAN to manually add partitions
    SQL> exec gc_interval_partition_mgr.partition_maintenance;
    SQL> exec mgmt_audit_admin.add_audit_partition;

2. Resume OMS installation
    If OUI is open, click on Retry on the OUI
    If OUI is closed, then resume the installation by executing the following command:
        $ export ORACLE_HOME=<OMS_HOME>
        $ <OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

꽃미남 Eric Johnson 의 Cliffs of Dover

언제 들어도 좋음 ^^

oracle 12c 12.1.0.2 버전 설치시에

- grid 설치시 1번노드만 설치가 성공하고 나머지 2,3번은 실패함.

  자료확인해 보면 아래와 같은 버그임.

CLSRSC-507: The root script cannot proceed on this node <node-n> because either the first-node operations have not completed on node <node-1> or there was an error in obtaining the status of the first-node operations. (문서 ID 1919825.1)

* oracle AMDU (ASM Metadata Dump Utility) 가 디스크를 읽지 못해서 나는 버그임.

우선 확인 및 해결절차

1. 1번노드에서 성공적으로 root script가 수행되었는지 확인

<NEW_GI_HOME>/cfgtoollogs/crsconfig/rootcrs_<node>_<timestamp>.log

CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

2. 다른 노드를 살펴보면 root script 가 ocrdump 가 실행되지 못해서 실패했다.

<NEW_GI_HOME>/cfgtoollogs/crsconfig/rootcrs_<node>_<timestamp>.log

2014-09-04 13:45:34: ASM_DISKS=ORCL:OCR01,ORCL:OCR02,ORCL:OCR03
....
2014-09-04 13:46:04: Check the existence of global ckpt 'checkpoints.firstnode'
2014-09-04 13:46:04: setting ORAASM_UPGRADE to 1
2014-09-04 13:46:04: Invoking "/product/app/12.1.0.2/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode"
2014-09-04 13:46:04: trace file=/product/app/grid/crsdata/sipr0-db04/crsconfig/cluutil8.log
2014-09-04 13:46:04: Running as user grid: /product/app/12.1.0.2/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode
2014-09-04 13:46:04: s_run_as_user2: Running /bin/su grid -c ' echo CLSRSC_START; /product/app/12.1.0.2/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode '
2014-09-04 13:46:05: Removing file /tmp/fileRiu5NI
2014-09-04 13:46:05: Successfully removed file: /tmp/fileRiu5NI
2014-09-04 13:46:05: pipe exit code: 256
2014-09-04 13:46:05: /bin/su exited with rc=1

2014-09-04 13:46:05: oracle.ops.mgmt.rawdevice.OCRException: PROC-32: Cluster Ready Services on the local node is not running Messaging error [gipcretConnectionRefused] [29]

2014-09-04 13:46:05: Cannot get OCR key with CLUUTIL, try using OCRDUMP.
2014-09-04 13:46:05: Check OCR key using ocrdump
2014-09-04 13:46:22: ocrdump output: PROT-302: Failed to initialize ocrdump

2014-09-04 13:46:22: The key pair with keyname: SYSTEM.rootcrs.checkpoints.firstnode does not exist in OCR.
2014-09-04 13:46:22: Checking a remote host sipr0-db03 for reachability...

3. ocrdump fails due to error AMDU-00201 and AMDU-00200 를 확인다.

<ADR_HOME>/crs/<node>/crs/trace/ocrdump_<pid>.trc

2014-09-04 13:46:14.044274 : OCRASM: proprasmo: ASM instance is down. Proceed to open the file in dirty mode.

CLWAL: clsw_Initialize: Error [32] from procr_init_ext
CLWAL: clsw_Initialize: Error [PROCL-32: Oracle High Availability Services on the local node is not running Messaging error [gipcretConnectionRefused] [29]] from procr_init_ext
2014-09-04 13:46:14.050831 : GPNP: clsgpnpkww_initclswcx: [at clsgpnpkww.c:351] Result: (56) CLSGPNP_OCR_INIT. (:GPNP01201:)Failed to init CLSW-OLR context. CLSW Error (3): CLSW-3: Error in the cluster registry (OCR) layer. [32] [PROCL-32: Oracle High Availability Services on the local node is not running Messaging error [gipcretConnectionRefused] [29]]
2014-09-04 13:46:14.093544 : OCRASM: proprasmo: Error [13] in opening the GPNP profile. Try to get offline profile
2014-09-04 13:46:16.210708 : OCRRAW: kgfo_kge2slos error stack at kgfolclcpi1: AMDU-00200: Unable to read [32768] bytes from Disk N0050 at offset [140737488355328]
AMDU-00201: Disk N0050: '/dev/sdg'
AMDU-00200: Unable to read [32768] bytes from Disk N0049 at offset [140737488355328]
AMDU-00201: Disk N0049: '/dev/sdf'
AMDU-00200: Unable to read [32768] bytes from Disk N0048 at offset [140737488355328]
AMDU-00201: Disk N0048: '/dev/sde'
AMDU-00200: Unable to read [32768] bytes from Disk N0035 at offset [140737488355328]
AMDU-00201: Disk N0035: '/dev/sdaw'
AMDU-00200: Unable to read [32768] bytes from Disk N0024 at offset [140737488355328]
AMDU-00201: Disk N0024: '/dev/sdaq'
....

2014-09-04 13:46:16.212934 : OCRASM: proprasmo: Failed to open file in dirty mode

2014-09-04 13:46:16.212964 : OCRASM: proprasmo: dgname is [OCRVOTE] : discoverystring []
2014-09-04 13:46:16.212990 : OCRASM: proprasmo: Error in open/create file in dg [OCRVOTE]
OCRASM: SLOS : SLOS: cat=8, opn=kgfolclcpi1, dep=200, loc=kgfokge

2014-09-04 13:46:16.213075 : OCRASM: ASM Error Stack :

....
2014-09-04 13:46:22.690905 : OCRASM: proprasmo: kgfoCheckMount returned [7]
2014-09-04 13:46:22.690933 : OCRASM: proprasmo: The ASM instance is down
2014-09-04 13:46:22.692150 : OCRRAW: proprioo: Failed to open [+OCRVOTE/sipr0-dbhv1/OCRFILE/registry.255.857389203]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2014-09-04 13:46:22.692204 : OCRRAW: proprioo: No OCR/OLR devices are usable
2014-09-04 13:46:22.692239 : OCRRAW: proprinit: Could not open raw device
2014-09-04 13:46:22.692561 : default: a_init:7!: Backend init unsuccessful : [26]
2014-09-04 13:46:22.692777 : OCRDUMP: Failed to initailized OCR context. Error [PROC-26: Error while accessing the physical storage
] [26].
2014-09-04 13:46:22.692822 : OCRDUMP: Failed to initialize ocrdump stage 2
2014-09-04 13:46:22.692864 : OCRDUMP: Exiting [status=failed]...

4. Case가 2~3가지 정도 되는데 해당 Case 인 경우 patch 18456643 를 받아서 적용해준다.

  patch 는 모든 노드에 다 적용해 주어야 한다.(이게 거지같은게 이미 grid가 설치되어 있어야 패치가 적용되므로 어차피 한번은 설치를
  실패하고 진행해야 함)
   
5.  이미 작업이 실패해서 1번 노드에 grid 가 올라와 있으므로 deconfig 해주고 패치 일괄적용.

root.sh 를 자동으로 모든노드에서 수행하게 했을 경우 2번,3번 노드에 실패한 정보가 있으므로 역시 2번,3번도 deconfig 해줘야 한다.

(설치시 root.sh 를 자동으로 수행하는 옵션이 있는데 절대 하지 말자..노드순서가 꼬임)

2번,3번에서
$GRID_HOME/crs/install/rootcrs.pl -verbose -deconfig -force

1번에서
$GRID_HOME/crs/install/rootcrs.pl -verbose -deconfig -force -lastnode

deconfig 안해주면 cluster patch 정보가 맞지 않아 기동시 다음과 같은 에러 발생

>  CRS-6706: Oracle Clusterware Release patch level ('4137922036') does not match Software patch level ('0'). Oracle Clusterware cannot be started.

(문서 ID 1639285.1)
해당 명령어로 각 노드의 패치를 확인한다.

<GI_HOME>/bin/kfod op=patches
<GI_HOME>/bin/kfod op=patchlvl

export ORACLE_HOME=/oragrid/product/12.1.0.2
opatch apply /oragrid/18456643

opatch rollback -id 18456643

버전 같은데 동일한 에러날 경우 reboot 하면 해결된다.

6. 다시 순서대로 root.sh 를 돌려서 실행한다.

root.sh 이후의 실패해서 GUI 화면이 사라졌으므로 config 작업은

$GRID_HOME/cfgtoollogs/configToolAllCommands 을 수행해서 마무리 한다.

Default 환경이 아닌 사이트 설치환경에 맞게 Customizing 하여 사용할수 있다.

===================================

[EXA1]root@exa1:/opt/oracle.SupportTools/onecommand/linux-x64/properties# cat es.properties

# Common properties shared across all platforms

#

DBFSDGNAME=DBFS_DG

ONECMDDIR=/opt/oracle.SupportTools/onecommand

SOFTWAREDIR={ONECMDDIR}/Software

EXACHKDIR=/opt/oracle.SupportTools/exachk

# This path changes before we switch to production

#GRIDINSTALLERPATH=clusterware/Disk1

GRIDINSTALLERPATH=grid

GRIDINSTALLERPATHSHIPHOME=clusterware/Disk1

DBINSTALLERPATH=database

DBINSTALLERPATHSHIPHOME=database/Disk1

GRID112040SuccessMessage=The installation of Oracle Grid Infrastructure 11g was successful.

PATCHDIR={SOFTWAREDIR}/patches

CELLDIR=/opt/oracle.cellos

EXADATAFILE=/opt/oracle.cellos/ORACLE_CELL_OS_IS_SETUP

CHARSET=AL32UTF8

NLSCHARSET=AL16UTF16

SYSAUXSIZE=16384

TEMPSIZE=32767

REDOFILESIZE=4096

PGA_MAX_SIZE_X4800=4G

PGA_MAX_SIZE_SSC=8G

PGA_MAX_SIZE_VM_SMALL=1G

AUSIZE=4

Avm121000TemplateFileName=AVM_X2_2_121000.dbt

AVMSYSUSER=AVMSYSUSER

# CLUSTERWARE PARAMETERS

## default is 60

## Best practice is 60

CSSMISSCOUNTVALUE=60

## default is 0

CSSDIAGWAITVALUE=13

# Clusterware installation zip files - should be in WorkDir

### Linux

CRS_LinuxPhysical_11.2.0.2=p10098816_112020_Linux-x86-64_3of7.zip

CRS_LinuxPhysical_11.2.0.3=p10404530_112030_Linux-x86-64_3of7.zip

CRS_LinuxPhysical_11.2.0.4=p13390677_112040_Linux-x86-64_3of7.zip

# 12.1 stuff - get zip file name from shiphome

# linuxamd64_12c_database_1of2.zip, linuxamd64_12c_database_2of2.zip,

#CRS_LinuxPhysical_12.1.0.0=p99999999_121010_Linux-x86-64_1of7.zip,\

  #p99999999_121010_Linux-x86-64_2of7.zip,

CRS_LinuxPhysical_12.1.0.0=linuxamd64_12c_grid_1of2.zip,\

  linuxamd64_12c_grid_2of2.zip

CRS_LinuxPhysical_12.1.0.1=linuxamd64_12c_grid_1of2.zip,\

  linuxamd64_12c_grid_2of2.zip

### Solaris Intel

CRS_SolarisPhysical_11.2.0.2=p10098816_112020_Solaris86-64_3of6.zip

CRS_SolarisPhysical_11.2.0.3=p10404530_112030_Solaris86-64_3of6.zip

CRS_SolarisPhysical_11.2.0.4=p13390677_112040_Solaris86-64_3of6.zip

CRS_SolarisPhysical_12.1.0.0=solaris.x64_12cR1_grid_1of2.zip,\

  solaris.x64_12cR1_grid_2of2.zip

CRS_SolarisPhysical_12.1.0.1=solaris.x64_12cR1_grid_1of2.zip,\

  solaris.x64_12cR1_grid_2of2.zip

### Solaris Sparc

CRS_SolarisSSC_11.2.0.2=p10098816_112020_SOLARIS64_3of7.zip

CRS_SolarisSSC_11.2.0.3=p10404530_112030_SOLARIS64_3of7.zip

CRS_SolarisSSC_11.2.0.4=p13390677_112040_SOLARIS64_3of7.zip

CRS_SolarisSSC_12.1.0.0=solaris.sparc64_12cR1_grid_1of2.zip,\

  solaris.sparc64_12cR1_grid_2of2.zip

CRS_SolarisSSC_12.1.0.1=solaris.sparc64_12cR1_grid_1of2.zip,\

  solaris.sparc64_12cR1_grid_2of2.zip

# Database installation zip files

### Linux

DB_LinuxPhysical_11.2.0.2=p10098816_112020_Linux-x86-64_1of7.zip,\

  p10098816_112020_Linux-x86-64_2of7.zip

DB_LinuxPhysical_11.2.0.3=p10404530_112030_Linux-x86-64_1of7.zip,\

  p10404530_112030_Linux-x86-64_2of7.zip

DB_LinuxPhysical_11.2.0.4=p13390677_112040_Linux-x86-64_1of7.zip,\

  p13390677_112040_Linux-x86-64_2of7.zip

#DB_LinuxPhysical_12.1.0.0=p99999999_121010_Linux-x86-64_3of7.zip,\

  #p99999999_121010_Linux-x86-64_4of7.zip

DB_LinuxPhysical_12.1.0.0=linuxamd64_12c_database_1of2.zip,\

  linuxamd64_12c_database_2of2.zip

DB_LinuxPhysical_12.1.0.1=linuxamd64_12c_database_1of2.zip,\

  linuxamd64_12c_database_2of2.zip

### Solaris Intel

DB_SolarisPhysical_11.2.0.2=p10098816_112020_Solaris86-64_1of6.zip,\

 p10098816_112020_Solaris86-64_2of6.zip

DB_SolarisPhysical_11.2.0.3=p10404530_112030_Solaris86-64_1of6.zip,\

    p10404530_112030_Solaris86-64_2of6.zip,\

    p10404530_112030_Solaris86-64_3of6.zip

DB_SolarisPhysical_11.2.0.4=p13390677_112040_Solaris86-64_1of6.zip,\

  p13390677_112040_Solaris86-64_2of6.zip

DB_SolarisPhysical_12.1.0.0=solaris.x64_12cR1_database_1of2.zip,\

  solaris.x64_12cR1_database_2of2.zip

DB_SolarisPhysical_12.1.0.1=solaris.x64_12cR1_database_1of2.zip,\

  solaris.x64_12cR1_database_2of2.zip

### Solaris Sparc

DB_SolarisSSC_11.2.0.2=p10098816_112020_SOLARIS64_1of7.zip,\

  p10098816_112020_SOLARIS64_2of7.zip

DB_SolarisSSC_11.2.0.3=p10404530_112030_SOLARIS64_1of7.zip,\

  p10404530_112030_SOLARIS64_2of7.zip

DB_SolarisSSC_11.2.0.4=p13390677_112040_SOLARIS64_1of7.zip,\

  p13390677_112040_SOLARIS64_2of7.zip

DB_SolarisSSC_12.1.0.0=solaris.sparc64_12cR1_database_1of2.zip,\

  solaris.sparc64_12cR1_database_2of2.zip

DB_SolarisSSC_12.1.0.1=solaris.sparc64_12cR1_database_1of2.zip,\

  solaris.sparc64_12cR1_database_2of2.zip

# Bundle patch list for 11.2.0.2, format is patch#:bundlepatch# cause we can

# skip index numbers and we're not always consistent

BUNDLE_PATCH_LIST_112020=13395584:13,13556724:14,13603787:15,13837673:16,\

  14084153:17:14461970:18,15835121:19,16310984:20

# Bundle patch list for 11.2.0.3

# 7/19/13 Adding BP20 , 10/17/13 Adding BP21

BUNDLE_PATCH_LIST_112030=13556853:3,13667791:4,13734832:5,13870089:6,13992240:7,\

  14103267:8,14229857:9,14352236:10,14474780:11,14662263:12,14786157:13,15835102:14, \

  16039087:15,16233552:16,16474946:17,16627873:18,16784993:19,16869210:20, \

  17395890:21,17747147:22

# Bundle patch list for 11.2.0.4

BUNDLE_PATCH_LIST_112040=17628025:1,17838803:2,17904156:3

# bundle patch list for 12.

BUNDLE_PATCH_LIST_121000=17272829:1,17735306:2

BUNDLE_PATCH_LIST_121010=17272829:1,17735306:2

#ONE OFF PATCHES

# - hyphen signifies the patch delimiter

# : colon signifies the BP the preceding patches are applicable to

# , comma separates BP releases

#samples

# 2 patches for BP10 1 for BP11

# 21222-21223:10,21224:11

#

ONEOFF_PATCH_LIST_112020_GRID=

ONEOFF_PATCH_LIST_112020_RAC=

#

# if 11.2.0.3 and  BP21 then  ensure they apply  16057129 - see bug 18070968

ONEOFF_PATCH_LIST_112030_GRID=

ONEOFF_PATCH_LIST_112030_RAC=16057129:21

# 17612092  is added ontop of base 11.2.0.4 base

#   it contains(  17313525, 17265217, 17546761, 14852021, 16863422, 16837842, 17446237  17465741, 17443671)

#   and is applicable to  both 11.2..4 homes

# 17629416 is a merge request on top of 11.2.0.4.0 for bugs 16346413 17065496 17551223

#   and is applicable to the grid home only

ONEOFF_PATCH_LIST_112040_GRID=17612092-17629416:0

ONEOFF_PATCH_LIST_112040_RAC=17612092:0

# 17272829 - Upcoming 12.1.0.1 bundle/PSU whatever we're calling it now. Changed bundle.xml format

# and also requires new Opatch

# if 12.1.0.1 and PSU1 then ensure they appply  16057129 - see bug 18070968

ONEOFF_PATCH_LIST_121010_GRID=

ONEOFF_PATCH_LIST_121010_RAC=16057129:1

ORAINSTROOT=orainstRoot.sh

ROOTSH=root.sh

ROOTPASSWORD=welcome1

OPATCHNUM=6880880

BUNDLEFILENAME=bundle.xml

OCMRSPFILE=onecommand-default-ocm.rsp

CELLIPINITDIR=/etc/oracle/cell/network-config

LINUXPHYSICAL=LinuxPhysical

LINUXDOM0=LinuxDom0

LINUXGUEST=LinuxGuest

SOLARISPHYSCIAL=SolarisPhysical

SOLARISSPARCPHYSICAL=SolarisSSC

SOLARISLDOM=SolarisLdom

SOLARISZONE=SolarisZone

RECONTROLFILE=resourcecontrol

REBOOTCMD=reboot

RESOURCECONTROLCMD=/opt/oracle.SupportTools/resourcecontrol

RESOURCECONTROLCMDCOREFLAG=core

RESOURCECONTROLCMDSHOWFLAG=show

CELLCLI=cellcli -e

ENABLEEIGHTRACK=alter cell eighthRack=TRUE

DISABLEEIGHTRACK=alter cell eighthRack=FALSE

# Imageversion:zip filename,Imageversion:zipfilename so we get to support

# multiple image versions when we get there.

#DBMOG=

DBMOG=112330:E13877_01.zip

DBMOGDOCDESTLOC=/opt/oracle/cell/doc

#

NUMCOMPUTECORES=8

NUMCELLCORES=6

ALLCORES=All

# MachineTypes

X3CELLMACHINETYPE=SUN_FIRE_X4270_M3

X4CELLMACHINETYPE=SUN_SERVER_X4-2L

NODELISTENERUSERNAME=nlistener

NODELISTENERUSERID=54212

VMSIZES=small,medium,large

VMATTRIBUTELIST=cpuCount,MemorySize,DiskSize

RESCONTROLFILE=resourcecontrol

SOLARISUBIOSPKG=solaris-ubiosfiles.tar.gz

SUPTOOLDIR=/opt/oracle.SupportTools

SSCZONETOOLDIR=/opt/oracle.supercluster/zonetools/ssc_exavm

# 20Gb in MB per zone

MAXZONEMEMORY=20971520

# Move this to solaris props

SVCADM=/usr/sbin/svcadm

UIENABLENEWREPORT=true

##UI

UISHOWCONSOLE=false

UIUSENEWMASKS=true

UIENABLEDEPLOY=false

UIENABLEAVM=false

UIENABLEM6=true

FAKERESECURE=false

============================================================

노드추가 (node1,node2 존재  node3 추가시)

1. 클러스터 무결성 확인

cluvfy stage -pre nodeadd -n node3 [-verbose]

2. addNode 로 cluster 확장

export IGNORE_PREADDNODE_CHECKS=Y

cd Oracle_home/oui/bin

$ ./addNode.sh "CLUSTER_NEW_NODES={node3}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={node3-vip}"

multiple 일 경우 , 로 노드구분

3. node 3에서 root 유저로

Grid_home/root.sh

4. 클러스터 무결성 확인

cluvfy stage -post nodeadd -n node3 [-verbose]

============================================================

노드제거  (node1,node2,node3 존재  node3 제거시)

1. olsnodes -s -t

(노드가 unpined 되었는지 확인)

2. root 유저로 

cd Grid_home/crs/install

/rootcrs.pl -deconfig -force

3. root 유저로 남아있는 노드에서

crsctl delete node -n node1

4. 지워질 노드에서

./runInstaller -updateNodeList ORACLE_HOME=Grid_home "CLUSTER_NODES={node3}" CRS=TRUE -silent -local

5. 지워질 노드에서 

$ Grid_home/deinstall/deinstall -local

6. 남아있는 노드에서 

./runInstaller -updateNodeList ORACLE_HOME=Grid_home "CLUSTER_NODES={node1,node2}" CRS=TRUE -silent

7. 해당 노드가 잘 지워졌는지 확인

cluvfy stage -post nodedel -n node3 [-verbose]

DB Node 쪽

[EXA1]root@exa1:/etc/oracle/cell/network-config# cat cellinit.ora

ipaddress1=192.168.10.8/24

[EXA1]root@exa1:/etc/oracle/cell/network-config# cat cellip.ora

cell="192.168.10.1"

cell="192.168.10.2"

cell="192.168.10.3"

X4-2 인 경우 Active-Active 이므로 1개 더 추가. Cell 도 마찬가지..

[EXA1]root@exa1:/etc/oracle/cell/network-config# cat cellinit.ora

ipaddress1=192.168.10.8/24

ipaddress2=192.168.10.9/24

[EXA1]root@exa1:/etc/oracle/cell/network-config# cat cellip.ora

cell="192.168.10.1;192.168.10.4"

cell="192.168.10.2;192.168.10.5"

cell="192.168.10.3;192.168.10.6"

Cell node 쪽

[root@gtceladm01 config]# cat /opt/oracle/cell11.2.3.3.0_LINUX.X64_131014.1/cellsrv/deploy/config/cellinit.ora

#CELL Initialization Parameters

version=0.0

HTTP_PORT=8888

bbuChargeThreshold=800

SSL_PORT=23943

RMI_PORT=23791

_cell_fc_persistence_state=WriteBack

ipaddress1=192.168.10.1/24

bbuTempThreshold=60

DEPLOYED=TRUE

JMS_PORT=9127

BMC_SNMP_PORT=162

멀티랙 구성시 Exadata 에서는 Subnet Manager 는 반드시 내려야 함.

Exalogic에서는 아래과 같이 변경해줌. Spine 은 8 leaf 는 5

Exadata ib switch priority 5 - > 8 로 변경 작업

[root@gtsw-iba01 ~]# setsmpriority list

Current SM settings:

smpriority 5

controlled_handover TRUE

subnet_prefix 0xfe80000000000000

[root@gtsw-iba01 ~]# disablesm

Stopping partitiond daemon.                                [  OK  ]

Stopping IB Subnet Manager..                               [  OK  ]

[root@gtsw-iba01 ~]# setsmpriority 8

Current SM settings:

smpriority 8

controlled_handover TRUE

subnet_prefix 0xfe80000000000000

[root@gtsw-iba01 ~]# enablesm

Starting IB Subnet Manager.                                [  OK  ]

Starting partitiond daemon.                                [  OK  ]

[root@gtsw-iba01 ~]# setsmpriority list

Current SM settings:

smpriority 8

controlled_handover TRUE

subnet_prefix 0xfe80000000000000

em 12c 의 default port list

설치시 제공하는 화면 참고

아래와 같은 script 로 oracle 옵션의 사용유무를 Check 할수 있다.

dba_feature_usage_statistics 뷰를 사용한다.

====================================================

SET LINESIZE 180;

SET PAGESIZE 1000;

SET FEEDBACK OFF;

SET COLSEP '|';

WHENEVER SQLERROR EXIT SQL.SQLCODE;

COL "Host Name" FORMAT A30;

COL "Option/Management Pack" FORMAT A60;

COL "Used" FORMAT A5;

with features as(

select a OPTIONS, b NAME  from

(

select 'Active Data Guard' a,  'Active Data Guard - Real-Time Query on Physical Standby' b from dual

union all 

select 'Advanced Compression', 'HeapCompression' from dual

union all

select 'Advanced Compression', 'Backup BZIP2 Compression' from dual

union all 

select 'Advanced Compression', 'Backup DEFAULT Compression' from dual

union all 

select 'Advanced Compression', 'Backup HIGH Compression' from dual

union all

select 'Advanced Compression', 'Backup LOW Compression' from dual

union all

select 'Advanced Compression', 'Backup MEDIUM Compression' from dual

union all

select 'Advanced Compression', 'Backup ZLIB, Compression' from dual

union all

select 'Advanced Compression', 'SecureFile Compression (user)' from dual

union all

select 'Advanced Compression', 'SecureFile Deduplication (user)' from dual

union all

select 'Advanced Compression',        'Data Guard' from dual

union all

select 'Advanced Compression', 'Oracle Utility Datapump (Export)' from dual

union all

select 'Advanced Compression', 'Oracle Utility Datapump (Import)' from dual

union all

select 'Advanced Security', 'ASO native encryption and checksumming' from dual

union all

select 'Advanced Security', 'Transparent Data Encryption' from dual

union all

select 'Advanced Security', 'Encrypted Tablespaces' from dual

union all

select 'Advanced Security', 'Backup Encryption' from dual

union all

select 'Advanced Security', 'SecureFile Encryption (user)' from dual

union all

select 'Change Management Pack', 'Change Management Pack (GC)' from dual

union all

select 'Data Masking Pack', 'Data Masking Pack (GC)' from dual

union all

select 'Data Mining', 'Data Mining' from dual

union all

select 'Diagnostic Pack',   'Diagnostic Pack' from dual

union all

select 'Diagnostic Pack',   'ADDM' from dual

union all

select 'Diagnostic Pack',   'AWR Baseline' from dual

union all

select 'Diagnostic Pack',   'AWR Baseline Template' from dual

union all

select 'Diagnostic Pack',   'AWR Report' from dual

union all

select 'Diagnostic Pack',   'Baseline Adaptive Thresholds' from dual

union all

select 'Diagnostic Pack',   'Baseline Static Computations' from dual

union all

select 'Tuning  Pack',   'Tuning Pack' from dual

union all

select 'Tuning  Pack',   'Real-Time SQL Monitoring' from dual

union all

select 'Tuning  Pack',   'SQL Tuning Advisor' from dual

union all

select 'Tuning  Pack',   'SQL Access Advisor' from dual

union all

select 'Tuning  Pack',   'SQL Profile' from dual

union all

select 'Tuning  Pack',   'Automatic SQL Tuning Advisor' from dual

union all

select 'Database Vault',   'Oracle Database Vault' from dual

union all

select 'WebLogic Server Management Pack Enterprise Edition',   'EM AS Provisioning and Patch Automation (GC)' from dual

union all

select 'Configuration Management Pack for Oracle Database',   'EM Config Management Pack (GC)' from dual

union all

select 'Provisioning and Patch Automation Pack for Database',   'EM Database Provisioning and Patch Automation (GC)' from dual

union all

select 'Provisioning and Patch Automation Pack',   'EM Standalone Provisioning and Patch Automation Pack (GC)' from dual

union all

select 'Exadata',   'Exadata' from dual

union all

select 'Label Security',   'Label Security' from dual

union all

select 'OLAP',   'OLAP - Analytic Workspaces' from dual

union all

select 'Partitioning',   'Partitioning (user)' from dual

union all

select 'Real Application Clusters',   'Real Application Clusters (RAC)' from dual

union all

select 'Real Application Testing',   'Database Replay: Workload Capture' from dual

union all

select 'Real Application Testing',   'Database Replay: Workload Replay' from dual

union all

select 'Real Application Testing',   'SQL Performance Analyzer' from dual

union all

select 'Spatial' ,'Spatial (Not used because this does not differential usage of spatial over locator, which is free)' from dual

union all

select 'Total Recall', 'Flashback Data Archive' from dual

)

)

select t.o "Option/Management Pack", 

       t.u "Used",

       d.DBID "DBID",

       d.name "DB Name",

       i.version "DB Version",

       i.host_name "Host Name",

       to_char(sysdate, 'YYYY-MM-DD HH24:MI:SS') "ReportGen Time"

from

(select OPTIONS o, DECODE(sum(num),0,'NO','YES') u

from

(

select f.OPTIONS OPTIONS, case

                   when f_stat.name is null then 0

                   when ( ( f_stat.currently_used = 'TRUE' and

                            f_stat.detected_usages > 0 and

                            (sysdate - f_stat.last_usage_date) < 366 and

                            f_stat.total_samples > 0

                          )

                          or 

                          (f_stat.detected_usages > 0 and 

                          (sysdate - f_stat.last_usage_date) < 366 and

                          f_stat.total_samples > 0)

                        ) and 

                        ( f_stat.name not in('Data Guard', 'Oracle Utility Datapump (Export)', 'Oracle Utility Datapump (Import)')

                          or

                          (f_stat.name in('Data Guard', 'Oracle Utility Datapump (Export)', 'Oracle Utility Datapump (Import)') and

                           f_stat.feature_info is not null and trim(substr(to_char(feature_info), instr(to_char(feature_info), 'compression used: ',1,1) + 18, 2)) != '0')

                        )

                        then 1

                   else 0

                  end num

  from features f,

       sys.dba_feature_usage_statistics f_stat

where f.name = f_stat.name(+)

) group by options) t,

  v$instance i,

  v$database d

order by 2 desc,1 

;

exit;

올해 초 쯤에 작성한 Exadata 설치문서 PPT 

Exadata Setup &amp; Install(김종인).ppt