2021.5.20

 

* 테스트 환경 : RHEL 7.7, 2node RAC 19.10 버전

 

- crs deconfig 테스트 (-keepdg 옵션을 사용하여 Diskgroup 을 그대로 살릴수 있는 지 테스트 하기 위함)

-  단 keepdg 옵션은 11.2.0.3.2 GI PSU 부터 사용 가능함.

- ASM 환경에서 CRS 를 Deconfig 후 재구성 작업했을 때 RMAN 백업본이 없으면 기존 ASM Diskgroup 삭제되면서 Data도 모두 유실된다.  

 

- 작업전 md_backup 명령어를 이용하여 ASM Metadata Backup 하였으나 이것만 가지고는 Data를 그대로 살릴수 없음.  Diskgroup Metadata 구조만 백업이 됨.

 

ASMCMD [+] > md_backup /home/oracle/md_backup

Disk group metadata to be backed up: DATA

Disk group metadata to be backed up: RECO

Disk group metadata to be backed up: VOTE

Current alias directory path: TEST/PARAMETERFILE

Current alias directory path: TEST/DATAFILE

Current alias directory path: TEST

Current alias directory path: TEST/CONTROLFILE

Current alias directory path: TEST/PASSWORD

Current alias directory path: TEST/TEMPFILE

Current alias directory path: TEST/ONLINELOG

Current alias directory path: TEST

Current alias directory path: TEST/ARCHIVELOG/2021_03_23

Current alias directory path: TEST/ARCHIVELOG/2021_05_20

Current alias directory path: TEST/ARCHIVELOG/2021_03_31

Current alias directory path: TEST/ARCHIVELOG/2021_02_16

Current alias directory path: TEST/ARCHIVELOG/2021_03_22

Current alias directory path: TEST/ARCHIVELOG

Current alias directory path: TEST/ARCHIVELOG/2021_02_05

Current alias directory path: ASM

Current alias directory path: rac-cluster/OCRFILE

Current alias directory path: ASM/PASSWORD

Current alias directory path: rac-cluster

Current alias directory path: rac-cluster/ASMPARAMETERFILE

Current alias directory path: rac-cluster/OCRBACKUP

 

1. crs 상태 확인

[root@rac1 ~]# crsctl stat res -t

--------------------------------------------------------------------------------

Name           Target  State        Server                   State details      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.chad

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.net1.network

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.ons

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.proxy_advm

               OFFLINE OFFLINE      rac1                     STABLE

               OFFLINE OFFLINE      rac2                     STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

      3        ONLINE  OFFLINE                               STABLE

ora.DATA.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac1                     STABLE

ora.RECO.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.VOTE.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.asm(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     Started,STABLE

      2        ONLINE  ONLINE       rac2                     Started,STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.asmnet1.asmnetwork(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.cvu

      1        ONLINE  ONLINE       rac1                     STABLE

ora.qosmserver

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac2.vip

      1        ONLINE  ONLINE       rac2                     STABLE

ora.scan1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

ora.test.db

      1        ONLINE  ONLINE       rac1                     Open,HOME=/u01/app/o

                                                             racle/product/19.3.0

                                                             .0/dbhome_1,STABLE

      2        ONLINE  ONLINE       rac2                     Open,HOME=/u01/app/o

                                                             racle/product/19.3.0

                                                             .0/dbhome_1,STABLE

--------------------------------------------------------------------------------

 

2. 먼저 2번 노드 Deconfig 함 (로그화일을 살펴보면 어떤식으로 삭제하는지 절차 확인 가능)..

[root@rac2 ~]# id

uid=0(root) gid=0(root) groups=0(root)

[root@rac2 ~]# export GI_HOME=/u01/app/19.3.0.0/grid

[root@rac2 ~]# $GI_HOME/perl/bin/perl $GI_HOME/crs/install/rootcrs.pl -deconfig -force -verbose

Using configuration parameter file: /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

  /u01/app/oracle/crsdata/rac2/crsconfig/crsdeconfig_rac2_2021-05-20_09-08-52PM.log

Redirecting to /bin/systemctl restart rsyslog.service

2021/05/20 21:09:54 CLSRSC-4006: Removing Oracle Trace File Analyzer (TFA) Collector.

2021/05/20 21:09:54 CLSRSC-4007: Successfully removed Oracle Trace File Analyzer (TFA) Collector.

2021/05/20 21:09:54 CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node

[root@rac2 ~]# vi /u01/app/oracle/crsdata/rac2/crsconfig/crsdeconfig_rac2_2021-05-20_09-08-52PM.log

2021-05-20 21:08:52: Checking parameters from paramfile /u01/app/19.3.0.0/grid/crs/install/crsconfig_params to validate installer variables

2021-05-20 21:08:52: Skipping validation for ODA_CONFIG

2021-05-20 21:08:52: Skipping validation for OPC_CLUSTER_TYPE

2021-05-20 21:08:52: Skipping validation for OPC_NAT_ADDRESS

2021-05-20 21:08:52: Skipping validation for RHP_PROVISIONED

2021-05-20 21:08:52: Skipping validation for SCAN_CREDENTIALS

2021-05-20 21:08:52: Skipping validation for SCAN_IPS

2021-05-20 21:08:52: Skipping validation for SCAN_TYPE

2021-05-20 21:08:52: Install node: rac1

2021-05-20 21:08:52: Current node is not the install node

2021-05-20 21:08:52: The configuration parameter file /u01/app/19.3.0.0/grid/crs/install/crsconfig_params  is valid

2021-05-20 21:08:52: Run command --/u01/app/19.3.0.0/grid/bin/oraversion -libVersion-- as oracle

2021-05-20 21:08:52: /u01/app/19.3.0.0/grid/bin/oraversion -libVersion successfully executed

2021-05-20 21:08:52: Command output:

>  19

>End Command output

2021-05-20 21:08:52: "/u01/app/19.3.0.0/grid/bin/oraversion -libVersion" output: 19

 

2021-05-20 21:08:52: Run command --/u01/app/19.3.0.0/grid/bin/oraversion -majorVersion-- as oracle

2021-05-20 21:08:52: /u01/app/19.3.0.0/grid/bin/oraversion -majorVersion successfully executed

2021-05-20 21:08:52: Command output:

>  19

>End Command output

2021-05-20 21:08:52: "/u01/app/19.3.0.0/grid/bin/oraversion -majorVersion" output: 19

 

2021-05-20 21:08:52: ### Printing the configuration values from files:

2021-05-20 21:08:52:    /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

2021-05-20 21:08:52:    /u01/app/19.3.0.0/grid/crs/install/s_crsconfig_defs

2021-05-20 21:08:52: AFD_CONF=false

2021-05-20 21:08:52: APPLICATION_VIP=

2021-05-20 21:08:52: ASMCA_ARGS=

2021-05-20 21:08:52: ASM_CONFIG=near

2021-05-20 21:08:52: ASM_CREDENTIALS=

2021-05-20 21:08:52: ASM_DISCOVERY_STRING=/dev/sd*

"/u01/app/oracle/crsdata/rac2/crsconfig/crsdeconfig_rac2_2021-05-20_09-08-52PM.log" 802L, 51062C

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sAevm

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sAevm_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_IPC_SOCKET_11

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_IPC_SOCKET_11_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_UI_SOCKET

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_UI_SOCKET_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2_

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2__lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2_rac-cluster

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2_rac-cluster_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_IPC_SOCKET_11

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_IPC_SOCKET_11_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_UI_SOCKET

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_UI_SOCKET_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sora_crsqs

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sora_crsqs_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOracle_CSS_LclLstnr_rac-cluster_2

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOracle_CSS_LclLstnr_rac-cluster_2_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROL

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROL_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sSYSTEM.evm.acceptor.auth

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sSYSTEM.evm.acceptor.auth_lock

2021-05-20 21:09:54: Root script is not invoked as part of deinstall. /u01/app/oracle/oradiag_root, /etc/oracle/maps, and /etc/oracle/setasmgid are not removed

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/profiles/peer

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/peer

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/prdr

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/pa

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/root

2021-05-20 21:09:54: removing gpnp backup directory /u01/app/19.3.0.0/grid/gpnp/gpnp_bcp__2021_2_4_163525

2021-05-20 21:09:54: Executing /etc/init.d/ohasd deinstall

2021-05-20 21:08:52: Checking parameters from paramfile /u01/app/19.3.0.0/grid/crs/install/crsconfig_params to validate installer variables

2021-05-20 21:08:52: Skipping validation for ODA_CONFIG

2021-05-20 21:08:52: Skipping validation for OPC_CLUSTER_TYPE

2021-05-20 21:08:52: Skipping validation for OPC_NAT_ADDRESS

2021-05-20 21:08:52: Skipping validation for RHP_PROVISIONED

2021-05-20 21:08:52: Skipping validation for SCAN_CREDENTIALS

2021-05-20 21:08:52: Skipping validation for SCAN_IPS

2021-05-20 21:08:52: Skipping validation for SCAN_TYPE

2021-05-20 21:08:52: Install node: rac1

2021-05-20 21:08:52: Current node is not the install node

2021-05-20 21:08:52: The configuration parameter file /u01/app/19.3.0.0/grid/crs/install/crsconfig_params  is valid

2021-05-20 21:08:52: Run command --/u01/app/19.3.0.0/grid/bin/oraversion -libVersion-- as oracle

2021-05-20 21:08:52: /u01/app/19.3.0.0/grid/bin/oraversion -libVersion successfully executed

2021-05-20 21:08:52: Command output:

>  19

>End Command output

2021-05-20 21:08:52: "/u01/app/19.3.0.0/grid/bin/oraversion -libVersion" output: 19

 

2021-05-20 21:08:52: Run command --/u01/app/19.3.0.0/grid/bin/oraversion -majorVersion-- as oracle

2021-05-20 21:08:52: /u01/app/19.3.0.0/grid/bin/oraversion -majorVersion successfully executed

2021-05-20 21:08:52: Command output:

>  19

>End Command output

2021-05-20 21:08:52: "/u01/app/19.3.0.0/grid/bin/oraversion -majorVersion" output: 19

 

2021-05-20 21:08:52: ### Printing the configuration values from files:

2021-05-20 21:08:52:    /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

2021-05-20 21:08:52:    /u01/app/19.3.0.0/grid/crs/install/s_crsconfig_defs

2021-05-20 21:08:52: AFD_CONF=false

2021-05-20 21:08:52: APPLICATION_VIP=

2021-05-20 21:08:52: ASMCA_ARGS=

2021-05-20 21:08:52: ASM_CONFIG=near

2021-05-20 21:08:52: ASM_CREDENTIALS=

2021-05-20 21:08:52: ASM_DISCOVERY_STRING=/dev/sd*

2021-05-20 21:08:52: ASM_SPFILE=

2021-05-20 21:08:52: ASM_UPGRADE=false

2021-05-20 21:08:52: BIG_CLUSTER=true

2021-05-20 21:08:52: CDATA_AUSIZE=4

2021-05-20 21:08:52: CDATA_BACKUP_AUSIZE=1

2021-05-20 21:08:52: CDATA_BACKUP_DISKS=

2021-05-20 21:08:52: CDATA_BACKUP_DISK_GROUP=

2021-05-20 21:08:52: CDATA_BACKUP_FAILURE_GROUPS=

2021-05-20 21:08:52: CDATA_BACKUP_QUORUM_GROUPS=

2021-05-20 21:08:52: CDATA_BACKUP_REDUNDANCY=

2021-05-20 21:08:52: CDATA_BACKUP_SITES=

2021-05-20 21:08:52: CDATA_BACKUP_SIZE=0

2021-05-20 21:08:52: CDATA_DISKS=/dev/sdd1,/dev/sde1,/dev/sdf1

2021-05-20 21:08:52: CDATA_DISK_GROUP=VOTE

2021-05-20 21:08:52: CDATA_FAILURE_GROUPS=

2021-05-20 21:08:52: CDATA_QUORUM_GROUPS=

2021-05-20 21:08:52: CDATA_REDUNDANCY=NORMAL

2021-05-20 21:08:52: CDATA_SITES=

2021-05-20 21:08:52: CDATA_SIZE=0

2021-05-20 21:08:52: CLSCFG_MISSCOUNT=

2021-05-20 21:08:52: CLUSTER_CLASS=STANDALONE

2021-05-20 21:08:52: CLUSTER_GUID=

2021-05-20 21:08:52: CLUSTER_NAME=rac-cluster

2021-05-20 21:08:52: CLUSTER_TYPE=DB

2021-05-20 21:08:52: CRS_LIMIT_CORE=unlimited

2021-05-20 21:08:52: CRS_LIMIT_MEMLOCK=unlimited

2021-05-20 21:08:52: CRS_LSNR_STACK=32768

2021-05-20 21:08:52: CRS_NODEVIPS='rac1-vip/255.255.255.0/enp0s3,rac2-vip/255.255.255.0/enp0s3'

2021-05-20 21:08:52: CRS_STORAGE_OPTION=1

2021-05-20 21:08:52: CSS_LEASEDURATION=400

2021-05-20 21:08:52: DC_HOME=

2021-05-20 21:08:52: DIRPREFIX=

2021-05-20 21:08:52: DISABLE_OPROCD=0

2021-05-20 21:08:52: EXTENDED_CLUSTER=false

2021-05-20 21:08:52: EXTENDED_CLUSTER_SITES=rac-cluster

2021-05-20 21:08:52: EXTENDED_CLUSTER_SITE_GUIDS=

2021-05-20 21:08:52: EXTERNAL_ORACLE=/opt/oracle

2021-05-20 21:08:52: EXTERNAL_ORACLE_BIN=/opt/oracle/bin

2021-05-20 21:08:52: GIMR_CONFIG=

2021-05-20 21:08:52: GIMR_CREDENTIALS=

2021-05-20 21:08:52: GNS_ADDR_LIST=

2021-05-20 21:08:52: GNS_ALLOW_NET_LIST=

2021-05-20 21:08:52: GNS_CONF=false

2021-05-20 21:08:52: GNS_CREDENTIALS=

2021-05-20 21:08:52: GNS_DENY_ITF_LIST=

2021-05-20 21:08:52: GNS_DENY_NET_LIST=

2021-05-20 21:08:52: GNS_DOMAIN_LIST=

2021-05-20 21:08:52: GNS_TYPE=

2021-05-20 21:08:52: GPNPCONFIGDIR=/u01/app/19.3.0.0/grid

2021-05-20 21:08:52: GPNPGCONFIGDIR=/u01/app/19.3.0.0/grid

2021-05-20 21:08:52: GPNP_PA=

2021-05-20 21:08:52: HUB_NODE_LIST=rac1,rac2

2021-05-20 21:08:52: HUB_NODE_VIPS=rac1-vip,rac2-vip

2021-05-20 21:08:52: HUB_SIZE=32

2021-05-20 21:08:52: ID=/etc/init.d

2021-05-20 21:08:52: INIT=/sbin/init

2021-05-20 21:08:52: INITCTL=/sbin/initctl

2021-05-20 21:08:52: INSTALL_NODE=rac1

2021-05-20 21:08:52: ISROLLING=true

2021-05-20 21:08:52: IT=/etc/inittab

2021-05-20 21:08:52: JLIBDIR=/u01/app/19.3.0.0/grid/jlib

2021-05-20 21:08:52: JREDIR=/u01/app/19.3.0.0/grid/jdk/jre/

2021-05-20 21:08:52: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8

2021-05-20 21:08:52: LISTENER_USERNAME=oracle

2021-05-20 21:08:52: MGMT_DB=false

2021-05-20 21:08:52: MSGFILE=/var/adm/messages

2021-05-20 21:08:52: NETWORKS="enp0s3"/192.168.56.0:public,"enp0s8"/10.10.10.0:asm,"enp0s8"/10.10.10.0:cluster_interconnect

2021-05-20 21:08:52: NEW_HOST_NAME_LIST=

2021-05-20 21:08:52: NEW_NODEVIPS='rac1-vip/255.255.255.0/enp0s3,rac2-vip/255.255.255.0/enp0s3'

2021-05-20 21:08:52: NEW_NODE_NAME_LIST=

2021-05-20 21:08:52: NEW_PRIVATE_NAME_LIST=

2021-05-20 21:08:52: NODE_NAME_LIST=rac1,rac2

2021-05-20 21:08:52: OCRCONFIG=/etc/oracle/ocr.loc

2021-05-20 21:08:52: OCRCONFIGDIR=/etc/oracle

2021-05-20 21:08:52: OCRID=

2021-05-20 21:08:52: OCRLOC=ocr.loc

2021-05-20 21:08:52: OCR_LOCATIONS=

2021-05-20 21:08:52: ODA_CONFIG=

2021-05-20 21:08:52: OLASTGASPDIR=/etc/oracle/lastgasp

2021-05-20 21:08:52: OLD_CRS_HOME=

2021-05-20 21:08:52: OLRCONFIG=/etc/oracle/olr.loc

2021-05-20 21:08:52: OLRCONFIGDIR=/etc/oracle

2021-05-20 21:08:52: OLRLOC=olr.loc

2021-05-20 21:08:52: OPC_CLUSTER_TYPE=

2021-05-20 21:08:52: OPC_NAT_ADDRESS=

2021-05-20 21:08:52: OPROCDCHECKDIR=/etc/oracle/oprocd/check

2021-05-20 21:08:52: OPROCDDIR=/etc/oracle/oprocd

2021-05-20 21:08:52: OPROCDFATALDIR=/etc/oracle/oprocd/fatal

2021-05-20 21:08:52: OPROCDSTOPDIR=/etc/oracle/oprocd/stop

2021-05-20 21:08:52: ORACLE_BASE=/u01/app/oracle

2021-05-20 21:08:52: ORACLE_HOME=/u01/app/19.3.0.0/grid

2021-05-20 21:08:52: ORACLE_OWNER=oracle

2021-05-20 21:08:52: ORA_ASM_GROUP=dba

2021-05-20 21:08:52: ORA_DBA_GROUP=dba

2021-05-20 21:08:52: PING_TARGETS=

2021-05-20 21:08:52: PRIVATE_NAME_LIST=

2021-05-20 21:08:52: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d

2021-05-20 21:08:52: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d

2021-05-20 21:08:52: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d

2021-05-20 21:08:52: RC_KILL=K15

2021-05-20 21:08:52: RC_KILL_OLD=K96

2021-05-20 21:08:52: RC_KILL_OLD2=K19

2021-05-20 21:08:52: RC_START=S96

2021-05-20 21:08:52: REUSEDG=false

2021-05-20 21:08:52: RHP_CONF=false

2021-05-20 21:08:52: RHP_PROVISIONED=

2021-05-20 21:08:52: RIM_NODE_LIST=

2021-05-20 21:08:52: SCAN_CREDENTIALS=

2021-05-20 21:08:52: SCAN_IPS=0racle_install_crs_OPC_SCAN_IPs%

2021-05-20 21:08:52: SCAN_NAME=rac-scan

2021-05-20 21:08:52: SCAN_PORT=1521

2021-05-20 21:08:52: SCAN_TYPE=LOCAL

2021-05-20 21:08:52: SCRBASE=/etc/oracle/scls_scr

2021-05-20 21:08:52: SILENT=false

2021-05-20 21:08:52: SO_EXT=so

2021-05-20 21:08:52: SRVCFGLOC=srvConfig.loc

2021-05-20 21:08:52: SRVCONFIG=/var/opt/oracle/srvConfig.loc

2021-05-20 21:08:52: SRVCONFIGDIR=/var/opt/oracle

2021-05-20 21:08:52: SYSTEMCTL=/usr/bin/systemctl

2021-05-20 21:08:52: SYSTEMD_SYSTEM_DIR=/etc/systemd/system

2021-05-20 21:08:52: TZ=Asia/Seoul

2021-05-20 21:08:52: UPSTART_INIT_DIR=/etc/init

2021-05-20 21:08:52: USER_IGNORED_PREREQ=true

2021-05-20 21:08:52: VNDR_CLUSTER=false

2021-05-20 21:08:52: VOTING_DISKS=

2021-05-20 21:08:52: ### Printing other configuration values ###

2021-05-20 21:08:52: CLSCFG_EXTRA_PARMS=

2021-05-20 21:08:52: DEBUG=1

2021-05-20 21:08:52: DECONFIG=1

2021-05-20 21:08:52: FORCE=1

2021-05-20 21:08:52: HAS_GROUP=dba

2021-05-20 21:08:52: HAS_USER=root

2021-05-20 21:08:52: HOST=rac2

2021-05-20 21:08:52: OLR_DIRECTORY=/u01/app/oracle/crsdata/rac2/olr

2021-05-20 21:08:52: OLR_LOCATION=/u01/app/oracle/crsdata/rac2/olr/rac2_19.olr

2021-05-20 21:08:52: ORA_CRS_HOME=/u01/app/19.3.0.0/grid

2021-05-20 21:08:52: ORA_VERSION=19

2021-05-20 21:08:52: SIHA=0

2021-05-20 21:08:52: SUCC_REBOOT=0

2021-05-20 21:08:52: SUPERUSER=root

2021-05-20 21:08:52: addfile=/u01/app/19.3.0.0/grid/crs/install/crsconfig_addparams

2021-05-20 21:08:52: cluutil_trc_suff_pp=0

2021-05-20 21:08:52: crscfg_trace=1

2021-05-20 21:08:52: crscfg_trace_file=/u01/app/oracle/crsdata/rac2/crsconfig/crsdeconfig_rac2_2021-05-20_09-08-52PM.log

2021-05-20 21:08:52: old_nodevips=

2021-05-20 21:08:52: osdfile=/u01/app/19.3.0.0/grid/crs/install/s_crsconfig_defs

2021-05-20 21:08:52: parameters_valid=1

2021-05-20 21:08:52: paramfile=/u01/app/19.3.0.0/grid/crs/install/crsconfig_params

2021-05-20 21:08:52: platform_family=unix

2021-05-20 21:08:52: pp_srvctl_trc_suff=0

2021-05-20 21:08:52: srvctl_trc_suff=0

2021-05-20 21:08:52: srvctl_trc_suff_pp=0

2021-05-20 21:08:52: stackStartLevel=11

2021-05-20 21:08:52: user_is_superuser=1

2021-05-20 21:08:52: ### Printing of configuration values complete ###

2021-05-20 21:08:52: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/crsdeconfig_rac2_2021-05-20_09-08-52PM.log

2021-05-20 21:08:52: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/crsdeconfig_rac2_2021-05-20_09-08-52PM.log

2021-05-20 21:08:52: Save the ASM password file location: +VOTE/orapwASM

2021-05-20 21:08:52: Print system environment variables:

2021-05-20 21:08:52: GI_HOME = /u01/app/19.3.0.0/grid

2021-05-20 21:08:52: HISTCONTROL = ignoredups

2021-05-20 21:08:52: HISTSIZE = 1000

2021-05-20 21:08:52: HOME = /root

2021-05-20 21:08:52: HOSTNAME = rac2

2021-05-20 21:08:52: LANG = en_US.UTF-8

2021-05-20 21:08:52: LESSOPEN = ||/usr/bin/lesspipe.sh

2021-05-20 21:08:52: LOGNAME = root

2021-05-20 21:08:52: LS_COLORS = rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:

2021-05-20 21:08:52: MAIL = /var/spool/mail/root

2021-05-20 21:08:52: ORACLE_BASE = /u01/app/oracle

2021-05-20 21:08:52: ORACLE_HOME = /u01/app/19.3.0.0/grid

2021-05-20 21:08:52: PATH = /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin:/u01/app/oracle/product/19.3.0.0/dbhome_1/bin:/u01/app/19.3.0.0/grid/bin:/u01/app/19.3.0.0/grid/OPatch:/u01/app/oracle/product/19.3.0.0/dbhome_1/OPatch

2021-05-20 21:08:52: PWD = /root

2021-05-20 21:08:52: SHELL = /bin/bash

2021-05-20 21:08:52: SHLVL = 1

2021-05-20 21:08:52: SSH_CLIENT = 192.168.56.1 60357 22

2021-05-20 21:08:52: SSH_CONNECTION = 192.168.56.1 60357 192.168.56.91 22

2021-05-20 21:08:52: SSH_TTY = /dev/pts/0

2021-05-20 21:08:52: TERM = vt100

2021-05-20 21:08:52: TZ = Asia/Seoul

2021-05-20 21:08:52: USER = root

2021-05-20 21:08:52: XDG_DATA_DIRS = /root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share

2021-05-20 21:08:52: XDG_RUNTIME_DIR = /run/user/0

2021-05-20 21:08:52: XDG_SESSION_ID = 265

2021-05-20 21:08:52: _ = /u01/app/19.3.0.0/grid/perl/bin/perl

2021-05-20 21:08:52: Perform initialization tasks before configuring AFD

2021-05-20 21:08:52: Perform initialization tasks before configuring ACFS

2021-05-20 21:08:52: Executing pwdx 11788 >/dev/null 2>&1

2021-05-20 21:08:52: Executing cmd: pwdx 11788 >/dev/null 2>&1

2021-05-20 21:08:52: Executing pwdx 11795 >/dev/null 2>&1

2021-05-20 21:08:52: Executing cmd: pwdx 11795 >/dev/null 2>&1

2021-05-20 21:08:52: Executing pwdx 11798 >/dev/null 2>&1

2021-05-20 21:08:52: Executing cmd: pwdx 11798 >/dev/null 2>&1

2021-05-20 21:08:52: Executing pwdx 17834 >/dev/null 2>&1

2021-05-20 21:08:52: Executing cmd: pwdx 17834 >/dev/null 2>&1

2021-05-20 21:08:52: Running /u01/app/19.3.0.0/grid/bin/acfsdriverstate installed -s

2021-05-20 21:08:52: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsdriverstate installed -s

2021-05-20 21:08:52: acfs is installed

2021-05-20 21:08:52: Running /u01/app/19.3.0.0/grid/bin/acfsdriverstate loaded -s

2021-05-20 21:08:52: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsdriverstate loaded -s

2021-05-20 21:08:52: acfs is loaded

2021-05-20 21:08:52: Executing cmd: /sbin/acfsutil info fs "/root" -o mountpoint

2021-05-20 21:08:52: Command output:

>  acfsutil info fs: ACFS-03037: not an ACFS file system

>End Command output

2021-05-20 21:08:52: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stat res ora.drivers.acfs -init

2021-05-20 21:08:52: Command output:

>  NAME=ora.drivers.acfs

>  TYPE=ora.drivers.acfs.type

>  TARGET=ONLINE

>  STATE=ONLINE on rac2

>End Command output

2021-05-20 21:08:52: Performing few checks before running scripts

2021-05-20 21:08:52: running script rootcrs.pl

2021-05-20 21:08:52: Opening file /etc/oracle/ocr.loc

2021-05-20 21:08:52: Value (FALSE) is set for key=local_only

2021-05-20 21:08:52: Attempt to get current working directory

2021-05-20 21:08:52: Running as user oracle: pwd

2021-05-20 21:08:52: Removing file /tmp/iTlC9Pt_vH

2021-05-20 21:08:52:

2021-05-20 21:08:52: Successfully removed file: /tmp/iTlC9Pt_vH

2021-05-20 21:08:52: pipe exit code: 0

2021-05-20 21:08:52: /bin/su successfully executed

 

2021-05-20 21:08:52: The current working directory: /root

2021-05-20 21:08:52: Change working directory to safe directory /u01/app/19.3.0.0/grid

2021-05-20 21:08:52: Pre-checks for running the rootcrs script passed.

2021-05-20 21:08:52: Deconfiguring Oracle Clusterware on this node

2021-05-20 21:08:52: Executing the [DeconfigValidate] step with checkpoint [null] ...

2021-05-20 21:08:52: Perform initialization tasks before configuring OLR

2021-05-20 21:08:52: Perform initialization tasks before configuring OCR

2021-05-20 21:08:52: Perform initialization tasks before configuring CHM

2021-05-20 21:08:52: Perform initialization tasks before configuring ASM

2021-05-20 21:08:52: Perform initialization tasks before configuring SRVM

2021-05-20 21:08:52: Perform prechecks for deconfiguration

2021-05-20 21:08:52: Checking whether current node rac2 has been deconfigured.

2021-05-20 21:08:52: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:08:52: Command output:

>  CRS-4638: Oracle High Availability Services is online

>  CRS-4537: Cluster Ready Services is online

>  CRS-4529: Cluster Synchronization Services is online

>  CRS-4533: Event Manager is online

>End Command output

2021-05-20 21:08:52: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -chkckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED"

2021-05-20 21:08:52: trace file=/u01/app/oracle/crsdata/rac2/crsconfig/cluutil1.log

2021-05-20 21:08:52: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/cluutil1.log

2021-05-20 21:08:52: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/cluutil1.log

2021-05-20 21:08:52: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -chkckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED

2021-05-20 21:08:53: Removing file /tmp/RxEUhsKubX

2021-05-20 21:08:53:

2021-05-20 21:08:53: Successfully removed file: /tmp/RxEUhsKubX

2021-05-20 21:08:53: pipe exit code: 0

2021-05-20 21:08:53: /bin/su successfully executed

 

2021-05-20 21:08:53: FALSE

 

2021-05-20 21:08:53: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/cluutil1.log

2021-05-20 21:08:53: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/cluutil1.log

2021-05-20 21:08:53: FALSE

 

2021-05-20 21:08:53: The property ORACLE_HOME_SHARED for checkpoint ROOTCRS_STACK does not exist,or cluutil -ckpt -oraclebase /u01/app/oracle -chkckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED failed.

2021-05-20 21:08:53: cluutil -ckpt -oraclebase /u01/app/oracle -chkckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED returned with status 0

2021-05-20 21:08:53: Checking if path [/u01/app/19.3.0.0/grid/gpnp] is shared

2021-05-20 21:08:53: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -chkshare -oh /u01/app/19.3.0.0/grid/gpnp -localnode rac2 -nodelist rac1,rac2"

2021-05-20 21:08:53: trace file=/u01/app/oracle/crsdata/rac2/crsconfig/cluutil2.log

2021-05-20 21:08:53: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/cluutil2.log

2021-05-20 21:08:53: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/cluutil2.log

2021-05-20 21:08:53: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -chkshare -oh /u01/app/19.3.0.0/grid/gpnp -localnode rac2 -nodelist rac1,rac2

2021-05-20 21:08:55: Removing file /tmp/ZMJbmnjTI9

2021-05-20 21:08:55:

2021-05-20 21:08:55: Successfully removed file: /tmp/ZMJbmnjTI9

2021-05-20 21:08:55: pipe exit code: 0

2021-05-20 21:08:55: /bin/su successfully executed

 

2021-05-20 21:08:55: FALSE

 

2021-05-20 21:08:55: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/cluutil2.log

2021-05-20 21:08:55: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/cluutil2.log

2021-05-20 21:08:55: Output: FALSE

 

2021-05-20 21:08:55: The path [/u01/app/19.3.0.0/grid/gpnp] is not shared

2021-05-20 21:08:55: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -writeckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED -pvalue false"

2021-05-20 21:08:55: trace file=/u01/app/oracle/crsdata/rac2/crsconfig/cluutil3.log

2021-05-20 21:08:55: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/cluutil3.log

2021-05-20 21:08:55: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/cluutil3.log

2021-05-20 21:08:55: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -writeckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED -pvalue false

2021-05-20 21:08:55: Removing file /tmp/HbGpSUkAB8

2021-05-20 21:08:55:

2021-05-20 21:08:55: Successfully removed file: /tmp/HbGpSUkAB8

2021-05-20 21:08:55: pipe exit code: 0

2021-05-20 21:08:55: /bin/su successfully executed

 

2021-05-20 21:08:55:

2021-05-20 21:08:55: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/cluutil3.log

2021-05-20 21:08:55: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/cluutil3.log

2021-05-20 21:08:55:  "-ckpt -oraclebase /u01/app/oracle -writeckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED -pvalue false" succeeded with status 0.

2021-05-20 21:08:55: Succeeded to add (property/value):('ORACLE_HOME_SHARED/'false') for checkpoint:ROOTCRS_STACK

2021-05-20 21:08:55: ORACLE_HOME is shared: 0

2021-05-20 21:08:55: options=-force

2021-05-20 21:08:55: Validate crsctl command

2021-05-20 21:08:55: Validating /u01/app/19.3.0.0/grid/bin/crsctl

2021-05-20 21:08:55: Executing the [DeconfigResources] step with checkpoint [null] ...

2021-05-20 21:08:55: Verifying the existence of CRS resources used by Oracle RAC databases

2021-05-20 21:08:55: Check if CRS is running

2021-05-20 21:08:55: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:08:55: Running /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:08:55: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:08:55: Command output:

>  CRS-4638: Oracle High Availability Services is online

>  CRS-4537: Cluster Ready Services is online

>  CRS-4529: Cluster Synchronization Services is online

>  CRS-4533: Event Manager is online

>End Command output

2021-05-20 21:08:55: Validate srvctl command

2021-05-20 21:08:55: Validating /u01/app/19.3.0.0/grid/bin/srvctl

2021-05-20 21:08:55: Remove Resources

2021-05-20 21:08:55: Validate srvctl command

2021-05-20 21:08:55: Validating /u01/app/19.3.0.0/grid/bin/srvctl

2021-05-20 21:08:55: Removing nodeapps...

2021-05-20 21:08:55: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl config nodeapps"

2021-05-20 21:08:55: trace file=/u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg1.log

2021-05-20 21:08:55: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl config nodeapps

2021-05-20 21:09:01: Command output:

>  Network 1 exists

>  Subnet IPv4: 192.168.56.0/255.255.255.0/enp0s3, static

>  Subnet IPv6:

>  Ping Targets:

>  Network is enabled

>  Network is individually enabled on nodes:

>  Network is individually disabled on nodes:

>  VIP exists: network number 1, hosting node rac1

>  VIP Name: rac1-vip

>  VIP IPv4 Address: 192.168.56.92

>  VIP IPv6 Address:

>  VIP is enabled.

>  VIP is individually enabled on nodes:

>  VIP is individually disabled on nodes:

>  VIP exists: network number 1, hosting node rac2

>  VIP Name: rac2-vip

>  VIP IPv4 Address: 192.168.56.93

>  VIP IPv6 Address:

>  VIP is enabled.

>  VIP is individually enabled on nodes:

>  VIP is individually disabled on nodes:

>  ONS exists: Local port 6100, remote port 6200, EM port 2016, Uses SSL true

>  ONS is enabled

>  ONS is individually enabled on nodes:

>  ONS is individually disabled on nodes:

>End Command output

2021-05-20 21:09:01: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg1.log

2021-05-20 21:09:01: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg1.log

2021-05-20 21:09:01: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl stop nodeapps -n rac2 -f"

2021-05-20 21:09:01: trace file=/u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg2.log

2021-05-20 21:09:01: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl stop nodeapps -n rac2 -f

2021-05-20 21:09:04: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg2.log

2021-05-20 21:09:04: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg2.log

2021-05-20 21:09:04: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl remove vip -i rac2 -y -f"

2021-05-20 21:09:04: trace file=/u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg3.log

2021-05-20 21:09:04: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl remove vip -i rac2 -y -f

2021-05-20 21:09:06: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg3.log

2021-05-20 21:09:06: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac2/crsconfig/srvmcfg3.log

2021-05-20 21:09:06: Deconfiguring Oracle ASM or shared filesystem storage ...

2021-05-20 21:09:06: Stopping Oracle Clusterware ...

2021-05-20 21:09:06: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stop crs  -f

2021-05-20 21:09:34: Command output:

>  CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2'

>  CRS-2673: Attempting to stop 'ora.crsd' on 'rac2'

>  CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'rac2'

>  CRS-2673: Attempting to stop 'ora.test.db' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.chad' on 'rac2'

>  CRS-2677: Stop of 'ora.test.db' on 'rac2' succeeded

>  CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'rac2'

>  CRS-2673: Attempting to stop 'ora.RECO.dg' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.VOTE.dg' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac2'

>  CRS-2677: Stop of 'ora.VOTE.dg' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.RECO.dg' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.DATA.dg' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.asm' on 'rac2'

>  CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac2'

>  CRS-2677: Stop of 'ora.chad' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'rac2'

>  CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'rac2' succeeded

>  CRS-33677: Stop of resource group 'ora.asmgroup' on server 'rac2' succeeded.

>  CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac2' has completed

>  CRS-2677: Stop of 'ora.crsd' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.storage' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.crf' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac2'

>  CRS-2677: Stop of 'ora.storage' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.asm' on 'rac2'

>  CRS-2677: Stop of 'ora.crf' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.drivers.acfs' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.mdnsd' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac2'

>  CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.evmd' on 'rac2'

>  CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.evmd' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.cssd' on 'rac2'

>  CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded

>  CRS-2673: Attempting to stop 'ora.gipcd' on 'rac2'

>  CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac2'

>  CRS-2677: Stop of 'ora.gipcd' on 'rac2' succeeded

>  CRS-2677: Stop of 'ora.gpnpd' on 'rac2' succeeded

>  CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2' has completed

>  CRS-4133: Oracle High Availability Services has been stopped.

>End Command output

2021-05-20 21:09:34: The return value of stop of CRS: 0

2021-05-20 21:09:34: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:09:34: Command output:

>  CRS-4639: Could not contact Oracle High Availability Services

>End Command output

2021-05-20 21:09:34: Oracle CRS stack has been shut down

2021-05-20 21:09:44: Executing the [DeconfigCleanup] step with checkpoint [null] ...

2021-05-20 21:09:44: rsyslog service is running

2021-05-20 21:09:44: Executing /sbin/service rsyslog restart

2021-05-20 21:09:44: Executing cmd: /sbin/service rsyslog restart

2021-05-20 21:09:44: Command output:

>  Redirecting to /bin/systemctl restart rsyslog.service

>End Command output

2021-05-20 21:09:44: Running /u01/app/19.3.0.0/grid/bin/acfshanfs installed -nfsv4lock

2021-05-20 21:09:44: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfshanfs installed -nfsv4lock

2021-05-20 21:09:44: Command output:

>  ACFS-9204: false

>End Command output

2021-05-20 21:09:44: acfshanfs is not installed

2021-05-20 21:09:44: Executing step deconfiguration ACFS on the current node

2021-05-20 21:09:44: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsdriverstate supported

2021-05-20 21:09:45: Command output:

>  ACFS-9200: Supported

>End Command output

2021-05-20 21:09:45: acfs is supported

2021-05-20 21:09:45: isACFSInstalled: 1

2021-05-20 21:09:45: Not using checkpoint for USM driver uninstall

2021-05-20 21:09:45: Stopping ora.drivers.acfs if it exists, so that it doesn't race.

2021-05-20 21:09:45: isACFSSupported: 1

2021-05-20 21:09:45: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stat res ora.drivers.acfs -init

2021-05-20 21:09:45: Command output:

>  CRS-4639: Could not contact Oracle High Availability Services

>  CRS-4000: Command Status failed, or completed with errors.

>End Command output

2021-05-20 21:09:45: Executing /u01/app/19.3.0.0/grid/bin/acfsroot uninstall -t2

2021-05-20 21:09:45: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsroot uninstall -t2

2021-05-20 21:09:53: Command output:

>  ACFS-9176: Entering 'ga admin name'

>  ACFS-9176: Entering 'va admin group'

>  ACFS-9178: Return code = 0

>  ACFS-9177: Return from 'va admin group'

>  ACFS-9178: Return code = dba

>  ACFS-9177: Return from 'ga admin name'

>  ACFS-9176: Entering 'uncompress'

>  Version Match: 201219,201219

>  Setting install_files_loc to default for main

>  ACFS-9505: Using acfsutil executable from location: '/u01/app/19.3.0.0/grid/usm/install/cmds/bin/acfsutil'

>  ACFS-9176: Entering 'uninstall'

>  ACFS-9176: Entering 'lc check any driver'

>  ACFS-9155: Checking for existing 'oracleoks.ko' driver installation.

>  ACFS-9178: Return code = 1

>  ACFS-9177: Return from 'lc check any driver'

>  ACFS-9312: Existing ADVM/ACFS installation detected.

>  ACFS-9176: Entering 'uld usm drvs'

>  ACFS-9178: Return code = USM_SUCCESS

>  ACFS-9177: Return from 'uld usm drvs'

>  ACFS-9314: Removing previous ADVM/ACFS installation.

>  ACFS-9176: Entering 'getparm'

>  ACFS-9178: Return code = rac-cluster

>  ACFS-9177: Return from 'getparm'

>  ACFS-9176: Entering 'depmod uninstall'

>  ACFS-9177: Return from 'depmod uninstall'

>  ACFS-9315: Previous ADVM/ACFS components successfully removed.

>  ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf

>  ACFS-9178: Return code = USM_SUCCESS

>  ACFS-9177: Return from 'uninstall'

>  ACFS-9176: Entering 'acroot ex'

>  ACFS-9178: Return code = 0

>  ACFS-9177: Return from 'acroot ex'

>End Command output

2021-05-20 21:09:53: /u01/app/19.3.0.0/grid/bin/acfsroot uninstall -t2 ... success

2021-05-20 21:09:53: ACFS drivers uninstall completed

2021-05-20 21:09:53: Running /u01/app/19.3.0.0/grid/bin/okadriverstate installed

2021-05-20 21:09:53: Executing cmd: /u01/app/19.3.0.0/grid/bin/okadriverstate installed

2021-05-20 21:09:53: Command output:

>  OKA-9204: false

>End Command output

2021-05-20 21:09:53: OKA is not installed

2021-05-20 21:09:53: Executing step deconfiguration AFD on the Non Last node

2021-05-20 21:09:53: AFD Configuration is not selected

2021-05-20 21:09:53: Executing cmd: /u01/app/19.3.0.0/grid/bin/afddriverstate installed

2021-05-20 21:09:54: Command output:

>  AFD-9204: AFD device driver installed status: 'false'

>End Command output

2021-05-20 21:09:54: Failed to open /opt/oracle/extapi/64/asm/orcl/1 for reading: No such file or directory

2021-05-20 21:09:54: AFD Library is not present

2021-05-20 21:09:54: AFD is not installed

2021-05-20 21:09:54: AFD driver has been removed.

2021-05-20 21:09:54: CHM repository path not found

2021-05-20 21:09:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4006

2021-05-20 21:09:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4006

2021-05-20 21:09:54: Command output:

>  CLSRSC-4006: Removing Oracle Trace File Analyzer (TFA) Collector.

>End Command output

2021-05-20 21:09:54: CLSRSC-4006: Removing Oracle Trace File Analyzer (TFA) Collector.

2021-05-20 21:09:54: Executing cmd: /u01/app/19.3.0.0/grid/tfa/rac2/tfa_home/bin/uninstalltfa -silent -local -crshome /u01/app/19.3.0.0/grid

2021-05-20 21:09:54: Command output:

>  TFA-00055: TFA_HOME not found in CRS_HOME. Exiting now...

>End Command output

2021-05-20 21:09:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4007

2021-05-20 21:09:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4007

2021-05-20 21:09:54: Command output:

>  CLSRSC-4007: Successfully removed Oracle Trace File Analyzer (TFA) Collector.

>End Command output

2021-05-20 21:09:54: CLSRSC-4007: Successfully removed Oracle Trace File Analyzer (TFA) Collector.

2021-05-20 21:09:54: Remove init resources

2021-05-20 21:09:54: itab entries=cssd|evmd|crsd|ohasd

2021-05-20 21:09:54: Check if the startup mechanism upstart is being used

2021-05-20 21:09:54: Executing cmd: /bin/rpm -qf /sbin/init

2021-05-20 21:09:54: Command output:

>  systemd-219-67.el7.x86_64

>End Command output

2021-05-20 21:09:54: Not using the Linux startup method: upstart

2021-05-20 21:09:54: Check if the startup mechanism systemd is being used

2021-05-20 21:09:54: Executing cmd: /bin/rpm -qf /sbin/init

2021-05-20 21:09:54: Command output:

>  systemd-219-67.el7.x86_64

>End Command output

2021-05-20 21:09:54: remove systemd conf for services: [cssd evmd crsd ohasd]

2021-05-20 21:09:54: attempt to deconfigure oracle-cssd.service

2021-05-20 21:09:54: Executing cmd: /usr/bin/systemctl status oracle-cssd.service

2021-05-20 21:09:54: Command output:

>  Unit oracle-cssd.service could not be found.

>End Command output

2021-05-20 21:09:54: The unit -> oracle-cssd.service may not be installed

2021-05-20 21:09:54: isRunning: 0; isEnabled: 0

2021-05-20 21:09:54: remove service file: /etc/systemd/system/oracle-cssd.service

2021-05-20 21:09:54: attempt to deconfigure oracle-evmd.service

2021-05-20 21:09:54: Executing cmd: /usr/bin/systemctl status oracle-evmd.service

2021-05-20 21:09:54: Command output:

>  Unit oracle-evmd.service could not be found.

>End Command output

2021-05-20 21:09:54: The unit -> oracle-evmd.service may not be installed

2021-05-20 21:09:54: isRunning: 0; isEnabled: 0

2021-05-20 21:09:54: remove service file: /etc/systemd/system/oracle-evmd.service

2021-05-20 21:09:54: attempt to deconfigure oracle-crsd.service

2021-05-20 21:09:54: Executing cmd: /usr/bin/systemctl status oracle-crsd.service

2021-05-20 21:09:54: Command output:

>  Unit oracle-crsd.service could not be found.

>End Command output

2021-05-20 21:09:54: The unit -> oracle-crsd.service may not be installed

2021-05-20 21:09:54: isRunning: 0; isEnabled: 0

2021-05-20 21:09:54: remove service file: /etc/systemd/system/oracle-crsd.service

2021-05-20 21:09:54: attempt to deconfigure oracle-ohasd.service

2021-05-20 21:09:54: Executing cmd: /usr/bin/systemctl status oracle-ohasd.service

2021-05-20 21:09:54: Command output:

>  ● oracle-ohasd.service - Oracle High Availability Services

>     Loaded: loaded (/etc/systemd/system/oracle-ohasd.service; enabled; vendor preset: disabled)

>    Drop-In: /etc/systemd/system/oracle-ohasd.service.d

>             └─00_oracle-ohasd.conf

>     Active: active (running) since Thu 2021-05-20 09:42:43 KST; 11h ago

>   Main PID: 1487 (init.ohasd)

>      Tasks: 2

>     CGroup: /system.slice/oracle-ohasd.service

>             ├─ 1487 /bin/sh /etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null

>             └─13632 /bin/sleep 1

>  May 20 21:00:45 rac2 oracle_7933_+as[7933]: Oracle Audit[7933]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:02:29 rac2 oracle_8829_+as[8829]: Oracle Audit[8829]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:04:38 rac2 oracle_9758_+as[9758]: Oracle Audit[9758]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:05:45 rac2 oracle_10236_+a[10236]: Oracle Audit[10236]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:09:08 rac2 oracle_12555_+a[12555]: Oracle Audit[12555]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSASM' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:09:12 rac2 oracle_12608_+a[12608]: Oracle Audit[12608]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSASM' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:09:12 rac2 oracle_12624_+a[12624]: Oracle Audit[12624]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:09:15 rac2 oracle_12691_+a[12691]: Oracle Audit[12691]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSASM' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:09:20 rac2 oracle_12691_+a[12691]: Oracle Audit[12691]: LENGTH : '254' ACTION :[18] 'SHUTDOWN IMMEDIATE' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSASM' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac2' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '139'

>  May 20 21:09:29 rac2 octssd.bin[5074]: Oracle Clusterware: 2021-05-20 21:09:29.168

>                                         [(5074)]CRS-8504:Oracle Clusterware OCTSSD process with operating system process ID 5074 is exiting

>End Command output

2021-05-20 21:09:54: isRunning: 1; isEnabled: 1

2021-05-20 21:09:54: Executing cmd: /usr/bin/systemctl stop oracle-ohasd.service

2021-05-20 21:09:54: Executing cmd: /usr/bin/systemctl disable oracle-ohasd.service

2021-05-20 21:09:54: Command output:

>  Removed symlink /etc/systemd/system/multi-user.target.wants/oracle-ohasd.service.

>  Removed symlink /etc/systemd/system/graphical.target.wants/oracle-ohasd.service.

>End Command output

2021-05-20 21:09:54: remove service file: /etc/systemd/system/oracle-ohasd.service

2021-05-20 21:09:54: Removing file /etc/systemd/system/oracle-ohasd.service

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/systemd/system/oracle-ohasd.service

2021-05-20 21:09:54: remove conf file: /etc/systemd/system/oracle-ohasd.service.d/00_oracle-ohasd.conf

2021-05-20 21:09:54: Removing file /etc/systemd/system/oracle-ohasd.service.d/00_oracle-ohasd.conf

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/systemd/system/oracle-ohasd.service.d/00_oracle-ohasd.conf

2021-05-20 21:09:54: Removing script for Oracle Cluster Ready services

2021-05-20 21:09:54: Removing /etc/init.d/init.evmd file

2021-05-20 21:09:54: Removing /etc/init.d/init.crsd file

2021-05-20 21:09:54: Removing /etc/init.d/init.cssd file

2021-05-20 21:09:54: Removing /etc/init.d/init.crs file

2021-05-20 21:09:54: Removing /etc/init.d/init.ohasd file

2021-05-20 21:09:54: Removing file /etc/init.d/init.ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/init.d/init.ohasd

2021-05-20 21:09:54: Init file = ohasd

2021-05-20 21:09:54: Removing "ohasd" from RC dirs

2021-05-20 21:09:54: Removing file /etc/rc.d/rc0.d/K15ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/rc.d/rc0.d/K15ohasd

2021-05-20 21:09:54: Removing file /etc/rc.d/rc1.d/K15ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/rc.d/rc1.d/K15ohasd

2021-05-20 21:09:54: Removing file /etc/rc.d/rc2.d/K15ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/rc.d/rc2.d/K15ohasd

2021-05-20 21:09:54: Removing file /etc/rc.d/rc3.d/S96ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/rc.d/rc3.d/S96ohasd

2021-05-20 21:09:54: Removing file /etc/rc.d/rc4.d/K15ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/rc.d/rc4.d/K15ohasd

2021-05-20 21:09:54: Removing file /etc/rc.d/rc5.d/S96ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/rc.d/rc5.d/S96ohasd

2021-05-20 21:09:54: Removing file /etc/rc.d/rc6.d/K15ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/rc.d/rc6.d/K15ohasd

2021-05-20 21:09:54: Init file = init.crs

2021-05-20 21:09:54: Removing "init.crs" from RC dirs

2021-05-20 21:09:54: /etc/oracle/cell/network-config/cellip.ora not found

2021-05-20 21:09:54: Cleaning up SCR settings in /etc/oracle/scls_scr

2021-05-20 21:09:54: Cleaning oprocd directory, and log files

2021-05-20 21:09:54: Cleaning up Network socket directories

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/mdnsd

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/mdnsd.pid

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/npohasd

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/npohasd2

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_GPNPD_rac2

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_GPNPD_rac2_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CHAD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CHAD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CRSD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CRSD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CRSD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CRSD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CSSD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CSSD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CSSD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CSSD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CTSSD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_CTSSD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_EVMD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_EVMD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_EVMD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_EVMD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_GIPCD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_GIPCD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_GPNPD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_GPNPD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_INIT

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_INIT_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_LOGD

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_LOGD_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_MOND

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_rac2_MOND_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_scls_opct_rac2

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_scls_opct_rac2_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_srac2CRFM_CLIIPC

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_srac2CRFM_CLIIPC_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_srac2CRFM_MIIPC

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_srac2CRFM_MIIPC_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_srac2CRFM_SIPC

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/ora_gipc_srac2CRFM_SIPC_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sAevm

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sAevm_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_IPC_SOCKET_11

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_IPC_SOCKET_11_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_UI_SOCKET

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sCRSD_UI_SOCKET_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2_

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2__lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2_rac-cluster

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac2_rac-cluster_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_IPC_SOCKET_11

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_IPC_SOCKET_11_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_UI_SOCKET

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOHASD_UI_SOCKET_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sora_crsqs

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sora_crsqs_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOracle_CSS_LclLstnr_rac-cluster_2

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sOracle_CSS_LclLstnr_rac-cluster_2_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROC_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROL

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROL_lock

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sSYSTEM.evm.acceptor.auth

2021-05-20 21:09:54: Unlinking file : /var/tmp/.oracle/sSYSTEM.evm.acceptor.auth_lock

2021-05-20 21:09:54: Root script is not invoked as part of deinstall. /u01/app/oracle/oradiag_root, /etc/oracle/maps, and /etc/oracle/setasmgid are not removed

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/profiles/peer

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/peer

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/prdr

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/pa

2021-05-20 21:09:54: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/root

2021-05-20 21:09:54: removing gpnp backup directory /u01/app/19.3.0.0/grid/gpnp/gpnp_bcp__2021_2_4_163525

2021-05-20 21:09:54: Executing /etc/init.d/ohasd deinstall

2021-05-20 21:09:54: Executing cmd: /etc/init.d/ohasd deinstall

2021-05-20 21:09:54: Removing file /etc/init.d/ohasd

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/init.d/ohasd

2021-05-20 21:09:54: Executing cmd: /bin/netstat -a -A unix

2021-05-20 21:09:54: Remove /var/tmp/.oracle

2021-05-20 21:09:54: Removed /var/tmp/.oracle

2021-05-20 21:09:54: /var/tmp/.oracle has been deleted successfully

2021-05-20 21:09:54: Executing cmd: /bin/netstat -a -A unix

2021-05-20 21:09:54: Remove /tmp/.oracle

2021-05-20 21:09:54: Remove /etc/oracle/lastgasp

2021-05-20 21:09:54: Removing file /etc/oracle/ocr.loc.orig

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/oracle/ocr.loc.orig

2021-05-20 21:09:54: Removing file /etc/oracle/olr.loc.orig

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/oracle/olr.loc.orig

2021-05-20 21:09:54: Reset OCR

2021-05-20 21:09:54: Removing OLR file: /u01/app/oracle/crsdata/rac2/olr/rac2_19.olr

2021-05-20 21:09:54: Removing file /u01/app/oracle/crsdata/rac2/olr/rac2_19.olr

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /u01/app/oracle/crsdata/rac2/olr/rac2_19.olr

2021-05-20 21:09:54: Removing file /etc/oracle/olr.loc

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/oracle/olr.loc

2021-05-20 21:09:54: Removing file /etc/oracle/ocr.loc

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /etc/oracle/ocr.loc

2021-05-20 21:09:54: Removing the local checkpoint file /u01/app/oracle/crsdata/rac2/crsconfig/ckptGridHA_rac2.xml

2021-05-20 21:09:54: Removing file /u01/app/oracle/crsdata/rac2/crsconfig/ckptGridHA_rac2.xml

2021-05-20 21:09:54:

2021-05-20 21:09:54: Successfully removed file: /u01/app/oracle/crsdata/rac2/crsconfig/ckptGridHA_rac2.xml

2021-05-20 21:09:54: Removing the local checkpoint index file /u01/app/oracle/rac2/checkpoints/crsconfig/index.xml

2021-05-20 21:09:54: removing cvuqdisk rpm

2021-05-20 21:09:54: Executing /bin/rpm -e --allmatches cvuqdisk

2021-05-20 21:09:54: Executing cmd: /bin/rpm -e --allmatches cvuqdisk

2021-05-20 21:09:54: Successfully deconfigured Oracle Clusterware stack on this node

2021-05-20 21:09:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 336

2021-05-20 21:09:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 336

2021-05-20 21:09:54: Command output:

>  CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node

>End Command output

2021-05-20 21:09:54: CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node

2021-05-20 21:09:54: ###### Begin Error Stack Trace ######

2021-05-20 21:09:54:     Package         File                 Line Calling

2021-05-20 21:09:54:     --------------- -------------------- ---- ----------

2021-05-20 21:09:54:  1: crsdeconfig     crsdeconfig.pm        358 crsutils::print_error

2021-05-20 21:09:54:  2: crsdeconfig     crsdeconfig.pm        311 crsdeconfig::CRSDeconfig

2021-05-20 21:09:54:  3: main            rootcrs.pl            370 crsdeconfig::new

2021-05-20 21:09:54: ####### End Error Stack Trace #######

 

2021-05-20 21:09:54: deinstall or deconfig cleanup completed successfully

 

3. 2번 노드는 CRS 가 제거된 상태

[root@rac1 ~]# crsctl stat res -t

--------------------------------------------------------------------------------

Name           Target  State        Server                   State details      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac1                     STABLE

ora.chad

               ONLINE  ONLINE       rac1                     STABLE

ora.net1.network

               ONLINE  ONLINE       rac1                     STABLE

ora.ons

               ONLINE  ONLINE       rac1                     STABLE

ora.proxy_advm

               OFFLINE OFFLINE      rac1                     STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  OFFLINE                               STABLE

      3        ONLINE  OFFLINE                               STABLE

ora.DATA.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  OFFLINE                               STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac1                     STABLE

ora.RECO.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  OFFLINE                               STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.VOTE.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  OFFLINE                               STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.asm(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     Started,STABLE

      2        ONLINE  OFFLINE                               STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.asmnet1.asmnetwork(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  OFFLINE                               STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.cvu

      1        ONLINE  ONLINE       rac1                     STABLE

ora.qosmserver

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

ora.scan1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

ora.test.db

      1        ONLINE  ONLINE       rac1                     Open,HOME=/u01/app/o

                                                             racle/product/19.3.0

                                                             .0/dbhome_1,STABLE

      2        ONLINE  OFFLINE                               Instance Shutdown,ST

                                                             ABLE

--------------------------------------------------------------------------------

 

4. 이제 1번 노드를 deconfig 함. (-keepdg 옵션 추가)

 

[root@rac1 ~]# export GI_HOME=/u01/app/19.3.0.0/grid

[root@rac1 ~]# $GI_HOME/perl/bin/perl $GI_HOME/crs/install/rootcrs.pl -deconfig -force -verbose -lastnode -keepdg

Using configuration parameter file: /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

  /u01/app/oracle/crsdata/rac1/crsconfig/crsdeconfig_rac1_2021-05-20_09-12-48PM.log

2021/05/20 21:12:51 CLSRSC-332: CRS resources for listeners are still configured

CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'

CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded

 

ASM de-configuration trace file location: /u01/app/oracle/cfgtoollogs/asmca/asmcadc_clean2021-05-20_09-16-11PM.log

ASM Clean Configuration START

ASM Clean Configuration END

 

ASM instance deleted successfully. Check /u01/app/oracle/cfgtoollogs/asmca/asmcadc_clean2021-05-20_09-16-11PM.log for details.

 

2021/05/20 21:17:28 CLSRSC-170: Failed to deconfigure Oracle ASM (error code 0)

2021/05/20 21:17:28 CLSRSC-558: failed to deconfigure ASM

2021/05/20 21:17:28 CLSRSC-651: One or more deconfiguration steps failed, but the deconfiguration process continued because the -force option was specified.

Redirecting to /bin/systemctl restart rsyslog.service

2021/05/20 21:17:54 CLSRSC-4006: Removing Oracle Trace File Analyzer (TFA) Collector.

2021/05/20 21:17:54 CLSRSC-4007: Successfully removed Oracle Trace File Analyzer (TFA) Collector.

2021/05/20 21:17:57 CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node

2021/05/20 21:17:57 CLSRSC-559: Ensure that the GPnP profile data under the 'gpnp' directory in /u01/app/19.3.0.0/grid is deleted on each node before using the software in the current Grid Infrastructure home for reconfiguration.

[root@rac1 ~]#

[root@rac1 ~]# cat /u01/app/oracle/crsdata/rac1/crsconfig/crsdeconfig_rac1_2021-05-20_09-12-48PM.log

2021-05-20 21:12:48: Checking parameters from paramfile /u01/app/19.3.0.0/grid/crs/install/crsconfig_params to validate installer variables

2021-05-20 21:12:48: Skipping validation for ODA_CONFIG

2021-05-20 21:12:48: Skipping validation for OPC_CLUSTER_TYPE

2021-05-20 21:12:48: Skipping validation for OPC_NAT_ADDRESS

2021-05-20 21:12:48: Skipping validation for RHP_PROVISIONED

2021-05-20 21:12:48: Skipping validation for SCAN_CREDENTIALS

2021-05-20 21:12:48: Skipping validation for SCAN_IPS

2021-05-20 21:12:48: Skipping validation for SCAN_TYPE

2021-05-20 21:12:48: Install node: rac1

2021-05-20 21:12:48: Current node is the install node

2021-05-20 21:12:48: cache CLUSTER_CLASS to /u01/app/oracle/crsdata/@global/environmentInfo.cache

2021-05-20 21:12:48: clusterClass = STANDALONE

2021-05-20 21:12:48: The configuration parameter file /u01/app/19.3.0.0/grid/crs/install/crsconfig_params  is valid

2021-05-20 21:12:48: Run command --/u01/app/19.3.0.0/grid/bin/oraversion -libVersion-- as oracle

2021-05-20 21:12:48: /u01/app/19.3.0.0/grid/bin/oraversion -libVersion successfully executed

2021-05-20 21:12:48: Command output:

>  19

>End Command output

2021-05-20 21:12:48: "/u01/app/19.3.0.0/grid/bin/oraversion -libVersion" output: 19

 

2021-05-20 21:12:48: Run command --/u01/app/19.3.0.0/grid/bin/oraversion -majorVersion-- as oracle

2021-05-20 21:12:48: /u01/app/19.3.0.0/grid/bin/oraversion -majorVersion successfully executed

2021-05-20 21:12:48: Command output:

>  19

>End Command output

2021-05-20 21:12:48: "/u01/app/19.3.0.0/grid/bin/oraversion -majorVersion" output: 19

 

2021-05-20 21:12:48: ### Printing the configuration values from files:

2021-05-20 21:12:48:    /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

2021-05-20 21:12:48:    /u01/app/19.3.0.0/grid/crs/install/s_crsconfig_defs

2021-05-20 21:12:48: AFD_CONF=false

2021-05-20 21:12:48: APPLICATION_VIP=

2021-05-20 21:12:48: ASMCA_ARGS=

2021-05-20 21:12:48: ASM_CONFIG=near

2021-05-20 21:12:48: ASM_CREDENTIALS=

2021-05-20 21:12:48: ASM_DISCOVERY_STRING=/dev/sd*

2021-05-20 21:12:48: ASM_SPFILE=

2021-05-20 21:12:48: ASM_UPGRADE=false

2021-05-20 21:12:48: BIG_CLUSTER=true

2021-05-20 21:12:48: CDATA_AUSIZE=4

2021-05-20 21:12:48: CDATA_BACKUP_AUSIZE=1

2021-05-20 21:12:48: CDATA_BACKUP_DISKS=

2021-05-20 21:12:48: CDATA_BACKUP_DISK_GROUP=

2021-05-20 21:12:48: CDATA_BACKUP_FAILURE_GROUPS=

2021-05-20 21:12:48: CDATA_BACKUP_QUORUM_GROUPS=

2021-05-20 21:12:48: CDATA_BACKUP_REDUNDANCY=

2021-05-20 21:12:48: CDATA_BACKUP_SITES=

2021-05-20 21:12:48: CDATA_BACKUP_SIZE=0

2021-05-20 21:12:48: CDATA_DISKS=/dev/sdd1,/dev/sde1,/dev/sdf1

2021-05-20 21:12:48: CDATA_DISK_GROUP=VOTE

2021-05-20 21:12:48: CDATA_FAILURE_GROUPS=

2021-05-20 21:12:48: CDATA_QUORUM_GROUPS=

2021-05-20 21:12:48: CDATA_REDUNDANCY=NORMAL

2021-05-20 21:12:48: CDATA_SITES=

2021-05-20 21:12:48: CDATA_SIZE=0

2021-05-20 21:12:48: CLSCFG_MISSCOUNT=

2021-05-20 21:12:48: CLUSTER_CLASS=STANDALONE

2021-05-20 21:12:48: CLUSTER_GUID=

2021-05-20 21:12:48: CLUSTER_NAME=rac-cluster

2021-05-20 21:12:48: CLUSTER_TYPE=DB

2021-05-20 21:12:48: CRS_LIMIT_CORE=unlimited

2021-05-20 21:12:48: CRS_LIMIT_MEMLOCK=unlimited

2021-05-20 21:12:48: CRS_LSNR_STACK=32768

2021-05-20 21:12:48: CRS_NODEVIPS='rac1-vip/255.255.255.0/enp0s3,rac2-vip/255.255.255.0/enp0s3'

2021-05-20 21:12:48: CRS_STORAGE_OPTION=1

2021-05-20 21:12:48: CSS_LEASEDURATION=400

2021-05-20 21:12:48: DC_HOME=

2021-05-20 21:12:48: DIRPREFIX=

2021-05-20 21:12:48: DISABLE_OPROCD=0

2021-05-20 21:12:48: EXTENDED_CLUSTER=false

2021-05-20 21:12:48: EXTENDED_CLUSTER_SITES=rac-cluster

2021-05-20 21:12:48: EXTENDED_CLUSTER_SITE_GUIDS=

2021-05-20 21:12:48: EXTERNAL_ORACLE=/opt/oracle

2021-05-20 21:12:48: EXTERNAL_ORACLE_BIN=/opt/oracle/bin

2021-05-20 21:12:48: GIMR_CONFIG=

2021-05-20 21:12:48: GIMR_CREDENTIALS=

2021-05-20 21:12:48: GNS_ADDR_LIST=

2021-05-20 21:12:48: GNS_ALLOW_NET_LIST=

2021-05-20 21:12:48: GNS_CONF=false

2021-05-20 21:12:48: GNS_CREDENTIALS=

2021-05-20 21:12:48: GNS_DENY_ITF_LIST=

2021-05-20 21:12:48: GNS_DENY_NET_LIST=

2021-05-20 21:12:48: GNS_DOMAIN_LIST=

2021-05-20 21:12:48: GNS_TYPE=

2021-05-20 21:12:48: GPNPCONFIGDIR=/u01/app/19.3.0.0/grid

2021-05-20 21:12:48: GPNPGCONFIGDIR=/u01/app/19.3.0.0/grid

2021-05-20 21:12:48: GPNP_PA=

2021-05-20 21:12:48: HUB_NODE_LIST=rac1,rac2

2021-05-20 21:12:48: HUB_NODE_VIPS=rac1-vip,rac2-vip

2021-05-20 21:12:48: HUB_SIZE=32

2021-05-20 21:12:48: ID=/etc/init.d

2021-05-20 21:12:48: INIT=/sbin/init

2021-05-20 21:12:48: INITCTL=/sbin/initctl

2021-05-20 21:12:48: INSTALL_NODE=rac1

2021-05-20 21:12:48: ISROLLING=true

2021-05-20 21:12:48: IT=/etc/inittab

2021-05-20 21:12:48: JLIBDIR=/u01/app/19.3.0.0/grid/jlib

2021-05-20 21:12:48: JREDIR=/u01/app/19.3.0.0/grid/jdk/jre/

2021-05-20 21:12:48: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8

2021-05-20 21:12:48: LISTENER_USERNAME=oracle

2021-05-20 21:12:48: MGMT_DB=false

2021-05-20 21:12:48: MSGFILE=/var/adm/messages

2021-05-20 21:12:48: NETWORKS="enp0s3"/192.168.56.0:public,"enp0s8"/10.10.10.0:asm,"enp0s8"/10.10.10.0:cluster_interconnect

2021-05-20 21:12:48: NEW_HOST_NAME_LIST=

2021-05-20 21:12:48: NEW_NODEVIPS='rac1-vip/255.255.255.0/enp0s3,rac2-vip/255.255.255.0/enp0s3'

2021-05-20 21:12:48: NEW_NODE_NAME_LIST=

2021-05-20 21:12:48: NEW_PRIVATE_NAME_LIST=

2021-05-20 21:12:48: NODE_NAME_LIST=rac1,rac2

2021-05-20 21:12:48: OCRCONFIG=/etc/oracle/ocr.loc

2021-05-20 21:12:48: OCRCONFIGDIR=/etc/oracle

2021-05-20 21:12:48: OCRID=

2021-05-20 21:12:48: OCRLOC=ocr.loc

2021-05-20 21:12:48: OCR_LOCATIONS=

2021-05-20 21:12:48: ODA_CONFIG=

2021-05-20 21:12:48: OLASTGASPDIR=/etc/oracle/lastgasp

2021-05-20 21:12:48: OLD_CRS_HOME=

2021-05-20 21:12:48: OLRCONFIG=/etc/oracle/olr.loc

2021-05-20 21:12:48: OLRCONFIGDIR=/etc/oracle

2021-05-20 21:12:48: OLRLOC=olr.loc

2021-05-20 21:12:48: OPC_CLUSTER_TYPE=

2021-05-20 21:12:48: OPC_NAT_ADDRESS=

2021-05-20 21:12:48: OPROCDCHECKDIR=/etc/oracle/oprocd/check

2021-05-20 21:12:48: OPROCDDIR=/etc/oracle/oprocd

2021-05-20 21:12:48: OPROCDFATALDIR=/etc/oracle/oprocd/fatal

2021-05-20 21:12:48: OPROCDSTOPDIR=/etc/oracle/oprocd/stop

2021-05-20 21:12:48: ORACLE_BASE=/u01/app/oracle

2021-05-20 21:12:48: ORACLE_HOME=/u01/app/19.3.0.0/grid

2021-05-20 21:12:48: ORACLE_OWNER=oracle

2021-05-20 21:12:48: ORA_ASM_GROUP=dba

2021-05-20 21:12:48: ORA_DBA_GROUP=dba

2021-05-20 21:12:48: PING_TARGETS=

2021-05-20 21:12:48: PRIVATE_NAME_LIST=

2021-05-20 21:12:48: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d

2021-05-20 21:12:48: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d

2021-05-20 21:12:48: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d

2021-05-20 21:12:48: RC_KILL=K15

2021-05-20 21:12:48: RC_KILL_OLD=K96

2021-05-20 21:12:48: RC_KILL_OLD2=K19

2021-05-20 21:12:48: RC_START=S96

2021-05-20 21:12:48: REUSEDG=false

2021-05-20 21:12:48: RHP_CONF=false

2021-05-20 21:12:48: RHP_PROVISIONED=

2021-05-20 21:12:48: RIM_NODE_LIST=

2021-05-20 21:12:48: SCAN_CREDENTIALS=

2021-05-20 21:12:48: SCAN_IPS=0racle_install_crs_OPC_SCAN_IPs%

2021-05-20 21:12:48: SCAN_NAME=rac-scan

2021-05-20 21:12:48: SCAN_PORT=1521

2021-05-20 21:12:48: SCAN_TYPE=LOCAL

2021-05-20 21:12:48: SCRBASE=/etc/oracle/scls_scr

2021-05-20 21:12:48: SILENT=false

2021-05-20 21:12:48: SO_EXT=so

2021-05-20 21:12:48: SRVCFGLOC=srvConfig.loc

2021-05-20 21:12:48: SRVCONFIG=/var/opt/oracle/srvConfig.loc

2021-05-20 21:12:48: SRVCONFIGDIR=/var/opt/oracle

2021-05-20 21:12:48: SYSTEMCTL=/usr/bin/systemctl

2021-05-20 21:12:48: SYSTEMD_SYSTEM_DIR=/etc/systemd/system

2021-05-20 21:12:48: TZ=Asia/Seoul

2021-05-20 21:12:48: UPSTART_INIT_DIR=/etc/init

2021-05-20 21:12:48: USER_IGNORED_PREREQ=true

2021-05-20 21:12:48: VNDR_CLUSTER=false

2021-05-20 21:12:48: VOTING_DISKS=

2021-05-20 21:12:48: ### Printing other configuration values ###

2021-05-20 21:12:48: CLSCFG_EXTRA_PARMS=

2021-05-20 21:12:48: DEBUG=1

2021-05-20 21:12:48: DECONFIG=1

2021-05-20 21:12:48: FORCE=1

2021-05-20 21:12:48: HAS_GROUP=dba

2021-05-20 21:12:48: HAS_USER=root

2021-05-20 21:12:48: HOST=rac1

2021-05-20 21:12:48: KEEPDG=1

2021-05-20 21:12:48: LASTNODE=1

2021-05-20 21:12:48: OLR_DIRECTORY=/u01/app/oracle/crsdata/rac1/olr

2021-05-20 21:12:48: OLR_LOCATION=/u01/app/oracle/crsdata/rac1/olr/rac1_19.olr

2021-05-20 21:12:48: ORA_CRS_HOME=/u01/app/19.3.0.0/grid

2021-05-20 21:12:48: ORA_VERSION=19

2021-05-20 21:12:48: SIHA=0

2021-05-20 21:12:48: SUCC_REBOOT=0

2021-05-20 21:12:48: SUPERUSER=root

2021-05-20 21:12:48: addfile=/u01/app/19.3.0.0/grid/crs/install/crsconfig_addparams

2021-05-20 21:12:48: cluutil_trc_suff_pp=0

2021-05-20 21:12:48: crscfg_trace=1

2021-05-20 21:12:48: crscfg_trace_file=/u01/app/oracle/crsdata/rac1/crsconfig/crsdeconfig_rac1_2021-05-20_09-12-48PM.log

2021-05-20 21:12:48: old_nodevips=

2021-05-20 21:12:48: osdfile=/u01/app/19.3.0.0/grid/crs/install/s_crsconfig_defs

2021-05-20 21:12:48: parameters_valid=1

2021-05-20 21:12:48: paramfile=/u01/app/19.3.0.0/grid/crs/install/crsconfig_params

2021-05-20 21:12:48: platform_family=unix

2021-05-20 21:12:48: pp_srvctl_trc_suff=0

2021-05-20 21:12:48: srvctl_trc_suff=0

2021-05-20 21:12:48: srvctl_trc_suff_pp=0

2021-05-20 21:12:48: stackStartLevel=11

2021-05-20 21:12:48: user_is_superuser=1

2021-05-20 21:12:48: ### Printing of configuration values complete ###

2021-05-20 21:12:48: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/crsdeconfig_rac1_2021-05-20_09-12-48PM.log

2021-05-20 21:12:48: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/crsdeconfig_rac1_2021-05-20_09-12-48PM.log

2021-05-20 21:12:48: Save the ASM password file location: +VOTE/orapwASM

2021-05-20 21:12:48: Print system environment variables:

2021-05-20 21:12:48: DISPLAY = 192.168.56.90:10.0

2021-05-20 21:12:48: GI_HOME = /u01/app/19.3.0.0/grid

2021-05-20 21:12:48: HISTCONTROL = ignoredups

2021-05-20 21:12:48: HISTSIZE = 1000

2021-05-20 21:12:48: HOME = /root

2021-05-20 21:12:48: HOSTNAME = rac1

2021-05-20 21:12:48: LANG = en_US.UTF-8

2021-05-20 21:12:48: LESSOPEN = ||/usr/bin/lesspipe.sh

2021-05-20 21:12:48: LOGNAME = root

2021-05-20 21:12:48: LS_COLORS = rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:

2021-05-20 21:12:48: MAIL = /var/spool/mail/root

2021-05-20 21:12:48: ORACLE_BASE = /u01/app/oracle

2021-05-20 21:12:48: ORACLE_HOME = /u01/app/19.3.0.0/grid

2021-05-20 21:12:48: PATH = /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin:/u01/app/oracle/product/19.3.0.0/dbhome_1/bin:/u01/app/19.3.0.0/grid/bin:/u01/app/19.3.0.0/grid/OPatch:/u01/app/oracle/product/19.3.0.0/dbhome_1/OPatch

2021-05-20 21:12:48: PWD = /root

2021-05-20 21:12:48: SHELL = /bin/bash

2021-05-20 21:12:48: SHLVL = 1

2021-05-20 21:12:48: SSH_CLIENT = 192.168.56.1 60770 22

2021-05-20 21:12:48: SSH_CONNECTION = 192.168.56.1 60770 192.168.56.90 22

2021-05-20 21:12:48: SSH_TTY = /dev/pts/0

2021-05-20 21:12:48: TERM = vt100

2021-05-20 21:12:48: TZ = Asia/Seoul

2021-05-20 21:12:48: USER = root

2021-05-20 21:12:48: XDG_DATA_DIRS = /root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share

2021-05-20 21:12:48: XDG_RUNTIME_DIR = /run/user/0

2021-05-20 21:12:48: XDG_SESSION_ID = 13

2021-05-20 21:12:48: _ = /u01/app/19.3.0.0/grid/perl/bin/perl

2021-05-20 21:12:48: Perform initialization tasks before configuring AFD

2021-05-20 21:12:48: Perform initialization tasks before configuring ACFS

2021-05-20 21:12:48: Executing pwdx 20354 >/dev/null 2>&1

2021-05-20 21:12:48: Executing cmd: pwdx 20354 >/dev/null 2>&1

2021-05-20 21:12:48: Executing pwdx 20359 >/dev/null 2>&1

2021-05-20 21:12:48: Executing cmd: pwdx 20359 >/dev/null 2>&1

2021-05-20 21:12:48: Executing pwdx 20362 >/dev/null 2>&1

2021-05-20 21:12:48: Executing cmd: pwdx 20362 >/dev/null 2>&1

2021-05-20 21:12:48: Executing pwdx 24549 >/dev/null 2>&1

2021-05-20 21:12:48: Executing cmd: pwdx 24549 >/dev/null 2>&1

2021-05-20 21:12:48: Running /u01/app/19.3.0.0/grid/bin/acfsdriverstate installed -s

2021-05-20 21:12:48: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsdriverstate installed -s

2021-05-20 21:12:48: acfs is installed

2021-05-20 21:12:48: Running /u01/app/19.3.0.0/grid/bin/acfsdriverstate loaded -s

2021-05-20 21:12:48: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsdriverstate loaded -s

2021-05-20 21:12:48: acfs is loaded

2021-05-20 21:12:48: Executing cmd: /sbin/acfsutil info fs "/root" -o mountpoint

2021-05-20 21:12:48: Command output:

>  acfsutil info fs: ACFS-03037: not an ACFS file system

>End Command output

2021-05-20 21:12:48: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stat res ora.drivers.acfs -init

2021-05-20 21:12:48: Command output:

>  NAME=ora.drivers.acfs

>  TYPE=ora.drivers.acfs.type

>  TARGET=ONLINE

>  STATE=ONLINE on rac1

>  

>End Command output

2021-05-20 21:12:48: Performing few checks before running scripts

2021-05-20 21:12:48: running script rootcrs.pl

2021-05-20 21:12:48: Opening file /etc/oracle/ocr.loc

2021-05-20 21:12:48: Value (false) is set for key=local_only

2021-05-20 21:12:48: Attempt to get current working directory

2021-05-20 21:12:48: Running as user oracle: pwd

2021-05-20 21:12:48: Removing file /tmp/kdWr_AxOFL

2021-05-20 21:12:48:

2021-05-20 21:12:48: Successfully removed file: /tmp/kdWr_AxOFL

2021-05-20 21:12:48: pipe exit code: 0

2021-05-20 21:12:48: /bin/su successfully executed

 

2021-05-20 21:12:48: The current working directory: /root

2021-05-20 21:12:48: Change working directory to safe directory /u01/app/19.3.0.0/grid

2021-05-20 21:12:48: Pre-checks for running the rootcrs script passed.

2021-05-20 21:12:48: Deconfiguring Oracle Clusterware on this node

2021-05-20 21:12:48: Executing the [DeconfigValidate] step with checkpoint [null] ...

2021-05-20 21:12:48: Perform initialization tasks before configuring OLR

2021-05-20 21:12:48: Perform initialization tasks before configuring OCR

2021-05-20 21:12:48: Perform initialization tasks before configuring CHM

2021-05-20 21:12:48: Perform initialization tasks before configuring ASM

2021-05-20 21:12:48: Perform initialization tasks before configuring SRVM

2021-05-20 21:12:48: Perform prechecks for deconfiguration

2021-05-20 21:12:48: Checking whether current node rac1 has been deconfigured.

2021-05-20 21:12:48: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:12:48: Command output:

>  CRS-4638: Oracle High Availability Services is online

>  CRS-4537: Cluster Ready Services is online

>  CRS-4529: Cluster Synchronization Services is online

>  CRS-4533: Event Manager is online

>End Command output

2021-05-20 21:12:48: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -chkckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED"

2021-05-20 21:12:48: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/cluutil1.log

2021-05-20 21:12:48: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil1.log

2021-05-20 21:12:48: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil1.log

2021-05-20 21:12:48: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -chkckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED

2021-05-20 21:12:49: Removing file /tmp/jmp2P5i4rM

2021-05-20 21:12:49:

2021-05-20 21:12:49: Successfully removed file: /tmp/jmp2P5i4rM

2021-05-20 21:12:49: pipe exit code: 0

2021-05-20 21:12:49: /bin/su successfully executed

 

2021-05-20 21:12:49: TRUE

 

2021-05-20 21:12:49: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil1.log

2021-05-20 21:12:49: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil1.log

2021-05-20 21:12:49: The property ORACLE_HOME_SHARED for checkpoint:ROOTCRS_STACK is there

2021-05-20 21:12:49: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -listckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED"

2021-05-20 21:12:49: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/cluutil2.log

2021-05-20 21:12:49: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil2.log

2021-05-20 21:12:49: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil2.log

2021-05-20 21:12:49: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -ckpt -oraclebase /u01/app/oracle -listckpt -name ROOTCRS_STACK -pname ORACLE_HOME_SHARED

2021-05-20 21:12:49: Removing file /tmp/aq9z5ekBtt

2021-05-20 21:12:49:

2021-05-20 21:12:49: Successfully removed file: /tmp/aq9z5ekBtt

2021-05-20 21:12:49: pipe exit code: 0

2021-05-20 21:12:49: /bin/su successfully executed

 

2021-05-20 21:12:49: ORACLE_HOME_SHARED=false

 

2021-05-20 21:12:49: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil2.log

2021-05-20 21:12:49: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil2.log

2021-05-20 21:12:49: Succeeded to get property value:ORACLE_HOME_SHARED=false

 

2021-05-20 21:12:49: ORACLE_HOME is shared: 0

2021-05-20 21:12:49: options=-force -lastnode

2021-05-20 21:12:49: Validate crsctl command

2021-05-20 21:12:49: Validating /u01/app/19.3.0.0/grid/bin/crsctl

2021-05-20 21:12:49: Executing the [DeconfigResources] step with checkpoint [null] ...

2021-05-20 21:12:49: Verifying the existence of CRS resources used by Oracle RAC databases

2021-05-20 21:12:49: Check if CRS is running

2021-05-20 21:12:49: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:12:49: Running /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:12:49: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:12:49: Command output:

>  CRS-4638: Oracle High Availability Services is online

>  CRS-4537: Cluster Ready Services is online

>  CRS-4529: Cluster Synchronization Services is online

>  CRS-4533: Event Manager is online

>End Command output

2021-05-20 21:12:49: Validate srvctl command

2021-05-20 21:12:49: Validating /u01/app/19.3.0.0/grid/bin/srvctl

2021-05-20 21:12:49: Remove listener resource...

2021-05-20 21:12:49: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl config listener"

2021-05-20 21:12:49: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg1.log

2021-05-20 21:12:49: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl config listener

2021-05-20 21:12:51: Command output:

>  Name: LISTENER

>  Type: Database Listener

>  Network: 1, Owner: oracle

>  Home: <CRS home>

>  End points: TCP:1521

>  Listener is enabled.

>  Listener is individually enabled on nodes:

>  Listener is individually disabled on nodes: 

>End Command output

2021-05-20 21:12:51: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg1.log

2021-05-20 21:12:51: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg1.log

2021-05-20 21:12:51: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 332

2021-05-20 21:12:51: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 332

2021-05-20 21:12:52: Command output:

>  CLSRSC-332: CRS resources for listeners are still configured

>End Command output

2021-05-20 21:12:52: CLSRSC-332: CRS resources for listeners are still configured

2021-05-20 21:12:52: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl stop listener -f"

2021-05-20 21:12:52: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg2.log

2021-05-20 21:12:52: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl stop listener -f

2021-05-20 21:12:53: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg2.log

2021-05-20 21:12:53: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg2.log

2021-05-20 21:12:53: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl remove listener -a -f"

2021-05-20 21:12:53: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg3.log

2021-05-20 21:12:53: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl remove listener -a -f

2021-05-20 21:12:55: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg3.log

2021-05-20 21:12:55: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg3.log

2021-05-20 21:12:55: Remove Resources

2021-05-20 21:12:55: Validate srvctl command

2021-05-20 21:12:55: Validating /u01/app/19.3.0.0/grid/bin/srvctl

2021-05-20 21:12:55: Perform initialization tasks before configuring CDP

2021-05-20 21:12:55: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl config cdp"

2021-05-20 21:12:55: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg4.log

2021-05-20 21:12:55: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl config cdp

2021-05-20 21:12:56: Command output:

>  PRCS-1157 : The CDP resource does not exist.

>End Command output

2021-05-20 21:12:56: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg4.log

2021-05-20 21:12:56: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg4.log

2021-05-20 21:12:56: CDP resource does not exist.

2021-05-20 21:12:56: is cdp configured: 0

2021-05-20 21:12:56: CDP is not configured.

2021-05-20 21:12:56: Removing CVU ...

2021-05-20 21:12:56: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl stop cvu -f"

2021-05-20 21:12:56: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg5.log

2021-05-20 21:12:56: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg5.log

2021-05-20 21:12:56: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg5.log

2021-05-20 21:12:56: Running as user oracle: /u01/app/19.3.0.0/grid/bin/srvctl stop cvu -f

2021-05-20 21:12:57: Removing file /tmp/jTgKCNzMUq

2021-05-20 21:12:57:

2021-05-20 21:12:57: Successfully removed file: /tmp/jTgKCNzMUq

2021-05-20 21:12:57: pipe exit code: 0

2021-05-20 21:12:57: /bin/su successfully executed

 

2021-05-20 21:12:57:

2021-05-20 21:12:57: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg5.log

2021-05-20 21:12:57: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg5.log

2021-05-20 21:12:57: Stop CVU ... success

2021-05-20 21:12:57: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl remove cvu -f"

2021-05-20 21:12:57: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg6.log

2021-05-20 21:12:57: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg6.log

2021-05-20 21:12:57: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg6.log

2021-05-20 21:12:57: Running as user oracle: /u01/app/19.3.0.0/grid/bin/srvctl remove cvu -f

2021-05-20 21:12:58: Removing file /tmp/8AsRpNdT49

2021-05-20 21:12:58:

2021-05-20 21:12:58: Successfully removed file: /tmp/8AsRpNdT49

2021-05-20 21:12:58: pipe exit code: 0

2021-05-20 21:12:58: /bin/su successfully executed

 

2021-05-20 21:12:58:

2021-05-20 21:12:58: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg6.log

2021-05-20 21:12:58: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg6.log

2021-05-20 21:12:58: Remove CVU ... success

2021-05-20 21:12:58: Removing scan....

2021-05-20 21:12:58: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl stop scan_listener -f"

2021-05-20 21:12:58: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg7.log

2021-05-20 21:12:58: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg7.log

2021-05-20 21:12:58: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg7.log

2021-05-20 21:12:58: Running as user oracle: /u01/app/19.3.0.0/grid/bin/srvctl stop scan_listener -f

2021-05-20 21:13:00: Removing file /tmp/Srl8pDTiqK

2021-05-20 21:13:00:

2021-05-20 21:13:00: Successfully removed file: /tmp/Srl8pDTiqK

2021-05-20 21:13:00: pipe exit code: 0

2021-05-20 21:13:00: /bin/su successfully executed

 

2021-05-20 21:13:00:

2021-05-20 21:13:00: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg7.log

2021-05-20 21:13:00: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg7.log

2021-05-20 21:13:00: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl remove scan_listener -y -f"

2021-05-20 21:13:00: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg8.log

2021-05-20 21:13:00: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg8.log

2021-05-20 21:13:00: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg8.log

2021-05-20 21:13:00: Running as user oracle: /u01/app/19.3.0.0/grid/bin/srvctl remove scan_listener -y -f

2021-05-20 21:13:01: Removing file /tmp/69yznpjBrY

2021-05-20 21:13:01:

2021-05-20 21:13:01: Successfully removed file: /tmp/69yznpjBrY

2021-05-20 21:13:01: pipe exit code: 0

2021-05-20 21:13:01: /bin/su successfully executed

 

2021-05-20 21:13:01:

2021-05-20 21:13:01: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg8.log

2021-05-20 21:13:01: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg8.log

2021-05-20 21:13:01: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl stop scan -f"

2021-05-20 21:13:01: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg9.log

2021-05-20 21:13:01: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl stop scan -f

2021-05-20 21:13:02: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg9.log

2021-05-20 21:13:02: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg9.log

2021-05-20 21:13:02: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl remove scan -y -f"

2021-05-20 21:13:02: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg10.log

2021-05-20 21:13:02: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl remove scan -y -f

2021-05-20 21:13:04: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg10.log

2021-05-20 21:13:04: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg10.log

2021-05-20 21:13:04: Removing nodeapps...

2021-05-20 21:13:04: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl config nodeapps"

2021-05-20 21:13:04: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg11.log

2021-05-20 21:13:04: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl config nodeapps

2021-05-20 21:13:09: Command output:

>  Network 1 exists

>  Subnet IPv4: 192.168.56.0/255.255.255.0/enp0s3, static

>  Subnet IPv6:

>  Ping Targets:

>  Network is enabled

>  Network is individually enabled on nodes:

>  Network is individually disabled on nodes:

>  VIP exists: network number 1, hosting node rac1

>  VIP Name: rac1-vip

>  VIP IPv4 Address: 192.168.56.92

>  VIP IPv6 Address:

>  VIP is enabled.

>  VIP is individually enabled on nodes:

>  VIP is individually disabled on nodes:

>  ONS exists: Local port 6100, remote port 6200, EM port 2016, Uses SSL true

>  ONS is enabled

>  ONS is individually enabled on nodes:

>  ONS is individually disabled on nodes: 

>End Command output

2021-05-20 21:13:09: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg11.log

2021-05-20 21:13:09: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg11.log

2021-05-20 21:13:09: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl stop nodeapps -n rac1 -f"

2021-05-20 21:13:09: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg12.log

2021-05-20 21:13:09: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl stop nodeapps -n rac1 -f

2021-05-20 21:13:14: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg12.log

2021-05-20 21:13:14: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg12.log

2021-05-20 21:13:14: Invoking "/u01/app/19.3.0.0/grid/bin/srvctl remove nodeapps -y -f"

2021-05-20 21:13:14: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg13.log

2021-05-20 21:13:14: Executing cmd: /u01/app/19.3.0.0/grid/bin/srvctl remove nodeapps -y -f

2021-05-20 21:13:17: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg13.log

2021-05-20 21:13:17: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/srvmcfg13.log

2021-05-20 21:13:17: Deconfiguring Oracle ASM or shared filesystem storage ...

2021-05-20 21:13:17: Stopping Oracle Clusterware ...

2021-05-20 21:13:17: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stop crs  -f

2021-05-20 21:13:53: Command output:

>  CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

>  CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'

>  CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'rac1'

>  CRS-2673: Attempting to stop 'ora.test.db' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.chad' on 'rac1'

>  CRS-2677: Stop of 'ora.test.db' on 'rac1' succeeded

>  CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'rac1'

>  CRS-2673: Attempting to stop 'ora.RECO.dg' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.VOTE.dg' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac1'

>  CRS-2677: Stop of 'ora.DATA.dg' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.VOTE.dg' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.RECO.dg' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.asm' on 'rac1'

>  CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac1'

>  CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'rac1'

>  CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'rac1' succeeded

>  CRS-33677: Stop of resource group 'ora.asmgroup' on server 'rac1' succeeded.

>  CRS-2677: Stop of 'ora.chad' on 'rac1' succeeded

>  CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed

>  CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.asm' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.crf' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'

>  CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.drivers.acfs' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'

>  CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'

>  CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'

>  CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'

>  CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded

>  CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed

>  CRS-4133: Oracle High Availability Services has been stopped.

>End Command output

2021-05-20 21:13:53: The return value of stop of CRS: 0

2021-05-20 21:13:53: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:13:53: Command output:

>  CRS-4639: Could not contact Oracle High Availability Services

>End Command output

2021-05-20 21:13:53: Oracle CRS stack has been shut down

2021-05-20 21:13:53: Checking if OCR is on ASM

2021-05-20 21:13:53: Retrieving OCR main disk location

2021-05-20 21:13:53: Opening file /etc/oracle/ocr.loc

2021-05-20 21:13:53: Value (+VOTE/rac-cluster/OCRFILE/registry.255.1063642547) is set for key=ocrconfig_loc

2021-05-20 21:13:53: Retrieving OCR mirror disk location

2021-05-20 21:13:53: Opening file /etc/oracle/ocr.loc

2021-05-20 21:13:53: Value () is set for key=ocrmirrorconfig_loc

2021-05-20 21:13:53: Retrieving OCR loc3 disk location

2021-05-20 21:13:53: Opening file /etc/oracle/ocr.loc

2021-05-20 21:13:53: Value () is set for key=ocrconfig_loc3

2021-05-20 21:13:53: Retrieving OCR loc4 disk location

2021-05-20 21:13:53: Opening file /etc/oracle/ocr.loc

2021-05-20 21:13:53: Value () is set for key=ocrconfig_loc4

2021-05-20 21:13:53: Retrieving OCR loc5 disk location

2021-05-20 21:13:53: Opening file /etc/oracle/ocr.loc

2021-05-20 21:13:53: Value () is set for key=ocrconfig_loc5

2021-05-20 21:13:53: OCR is on ASM

2021-05-20 21:13:53: De-configuring ASM...

2021-05-20 21:13:53: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl start crs -excl

2021-05-20 21:14:50: Command output:

>  CRS-4123: Oracle High Availability Services has been started.

>  CRS-2672: Attempting to start 'ora.evmd' on 'rac1'

>  CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

>  CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

>  CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

>  CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

>  CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

>  CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

>  CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.crf' on 'rac1'

>  CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'

>  CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac1'

>  CRS-2676: Start of 'ora.crf' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.asm' on 'rac1'

>  CRS-2676: Start of 'ora.asm' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.storage' on 'rac1'

>  CRS-2676: Start of 'ora.storage' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.crsd' on 'rac1'

>  CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded

>End Command output

2021-05-20 21:14:50: The return value of blocking start of CRS with -excl: 0

2021-05-20 21:14:50: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:14:50: Command output:

>  CRS-4638: Oracle High Availability Services is online

>  CRS-4692: Cluster Ready Services is online in exclusive mode

>  CRS-4529: Cluster Synchronization Services is online

>  CRS-4533: Event Manager is online

>End Command output

2021-05-20 21:14:50: Oracle CRS stack completely started and running

2021-05-20 21:14:50: Oracle CRS home = /u01/app/19.3.0.0/grid

2021-05-20 21:14:50: GPnP host = rac1

2021-05-20 21:14:50: Oracle GPnP home = /u01/app/19.3.0.0/grid/gpnp

2021-05-20 21:14:50: Oracle GPnP local home = /u01/app/19.3.0.0/grid/gpnp/rac1

2021-05-20 21:14:50: GPnP directories verified.

2021-05-20 21:14:50: Try to read ASM mode from the global stage profile

2021-05-20 21:14:50: gpnptool: run /u01/app/19.3.0.0/grid/bin/gpnptool getpval -p="/u01/app/19.3.0.0/grid/gpnp/profiles/peer/profile.xml" -o="/u01/app/oracle/crsdata/rac1/LYNiI28MRN" -asm_m

2021-05-20 21:14:50: Running as user oracle: /u01/app/19.3.0.0/grid/bin/gpnptool getpval -p="/u01/app/19.3.0.0/grid/gpnp/profiles/peer/profile.xml" -o="/u01/app/oracle/crsdata/rac1/LYNiI28MRN" -asm_m

2021-05-20 21:14:51: Removing file /tmp/gttFCa2yid

2021-05-20 21:14:51:

2021-05-20 21:14:51: Successfully removed file: /tmp/gttFCa2yid

2021-05-20 21:14:51: pipe exit code: 0

2021-05-20 21:14:51: /bin/su successfully executed

 

2021-05-20 21:14:51: gpnptool: rc=0

2021-05-20 21:14:51: gpnptool output:

 

2021-05-20 21:14:51: Removing file /u01/app/oracle/crsdata/rac1/LYNiI28MRN

2021-05-20 21:14:51:

2021-05-20 21:14:51: Successfully removed file: /u01/app/oracle/crsdata/rac1/LYNiI28MRN

2021-05-20 21:14:51: ASM mode = remote

2021-05-20 21:14:51: ASM mode = remote

2021-05-20 21:14:51: Executing '/u01/app/19.3.0.0/grid/bin/crsctl stop resource ora.crsd -init -f'

2021-05-20 21:14:51: Executing /u01/app/19.3.0.0/grid/bin/crsctl stop resource ora.crsd -init -f

2021-05-20 21:14:51: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stop resource ora.crsd -init -f

2021-05-20 21:14:52: Command output:

>  CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'

>  CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded

>End Command output

2021-05-20 21:14:52: The return value of stop of ora.crsd: 0

2021-05-20 21:14:52: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:14:52: Command output:

>  CRS-4638: Oracle High Availability Services is online

>  CRS-4535: Cannot communicate with Cluster Ready Services

>  CRS-4529: Cluster Synchronization Services is online

>  CRS-4533: Event Manager is online

>End Command output

2021-05-20 21:14:52: Perform initialization tasks before configuring ASM

2021-05-20 21:14:52: KFODkfodListDGs called

 

2021-05-20 21:14:52: Installing xsub XS_KFODCLNT_kfodListDGs for function KFODkfodListDGs

2021-05-20 21:14:52: shared library to load is libasmperl19.so

2021-05-20 21:14:52: libpath found is /u01/app/19.3.0.0/grid/lib and /u01/app/19.3.0.0/grid/rdbms/lib

2021-05-20 21:14:52: DynaLoader:dl_find_symbol failed with: /u01/app/19.3.0.0/grid/perl/bin/perl: undefined symbol: XS_KFODCLNT_kfodListDGs at /u01/app/19.3.0.0/grid/crs/install/oraasm.pm line 1828.

 

2021-05-20 21:14:52: Failed to install XSUB as XS_KFODCLNT_kfodListDGs

2021-05-20 21:14:52: Failed to get disk groups with: .

2021-05-20 21:14:52:

2021-05-20 21:14:52: No vote disk or OCR diskgroup found.

2021-05-20 21:14:52: There is no OCR backup file need to be removed from disk group.

2021-05-20 21:14:52: Executing cmd: /u01/app/19.3.0.0/grid/bin/ocrcheck -config -details -debug

2021-05-20 21:14:52: Command output:

>  Oracle Cluster Registry configuration is :

>  PROT-709:     Device/File Name         : +VOTE/rac-cluster/OCRFILE/registry.255.1063642547

>End Command output

2021-05-20 21:14:52: Parse the output for the complete OCR file name

2021-05-20 21:14:52: LINE: PROT-709:     Device/File Name         : +VOTE/rac-cluster/OCRFILE/registry.255.1063642547

2021-05-20 21:14:52: ASM filename: +VOTE/rac-cluster/OCRFILE/registry.255.1063642547

2021-05-20 21:14:52: OCR files on the diskgroup: +VOTE/rac-cluster/OCRFILE/registry.255.1063642547

2021-05-20 21:14:52: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:14:52: ASM SID attribute: GEN_USR_ORA_INST_NAME=+ASM1

 

2021-05-20 21:14:52: ORACLE_SID = +ASM1

2021-05-20 21:14:52: ORACLE_HOME = /u01/app/19.3.0.0/grid

2021-05-20 21:14:52: Remove ASM file on DG: +VOTE/rac-cluster/OCRFILE/registry.255.1063642547

2021-05-20 21:14:52: Running as user oracle: /u01/app/19.3.0.0/grid/bin/asmcmd --nocp rm -f +VOTE/rac-cluster/OCRFILE/registry.255.1063642547

2021-05-20 21:14:55: Removing file /tmp/nDckHeyZtN

2021-05-20 21:14:55:

2021-05-20 21:14:55: Successfully removed file: /tmp/nDckHeyZtN

2021-05-20 21:14:55: pipe exit code: 0

2021-05-20 21:14:55: /bin/su successfully executed

 

2021-05-20 21:14:55: Output: ;

Return Code: 0.

2021-05-20 21:14:55: Attempt to bounce ohasd

2021-05-20 21:14:55: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stop crs  -f

2021-05-20 21:15:22: Command output:

>  CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

>  CRS-2673: Attempting to stop 'ora.crf' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.storage' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'

>  CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.storage' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.asm' on 'rac1'

>  CRS-2677: Stop of 'ora.drivers.acfs' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'

>  CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'

>  CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'

>  CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded

>  CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed

>  CRS-4133: Oracle High Availability Services has been stopped.

>End Command output

2021-05-20 21:15:22: The return value of stop of CRS: 0

2021-05-20 21:15:22: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:15:23: Command output:

>  CRS-4639: Could not contact Oracle High Availability Services

>End Command output

2021-05-20 21:15:23: Oracle CRS stack has been shut down

2021-05-20 21:15:23: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl start crs -noautostart

2021-05-20 21:15:29: Command output:

>  CRS-4123: Oracle High Availability Services has been started.

>End Command output

2021-05-20 21:15:29: Return value of start of CRS with '-noautostart': 0

2021-05-20 21:15:29: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check has

2021-05-20 21:15:29: Command output:

>  CRS-4638: Oracle High Availability Services is online

>End Command output

2021-05-20 21:15:29: Oracle High Availability Services is online

2021-05-20 21:15:29: Disable ASM to avoid race issue between ASM agent and ASMCA.

2021-05-20 21:15:29: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl modify resource ora.asm -attr "ENABLED@SERVERNAME(rac1)=0" -init

2021-05-20 21:15:29: Successfully disabled ASM resource.

2021-05-20 21:15:29: Executing cmd: /u01/app/19.3.0.0/grid/bin/ocrcheck -config -debug

2021-05-20 21:15:29: Command output:

>  Oracle Cluster Registry configuration is :

>  PROT-709:     Device/File Name         :      +VOTE

>End Command output

2021-05-20 21:15:29: Parse the output for diskgroups with OCR

2021-05-20 21:15:29: LINE: PROT-709:     Device/File Name         :      +VOTE

2021-05-20 21:15:29: OCR DG: +VOTE

2021-05-20 21:15:29: OCR DG name: VOTE

2021-05-20 21:15:29: Diskgoups with OCR: VOTE

2021-05-20 21:15:29: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:15:29: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:15:29: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check css

2021-05-20 21:15:30: Command output:

>  CRS-4530: Communications failure contacting Cluster Synchronization Services daemon

>End Command output

2021-05-20 21:15:30: Starting CSS exclusive

2021-05-20 21:15:30: Starting CSS in exclusive mode

2021-05-20 21:15:30: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:15:30: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl start crs -excl -cssonly

2021-05-20 21:15:48: Command output:

>  CRS-2672: Attempting to start 'ora.evmd' on 'rac1'

>  CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

>  CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

>  CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

>  CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

>  CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

>  CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

>  CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

>  CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

>  CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

>End Command output

2021-05-20 21:15:48: CRS-2672: Attempting to start 'ora.evmd' on 'rac1'

2021-05-20 21:15:48: CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

2021-05-20 21:15:48: CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded

2021-05-20 21:15:48: CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

2021-05-20 21:15:48: CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

2021-05-20 21:15:48: CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

2021-05-20 21:15:48: CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

2021-05-20 21:15:48: CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

2021-05-20 21:15:48: CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

2021-05-20 21:15:48: CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

2021-05-20 21:15:48: CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

2021-05-20 21:15:48: CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

2021-05-20 21:15:48: CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

2021-05-20 21:15:48: CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

2021-05-20 21:15:48: Querying CSS vote disks

2021-05-20 21:15:48: Voting disk is : ##  STATE    File Universal Id                File Name Disk group

2021-05-20 21:15:48: Voting disk is : --  -----    -----------------                --------- ---------

2021-05-20 21:15:48: Voting disk is :  1. ONLINE   fcea88d3a11e4fe7bf6eb13a36bbac40 (/dev/sdd1) [VOTE]

2021-05-20 21:15:48: Voting disk is :  2. ONLINE   63665d7abcd64f16bfe5c31b12707767 (/dev/sde1) [VOTE]

2021-05-20 21:15:48: Voting disk is :  3. ONLINE   b65ded4cdf3e4fbcbf9ef01d9d6353ae (/dev/sdf1) [VOTE]

2021-05-20 21:15:48: Voting disk is : Located 3 voting disk(s).

2021-05-20 21:15:48: Diskgroups found: VOTE

2021-05-20 21:15:48: The diskgroup to store voting files: VOTE

2021-05-20 21:15:48: All diskgroups used by Clusterware: VOTE

2021-05-20 21:15:48: Dropping the diskgroups: VOTE ...

2021-05-20 21:15:48: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:15:48: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:15:48: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check css

2021-05-20 21:15:48: Command output:

>  CRS-4529: Cluster Synchronization Services is online

>End Command output

2021-05-20 21:15:48: Querying CSS vote disks

2021-05-20 21:15:48: Voting disk is : ##  STATE    File Universal Id                File Name Disk group

2021-05-20 21:15:48: Voting disk is : --  -----    -----------------                --------- ---------

2021-05-20 21:15:48: Voting disk is :  1. ONLINE   fcea88d3a11e4fe7bf6eb13a36bbac40 (/dev/sdd1) [VOTE]

2021-05-20 21:15:48: Voting disk is :  2. ONLINE   63665d7abcd64f16bfe5c31b12707767 (/dev/sde1) [VOTE]

2021-05-20 21:15:48: Voting disk is :  3. ONLINE   b65ded4cdf3e4fbcbf9ef01d9d6353ae (/dev/sdf1) [VOTE]

2021-05-20 21:15:48: Voting disk is : Located 3 voting disk(s).

2021-05-20 21:15:48: Diskgroups found: VOTE

2021-05-20 21:15:48: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl delete css votedisk '+VOTE'

2021-05-20 21:15:49: Command output:

>  CRS-4611: Successful deletion of voting disk +VOTE.

>End Command output

2021-05-20 21:15:49: keep DG = 1

2021-05-20 21:15:49: Re-use existing diskgroups

2021-05-20 21:15:49: Perform initialization tasks before configuring ASM

2021-05-20 21:15:49: Running as user oracle: /u01/app/19.3.0.0/grid/bin/asmca -silent -deleteLocalASM -diskGroups VOTE -reuseDiskgroup

2021-05-20 21:15:49: Executing /bin/su oracle -c "/u01/app/19.3.0.0/grid/bin/asmca -silent -deleteLocalASM -diskGroups VOTE -reuseDiskgroup "

2021-05-20 21:15:49: Executing cmd: /bin/su oracle -c "/u01/app/19.3.0.0/grid/bin/asmca -silent -deleteLocalASM -diskGroups VOTE -reuseDiskgroup "

2021-05-20 21:17:28: Command output:

>  ASM de-configuration trace file location: /u01/app/oracle/cfgtoollogs/asmca/asmcadc_clean2021-05-20_09-16-11PM.log

>  ASM Clean Configuration START

>  ASM Clean Configuration END

> 

>  ASM instance deleted successfully. Check /u01/app/oracle/cfgtoollogs/asmca/asmcadc_clean2021-05-20_09-16-11PM.log for details.

>  

>End Command output

2021-05-20 21:17:28: disableRemoteASM called with oracle

2021-05-20 21:17:28: Installing xsub XS_KFODCLNT_kfodDisableRem for function KFODkfodDisableRem

2021-05-20 21:17:28: shared library to load is libasmperl19.so

2021-05-20 21:17:28: libpath found is /u01/app/19.3.0.0/grid/lib and /u01/app/19.3.0.0/grid/rdbms/lib

2021-05-20 21:17:28: DynaLoader:dl_find_symbol failed with: /u01/app/19.3.0.0/grid/perl/bin/perl: undefined symbol: XS_KFODCLNT_kfodDisableRem at /u01/app/19.3.0.0/grid/crs/install/oraasm.pm line 1828.

 

2021-05-20 21:17:28: Failed to install XSUB as XS_KFODCLNT_kfodDisableRem

2021-05-20 21:17:28: disable remote asm failed with error

2021-05-20 21:17:28: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 170 '0'

2021-05-20 21:17:28: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 170 '0'

2021-05-20 21:17:28: Command output:

>  CLSRSC-170: Failed to deconfigure Oracle ASM (error code 0)

>End Command output

2021-05-20 21:17:28: CLSRSC-170: Failed to deconfigure Oracle ASM (error code 0)

2021-05-20 21:17:28: ###### Begin Error Stack Trace ######

2021-05-20 21:17:28:     Package         File                 Line Calling  

2021-05-20 21:17:28:     --------------- -------------------- ---- ----------

2021-05-20 21:17:28:  1: crsdeconfig     crsdeconfig.pm       1609 crsutils::print_error

2021-05-20 21:17:28:  2: crsdeconfig     crsdeconfig.pm        482 crsdeconfig::deconfigure_ASM

2021-05-20 21:17:28:  3: crsdeconfig     crsdeconfig.pm        349 crsdeconfig::crs_deconfig_resources

2021-05-20 21:17:28:  4: crsdeconfig     crsdeconfig.pm        311 crsdeconfig::CRSDeconfig

2021-05-20 21:17:28:  5: main            rootcrs.pl            370 crsdeconfig::new

2021-05-20 21:17:28: ####### End Error Stack Trace #######

 

2021-05-20 21:17:28: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 558

2021-05-20 21:17:28: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 558

2021-05-20 21:17:28: Command output:

>  CLSRSC-558: failed to deconfigure ASM

>End Command output

2021-05-20 21:17:28: CLSRSC-558: failed to deconfigure ASM

2021-05-20 21:17:28: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 651

2021-05-20 21:17:28: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 651

2021-05-20 21:17:28: Command output:

>  CLSRSC-651: One or more deconfiguration steps failed, but the deconfiguration process continued because the -force option was specified.

>End Command output

2021-05-20 21:17:28: CLSRSC-651: One or more deconfiguration steps failed, but the deconfiguration process continued because the -force option was specified.

2021-05-20 21:17:28: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:17:28: Configured CRS Home: /u01/app/19.3.0.0/grid

2021-05-20 21:17:28: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check css

2021-05-20 21:17:29: Command output:

>  CRS-4529: Cluster Synchronization Services is online

>End Command output

2021-05-20 21:17:29: Querying CSS vote disks

2021-05-20 21:17:29: Voting disk is : Located 0 voting disk(s).

2021-05-20 21:17:29: Vote disks found:

2021-05-20 21:17:29: Reset voting disks

2021-05-20 21:17:29: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stop crs  -f

2021-05-20 21:17:35: Command output:

>  CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

>  CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac1'

>  CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'

>  CRS-2677: Stop of 'ora.drivers.acfs' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded

>  CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'

>  CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'

>  CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded

>  CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded

>  CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed

>  CRS-4133: Oracle High Availability Services has been stopped.

>End Command output

2021-05-20 21:17:35: The return value of stop of CRS: 0

2021-05-20 21:17:35: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl check crs

2021-05-20 21:17:35: Command output:

>  CRS-4639: Could not contact Oracle High Availability Services

>End Command output

2021-05-20 21:17:35: Oracle CRS stack has been shut down

2021-05-20 21:17:45: Executing the [DeconfigCleanup] step with checkpoint [null] ...

2021-05-20 21:17:45: rsyslog service is running

2021-05-20 21:17:45: Executing /sbin/service rsyslog restart

2021-05-20 21:17:45: Executing cmd: /sbin/service rsyslog restart

2021-05-20 21:17:45: Command output:

>  Redirecting to /bin/systemctl restart rsyslog.service

>End Command output

2021-05-20 21:17:45: Running /u01/app/19.3.0.0/grid/bin/acfshanfs installed -nfsv4lock

2021-05-20 21:17:45: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfshanfs installed -nfsv4lock

2021-05-20 21:17:45: Command output:

>  ACFS-9204: false

>End Command output

2021-05-20 21:17:45: acfshanfs is not installed

2021-05-20 21:17:45: Executing step deconfiguration ACFS on the last node

2021-05-20 21:17:45: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsdriverstate supported

2021-05-20 21:17:45: Command output:

>  ACFS-9200: Supported

>End Command output

2021-05-20 21:17:45: acfs is supported

2021-05-20 21:17:45: isACFSInstalled: 1

2021-05-20 21:17:45: Not using checkpoint for USM driver uninstall

2021-05-20 21:17:45: Stopping ora.drivers.acfs if it exists, so that it doesn't race.

2021-05-20 21:17:45: isACFSSupported: 1

2021-05-20 21:17:45: Executing cmd: /u01/app/19.3.0.0/grid/bin/crsctl stat res ora.drivers.acfs -init

2021-05-20 21:17:46: Command output:

>  CRS-4639: Could not contact Oracle High Availability Services

>  CRS-4000: Command Status failed, or completed with errors.

>End Command output

2021-05-20 21:17:46: Executing /u01/app/19.3.0.0/grid/bin/acfsroot uninstall -t2

2021-05-20 21:17:46: Executing cmd: /u01/app/19.3.0.0/grid/bin/acfsroot uninstall -t2

2021-05-20 21:17:54: Command output:

>  ACFS-9176: Entering 'ga admin name'

>  ACFS-9176: Entering 'va admin group'

>  ACFS-9178: Return code = 0

>  ACFS-9177: Return from 'va admin group'

>  ACFS-9178: Return code = dba

>  ACFS-9177: Return from 'ga admin name'

>  ACFS-9176: Entering 'uncompress'

>  Version Match: 201219,201219

>  Setting install_files_loc to default for main

>  ACFS-9505: Using acfsutil executable from location: '/u01/app/19.3.0.0/grid/usm/install/cmds/bin/acfsutil'

>  ACFS-9176: Entering 'uninstall'

>  ACFS-9176: Entering 'lc check any driver'

>  ACFS-9155: Checking for existing 'oracleoks.ko' driver installation.

>  ACFS-9178: Return code = 1

>  ACFS-9177: Return from 'lc check any driver'

>  ACFS-9312: Existing ADVM/ACFS installation detected.

>  ACFS-9176: Entering 'uld usm drvs'

>  ACFS-9178: Return code = USM_SUCCESS

>  ACFS-9177: Return from 'uld usm drvs'

>  ACFS-9314: Removing previous ADVM/ACFS installation.

>  ACFS-9176: Entering 'getparm'

>  ACFS-9178: Return code = rac-cluster

>  ACFS-9177: Return from 'getparm'

>  ACFS-9176: Entering 'depmod uninstall'

>  ACFS-9177: Return from 'depmod uninstall'

>  ACFS-9315: Previous ADVM/ACFS components successfully removed.

>  ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf

>  ACFS-9178: Return code = USM_SUCCESS

>  ACFS-9177: Return from 'uninstall'

>  ACFS-9176: Entering 'acroot ex'

>  ACFS-9178: Return code = 0

>  ACFS-9177: Return from 'acroot ex'

>End Command output

2021-05-20 21:17:54: /u01/app/19.3.0.0/grid/bin/acfsroot uninstall -t2 ... success

2021-05-20 21:17:54: ACFS drivers uninstall completed

2021-05-20 21:17:54: Running /u01/app/19.3.0.0/grid/bin/okadriverstate installed

2021-05-20 21:17:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/okadriverstate installed

2021-05-20 21:17:54: Command output:

>  OKA-9204: false

>End Command output

2021-05-20 21:17:54: OKA is not installed

2021-05-20 21:17:54: Executing step deconfiguration AFD on the last node

2021-05-20 21:17:54: AFD Configuration is not selected

2021-05-20 21:17:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/afddriverstate installed

2021-05-20 21:17:54: Command output:

>  AFD-9204: AFD device driver installed status: 'false'

>End Command output

2021-05-20 21:17:54: Failed to open /opt/oracle/extapi/64/asm/orcl/1 for reading: No such file or directory

2021-05-20 21:17:54: AFD Library is not present

2021-05-20 21:17:54: AFD is not installed

2021-05-20 21:17:54: AFD driver has been removed.

2021-05-20 21:17:54: CHM repository path not found

2021-05-20 21:17:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4006

2021-05-20 21:17:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4006

2021-05-20 21:17:54: Command output:

>  CLSRSC-4006: Removing Oracle Trace File Analyzer (TFA) Collector.

>End Command output

2021-05-20 21:17:54: CLSRSC-4006: Removing Oracle Trace File Analyzer (TFA) Collector.

2021-05-20 21:17:54: Executing cmd: /u01/app/19.3.0.0/grid/tfa/rac1/tfa_home/bin/uninstalltfa -silent -local -crshome /u01/app/19.3.0.0/grid

2021-05-20 21:17:54: Command output:

>  TFA-00055: TFA_HOME not found in CRS_HOME. Exiting now...

>End Command output

2021-05-20 21:17:54: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4007

2021-05-20 21:17:55: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 4007

2021-05-20 21:17:55: Command output:

>  CLSRSC-4007: Successfully removed Oracle Trace File Analyzer (TFA) Collector.

>End Command output

2021-05-20 21:17:55: CLSRSC-4007: Successfully removed Oracle Trace File Analyzer (TFA) Collector.

2021-05-20 21:17:55: Remove init resources

2021-05-20 21:17:55: itab entries=cssd|evmd|crsd|ohasd

2021-05-20 21:17:55: Check if the startup mechanism upstart is being used

2021-05-20 21:17:55: Executing cmd: /bin/rpm -qf /sbin/init

2021-05-20 21:17:55: Command output:

>  systemd-219-67.el7.x86_64

>End Command output

2021-05-20 21:17:55: Not using the Linux startup method: upstart

2021-05-20 21:17:55: Check if the startup mechanism systemd is being used

2021-05-20 21:17:55: Executing cmd: /bin/rpm -qf /sbin/init

2021-05-20 21:17:55: Command output:

>  systemd-219-67.el7.x86_64

>End Command output

2021-05-20 21:17:55: remove systemd conf for services: [cssd evmd crsd ohasd]

2021-05-20 21:17:55: attempt to deconfigure oracle-cssd.service

2021-05-20 21:17:55: Executing cmd: /usr/bin/systemctl status oracle-cssd.service

2021-05-20 21:17:55: Command output:

>  Unit oracle-cssd.service could not be found.

>End Command output

2021-05-20 21:17:55: The unit -> oracle-cssd.service may not be installed

2021-05-20 21:17:55: isRunning: 0; isEnabled: 0

2021-05-20 21:17:55: remove service file: /etc/systemd/system/oracle-cssd.service

2021-05-20 21:17:55: attempt to deconfigure oracle-evmd.service

2021-05-20 21:17:55: Executing cmd: /usr/bin/systemctl status oracle-evmd.service

2021-05-20 21:17:55: Command output:

>  Unit oracle-evmd.service could not be found.

>End Command output

2021-05-20 21:17:55: The unit -> oracle-evmd.service may not be installed

2021-05-20 21:17:55: isRunning: 0; isEnabled: 0

2021-05-20 21:17:55: remove service file: /etc/systemd/system/oracle-evmd.service

2021-05-20 21:17:55: attempt to deconfigure oracle-crsd.service

2021-05-20 21:17:55: Executing cmd: /usr/bin/systemctl status oracle-crsd.service

2021-05-20 21:17:55: Command output:

>  Unit oracle-crsd.service could not be found.

>End Command output

2021-05-20 21:17:55: The unit -> oracle-crsd.service may not be installed

2021-05-20 21:17:55: isRunning: 0; isEnabled: 0

2021-05-20 21:17:55: remove service file: /etc/systemd/system/oracle-crsd.service

2021-05-20 21:17:55: attempt to deconfigure oracle-ohasd.service

2021-05-20 21:17:55: Executing cmd: /usr/bin/systemctl status oracle-ohasd.service

2021-05-20 21:17:55: Command output:

>  ● oracle-ohasd.service - Oracle High Availability Services

>     Loaded: loaded (/etc/systemd/system/oracle-ohasd.service; enabled; vendor preset: disabled)

>    Drop-In: /etc/systemd/system/oracle-ohasd.service.d

>             └─00_oracle-ohasd.conf

>     Active: active (running) since Thu 2021-05-20 09:42:20 KST; 11h ago

>   Main PID: 1458 (init.ohasd)

>      Tasks: 2

>     CGroup: /system.slice/oracle-ohasd.service

>             ├─ 1458 /bin/sh /etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null

>             └─30871 /bin/sleep 1

> 

>  May 20 21:14:49 rac1 oracle_23776_+a[23776]: Oracle Audit[23776]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac1' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:14:49 rac1 oracle_23777_+a[23777]: Oracle Audit[23777]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac1' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:14:51 rac1 oracle_23898_+a[23898]: Oracle Audit[23898]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSDBA' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac1' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:14:55 rac1 octssd.bin[22648]: Oracle Clusterware: 2021-05-20 21:14:55.200

>                                          [(22648)]CRS-8504:Oracle Clusterware OCTSSD process with operating system process ID 22648 is exiting

>  May 20 21:14:57 rac1 oracle_24397_+a[24397]: Oracle Audit[24397]: LENGTH : '242' ACTION :[7] 'CONNECT' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSASM' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac1' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '100'

>  May 20 21:15:03 rac1 oracle_24397_+a[24397]: Oracle Audit[24397]: LENGTH : '254' ACTION :[18] 'SHUTDOWN IMMEDIATE' DATABASE USER:[1] '/' PRIVILEGE :[6] 'SYSASM' CLIENT USER:[6] 'oracle' CLIENT TERMINAL:[5] 'pts/0' STATUS:[1] '0' DBID:[0] '' SESSIONID:[10] '4294967295' USERHOST:[4] 'rac1' CLIENT ADDRESS:[0] '' ACTION NUMBER:[3] '139'

>  May 20 21:15:24 rac1 clsecho[26991]: /etc/init.d/init.ohasd: 26936 \> /sys/fs/cgroup/cpu,cpuacct/tasks

>  May 20 21:15:24 rac1 init.ohasd[1458]: /etc/init.d/init.ohasd: 26936 \> /sys/fs/cgroup/cpu,cpuacct/tasks

>  May 20 21:15:24 rac1 init.ohasd[1458]: /etc/init.d/init.ohasd: 26936 \> /sys/fs/cgroup/systemd/system.slice/oracle-ohasd.service/tasks

>  May 20 21:15:25 rac1 ohasd.bin[26936]: Oracle Clusterware: 2021-05-20 21:15:25.741

>                                         [(26936)]CRS-8500:Oracle Clusterware OHASD process is starting with operating system process ID 26936

>End Command output

2021-05-20 21:17:55: isRunning: 1; isEnabled: 1

2021-05-20 21:17:55: Executing cmd: /usr/bin/systemctl stop oracle-ohasd.service

2021-05-20 21:17:55: Executing cmd: /usr/bin/systemctl disable oracle-ohasd.service

2021-05-20 21:17:55: Command output:

>  Removed symlink /etc/systemd/system/multi-user.target.wants/oracle-ohasd.service.

>  Removed symlink /etc/systemd/system/graphical.target.wants/oracle-ohasd.service.

>End Command output

2021-05-20 21:17:55: remove service file: /etc/systemd/system/oracle-ohasd.service

2021-05-20 21:17:55: Removing file /etc/systemd/system/oracle-ohasd.service

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/systemd/system/oracle-ohasd.service

2021-05-20 21:17:55: remove conf file: /etc/systemd/system/oracle-ohasd.service.d/00_oracle-ohasd.conf

2021-05-20 21:17:55: Removing file /etc/systemd/system/oracle-ohasd.service.d/00_oracle-ohasd.conf

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/systemd/system/oracle-ohasd.service.d/00_oracle-ohasd.conf

2021-05-20 21:17:55: Removing script for Oracle Cluster Ready services

2021-05-20 21:17:55: Removing /etc/init.d/init.evmd file

2021-05-20 21:17:55: Removing /etc/init.d/init.crsd file

2021-05-20 21:17:55: Removing /etc/init.d/init.cssd file

2021-05-20 21:17:55: Removing /etc/init.d/init.crs file

2021-05-20 21:17:55: Removing /etc/init.d/init.ohasd file

2021-05-20 21:17:55: Removing file /etc/init.d/init.ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/init.d/init.ohasd

2021-05-20 21:17:55: Init file = ohasd

2021-05-20 21:17:55: Removing "ohasd" from RC dirs

2021-05-20 21:17:55: Removing file /etc/rc.d/rc0.d/K15ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/rc.d/rc0.d/K15ohasd

2021-05-20 21:17:55: Removing file /etc/rc.d/rc1.d/K15ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/rc.d/rc1.d/K15ohasd

2021-05-20 21:17:55: Removing file /etc/rc.d/rc2.d/K15ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/rc.d/rc2.d/K15ohasd

2021-05-20 21:17:55: Removing file /etc/rc.d/rc3.d/S96ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/rc.d/rc3.d/S96ohasd

2021-05-20 21:17:55: Removing file /etc/rc.d/rc4.d/K15ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/rc.d/rc4.d/K15ohasd

2021-05-20 21:17:55: Removing file /etc/rc.d/rc5.d/S96ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/rc.d/rc5.d/S96ohasd

2021-05-20 21:17:55: Removing file /etc/rc.d/rc6.d/K15ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/rc.d/rc6.d/K15ohasd

2021-05-20 21:17:55: Init file = init.crs

2021-05-20 21:17:55: Removing "init.crs" from RC dirs

2021-05-20 21:17:55: /etc/oracle/cell/network-config/cellip.ora not found

2021-05-20 21:17:55: Cleaning up SCR settings in /etc/oracle/scls_scr

2021-05-20 21:17:55: Cleaning oprocd directory, and log files

2021-05-20 21:17:55: Cleaning up Network socket directories

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/mdnsd

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/mdnsd.pid

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/npohasd

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/npohasd2

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_css_ctrllcl_CSSD_BCCM_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_GPNPD_rac1

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_GPNPD_rac1_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_CSSD

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_CSSD

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_CSSD_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_CSSD_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_EVMD

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_EVMD

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_EVMD_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_EVMD_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_GIPCD

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_GIPCD_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_GPNPD

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_GPNPD_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_INIT

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_rac1_INIT_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_scls_opct_rac1

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/ora_gipc_scls_opct_rac1_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sAevm

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sAevm_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac1_

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac1__lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac1_rac-cluster

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOCSSD_LL_rac1_rac-cluster_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOHASD_IPC_SOCKET_11

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOHASD_IPC_SOCKET_11_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOHASD_UI_SOCKET

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOHASD_UI_SOCKET_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOracle_CSS_LclLstnr_rac-cluster_1

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sOracle_CSS_LclLstnr_rac-cluster_1_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROL

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sprocr_local_conn_0_PROL_lock

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sSYSTEM.evm.acceptor.auth

2021-05-20 21:17:55: Unlinking file : /var/tmp/.oracle/sSYSTEM.evm.acceptor.auth_lock

2021-05-20 21:17:55: Root script is not invoked as part of deinstall. /u01/app/oracle/oradiag_root, /etc/oracle/maps, and /etc/oracle/setasmgid are not removed

2021-05-20 21:17:55: removing all contents under /u01/app/19.3.0.0/grid/gpnp/profiles/peer

2021-05-20 21:17:55: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/peer

2021-05-20 21:17:55: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/prdr

2021-05-20 21:17:55: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/pa

2021-05-20 21:17:55: removing all contents under /u01/app/19.3.0.0/grid/gpnp/wallets/root

2021-05-20 21:17:55: removing gpnp backup directory /u01/app/19.3.0.0/grid/gpnp/gpnp_bcp__2021_2_4_162452

2021-05-20 21:17:55: Executing /etc/init.d/ohasd deinstall

2021-05-20 21:17:55: Executing cmd: /etc/init.d/ohasd deinstall

2021-05-20 21:17:55: Removing file /etc/init.d/ohasd

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/init.d/ohasd

2021-05-20 21:17:55: Executing cmd: /bin/netstat -a -A unix

2021-05-20 21:17:55: Remove /var/tmp/.oracle

2021-05-20 21:17:55: Removed /var/tmp/.oracle

2021-05-20 21:17:55: /var/tmp/.oracle has been deleted successfully

2021-05-20 21:17:55: Executing cmd: /bin/netstat -a -A unix

2021-05-20 21:17:55: Remove /tmp/.oracle

2021-05-20 21:17:55: Remove /etc/oracle/lastgasp

2021-05-20 21:17:55: Removing file /etc/oracle/ocr.loc.orig

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/oracle/ocr.loc.orig

2021-05-20 21:17:55: Removing file /etc/oracle/olr.loc.orig

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/oracle/olr.loc.orig

2021-05-20 21:17:55: Reset OCR

2021-05-20 21:17:55: Removing OLR file: /u01/app/oracle/crsdata/rac1/olr/rac1_19.olr

2021-05-20 21:17:55: Removing file /u01/app/oracle/crsdata/rac1/olr/rac1_19.olr

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /u01/app/oracle/crsdata/rac1/olr/rac1_19.olr

2021-05-20 21:17:55: Removing file /etc/oracle/olr.loc

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/oracle/olr.loc

2021-05-20 21:17:55: Retrieving OCR main disk location

2021-05-20 21:17:55: Opening file /etc/oracle/ocr.loc

2021-05-20 21:17:55: Value (+VOTE/rac-cluster/OCRFILE/registry.255.1063642547) is set for key=ocrconfig_loc

2021-05-20 21:17:55: Retrieving OCR mirror disk location

2021-05-20 21:17:55: Opening file /etc/oracle/ocr.loc

2021-05-20 21:17:55: Value () is set for key=ocrmirrorconfig_loc

2021-05-20 21:17:55: Retrieving OCR loc3 disk location

2021-05-20 21:17:55: Opening file /etc/oracle/ocr.loc

2021-05-20 21:17:55: Value () is set for key=ocrconfig_loc3

2021-05-20 21:17:55: Retrieving OCR loc4 disk location

2021-05-20 21:17:55: Opening file /etc/oracle/ocr.loc

2021-05-20 21:17:55: Value () is set for key=ocrconfig_loc4

2021-05-20 21:17:55: Retrieving OCR loc5 disk location

2021-05-20 21:17:55: Opening file /etc/oracle/ocr.loc

2021-05-20 21:17:55: Value () is set for key=ocrconfig_loc5

2021-05-20 21:17:55: Removing file /etc/oracle/ocr.loc

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /etc/oracle/ocr.loc

2021-05-20 21:17:55: Removing the local checkpoint file /u01/app/oracle/crsdata/rac1/crsconfig/ckptGridHA_rac1.xml

2021-05-20 21:17:55: Removing file /u01/app/oracle/crsdata/rac1/crsconfig/ckptGridHA_rac1.xml

2021-05-20 21:17:55:

2021-05-20 21:17:55: Successfully removed file: /u01/app/oracle/crsdata/rac1/crsconfig/ckptGridHA_rac1.xml

2021-05-20 21:17:55: Removing the local checkpoint index file /u01/app/oracle/rac1/checkpoints/crsconfig/index.xml

2021-05-20 21:17:55: Removing the global checkpoint file /u01/app/oracle/crsdata/@global/crsconfig/ckptGridHA_global.xml

2021-05-20 21:17:55: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -rmfile /u01/app/oracle/crsdata/@global/crsconfig/ckptGridHA_global.xml rac1,rac2"

2021-05-20 21:17:55: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/cluutil3.log

2021-05-20 21:17:55: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil3.log

2021-05-20 21:17:55: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil3.log

2021-05-20 21:17:55: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -rmfile /u01/app/oracle/crsdata/@global/crsconfig/ckptGridHA_global.xml rac1,rac2

2021-05-20 21:17:56: Removing file /tmp/oKIEOtcoqW

2021-05-20 21:17:56:

2021-05-20 21:17:56: Successfully removed file: /tmp/oKIEOtcoqW

2021-05-20 21:17:56: pipe exit code: 0

2021-05-20 21:17:56: /bin/su successfully executed

 

2021-05-20 21:17:56:

2021-05-20 21:17:56: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil3.log

2021-05-20 21:17:56: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil3.log

2021-05-20 21:17:56:  "-rmfile /u01/app/oracle/crsdata/@global/crsconfig/ckptGridHA_global.xml rac1,rac2" succeeded with status 0.

2021-05-20 21:17:56: Removing the global checkpoint index file /u01/app/oracle/crsdata/@global/crsconfig/index.xml

2021-05-20 21:17:56: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -rmfile /u01/app/oracle/crsdata/@global/crsconfig/index.xml rac1,rac2"

2021-05-20 21:17:56: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/cluutil4.log

2021-05-20 21:17:56: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil4.log

2021-05-20 21:17:56: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil4.log

2021-05-20 21:17:56: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -rmfile /u01/app/oracle/crsdata/@global/crsconfig/index.xml rac1,rac2

2021-05-20 21:17:56: Removing file /tmp/oAkHS1Kd42

2021-05-20 21:17:56:

2021-05-20 21:17:56: Successfully removed file: /tmp/oAkHS1Kd42

2021-05-20 21:17:56: pipe exit code: 0

2021-05-20 21:17:56: /bin/su successfully executed

 

2021-05-20 21:17:56:

2021-05-20 21:17:56: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil4.log

2021-05-20 21:17:56: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil4.log

2021-05-20 21:17:56:  "-rmfile /u01/app/oracle/crsdata/@global/crsconfig/index.xml rac1,rac2" succeeded with status 0.

2021-05-20 21:17:56: Removing the 'crsgenconfig_params' file /u01/app/19.3.0.0/grid/crs/install/crsgenconfig_params

2021-05-20 21:17:56: Invoking "/u01/app/19.3.0.0/grid/bin/cluutil -rmfile /u01/app/19.3.0.0/grid/crs/install/crsgenconfig_params rac1,rac2"

2021-05-20 21:17:56: trace file=/u01/app/oracle/crsdata/rac1/crsconfig/cluutil5.log

2021-05-20 21:17:56: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil5.log

2021-05-20 21:17:56: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil5.log

2021-05-20 21:17:56: Running as user oracle: /u01/app/19.3.0.0/grid/bin/cluutil -rmfile /u01/app/19.3.0.0/grid/crs/install/crsgenconfig_params rac1,rac2

2021-05-20 21:17:57: Removing file /tmp/OIHzVIJt7h

2021-05-20 21:17:57:

2021-05-20 21:17:57: Successfully removed file: /tmp/OIHzVIJt7h

2021-05-20 21:17:57: pipe exit code: 0

2021-05-20 21:17:57: /bin/su successfully executed

 

2021-05-20 21:17:57:

2021-05-20 21:17:57: Setting owner (oracle:1000) and group (dba:1001) on file /u01/app/oracle/crsdata/rac1/crsconfig/cluutil5.log

2021-05-20 21:17:57: Setting permissions (0640) on file/dir /u01/app/oracle/crsdata/rac1/crsconfig/cluutil5.log

2021-05-20 21:17:57:  "-rmfile /u01/app/19.3.0.0/grid/crs/install/crsgenconfig_params rac1,rac2" succeeded with status 0.

2021-05-20 21:17:57: removing cvuqdisk rpm

2021-05-20 21:17:57: Executing /bin/rpm -e --allmatches cvuqdisk

2021-05-20 21:17:57: Executing cmd: /bin/rpm -e --allmatches cvuqdisk

2021-05-20 21:17:57: Successfully deconfigured Oracle Clusterware stack on this node

2021-05-20 21:17:57: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 336

2021-05-20 21:17:57: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 336

2021-05-20 21:17:57: Command output:

>  CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node

>End Command output

2021-05-20 21:17:57: CLSRSC-336: Successfully deconfigured Oracle Clusterware stack on this node

2021-05-20 21:17:57: ###### Begin Error Stack Trace ######

2021-05-20 21:17:57:     Package         File                 Line Calling  

2021-05-20 21:17:57:     --------------- -------------------- ---- ----------

2021-05-20 21:17:57:  1: crsdeconfig     crsdeconfig.pm        358 crsutils::print_error

2021-05-20 21:17:57:  2: crsdeconfig     crsdeconfig.pm        311 crsdeconfig::CRSDeconfig

2021-05-20 21:17:57:  3: main            rootcrs.pl            370 crsdeconfig::new

2021-05-20 21:17:57: ####### End Error Stack Trace #######

 

2021-05-20 21:17:57: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 559 '/u01/app/19.3.0.0/grid'

2021-05-20 21:17:57: Executing cmd: /u01/app/19.3.0.0/grid/bin/clsecho -p has -f clsrsc -m 559 '/u01/app/19.3.0.0/grid'

2021-05-20 21:17:57: Command output:

>  CLSRSC-559: Ensure that the GPnP profile data under the 'gpnp' directory in /u01/app/19.3.0.0/grid is deleted on each node before using the software in the current Grid Infrastructure home for reconfiguration.

>End Command output

2021-05-20 21:17:57: CLSRSC-559: Ensure that the GPnP profile data under the 'gpnp' directory in /u01/app/19.3.0.0/grid is deleted on each node before using the software in the current Grid Infrastructure home for reconfiguration.

2021-05-20 21:17:57: deinstall or deconfig cleanup completed successfully

 

5.  Deconfig 후 root.sh 재실행하여 CRS 재구성

 

1) 1번 노드

[root@rac1 grid]# ./root.sh

Performing root user operation.

 

The following environment variables are set as:

    ORACLE_OWNER= oracle

    ORACLE_HOME=  /u01/app/19.3.0.0/grid

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The contents of "oraenv" have not changed. No need to overwrite.

The contents of "coraenv" have not changed. No need to overwrite.

 

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Relinking oracle with rac_on option

Using configuration parameter file: /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

  /u01/app/oracle/crsdata/rac1/crsconfig/rootcrs_rac1_2021-05-20_09-21-54PM.log

2021/05/20 21:22:01 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.

2021/05/20 21:22:01 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.

2021/05/20 21:22:01 CLSRSC-363: User ignored prerequisites during installation

2021/05/20 21:22:01 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.

2021/05/20 21:22:02 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.

2021/05/20 21:22:03 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.

2021/05/20 21:22:04 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.

Redirecting to /bin/systemctl restart rsyslog.service

2021/05/20 21:22:04 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.

2021/05/20 21:22:05 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.

2021/05/20 21:22:17 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.

2021/05/20 21:22:21 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.

2021/05/20 21:22:34 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.

2021/05/20 21:22:34 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.

2021/05/20 21:22:39 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.

2021/05/20 21:22:40 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'

2021/05/20 21:23:15 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.

2021/05/20 21:23:15 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.

2021/05/20 21:23:54 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.

2021/05/20 21:23:59 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.

 

ASM has been created and started successfully.

 

[DBT-30022] Disk group VOTE mounted successfully.

 

2021/05/20 21:25:23 CLSRSC-482: Running command: '/u01/app/19.3.0.0/grid/bin/ocrconfig -upgrade oracle dba'

CRS-4256: Updating the profile

Successful addition of voting disk 1111841de7cb4f7cbf660ea69cff7495.

Successful addition of voting disk 725808b1511e4f30bf395741a921a12d.

Successful addition of voting disk 86a3d7b3ec194f77bf3443887afa1fa6.

Successfully replaced voting disk group with +VOTE.

CRS-4256: Updating the profile

CRS-4266: Voting file(s) successfully replaced

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

 1. ONLINE   1111841de7cb4f7cbf660ea69cff7495 (/dev/sdd1) [VOTE]

 2. ONLINE   725808b1511e4f30bf395741a921a12d (/dev/sde1) [VOTE]

 3. ONLINE   86a3d7b3ec194f77bf3443887afa1fa6 (/dev/sdf1) [VOTE]

Located 3 voting disk(s).

2021/05/20 21:26:33 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.

2021/05/20 21:27:40 CLSRSC-343: Successfully started Oracle Clusterware stack

2021/05/20 21:27:40 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.

2021/05/20 21:28:59 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.

2021/05/20 21:29:24 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

 

2) 2번 노드

 

[root@rac2 grid]# ./root.sh

Performing root user operation.

 

The following environment variables are set as:

    ORACLE_OWNER= oracle

    ORACLE_HOME=  /u01/app/19.3.0.0/grid

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The contents of "oraenv" have not changed. No need to overwrite.

The contents of "coraenv" have not changed. No need to overwrite.

 

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Relinking oracle with rac_on option

Using configuration parameter file: /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

  /u01/app/oracle/crsdata/rac2/crsconfig/rootcrs_rac2_2021-05-20_09-30-32PM.log

2021/05/20 21:30:36 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.

2021/05/20 21:30:36 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.

2021/05/20 21:30:36 CLSRSC-363: User ignored prerequisites during installation

2021/05/20 21:30:36 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.

2021/05/20 21:30:38 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.

2021/05/20 21:30:38 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.

2021/05/20 21:30:39 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.

Redirecting to /bin/systemctl restart rsyslog.service

2021/05/20 21:30:39 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.

2021/05/20 21:30:40 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.

2021/05/20 21:30:41 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.

2021/05/20 21:30:41 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.

2021/05/20 21:30:49 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.

2021/05/20 21:30:49 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.

2021/05/20 21:30:50 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.

2021/05/20 21:30:50 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'

2021/05/20 21:31:22 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.

2021/05/20 21:31:22 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.

2021/05/20 21:32:01 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.

2021/05/20 21:32:02 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.

2021/05/20 21:32:13 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.

2021/05/20 21:33:10 CLSRSC-343: Successfully started Oracle Clusterware stack

2021/05/20 21:33:10 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.

2021/05/20 21:33:35 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.

2021/05/20 21:33:45 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

 

6. 구성완료 후 crs 상태를 보면 당연히 DATA, RECO 디스크 그룹이 없음.

[TEST1]oracle@rac1:/home/oracle# crsctl stat res -t

--------------------------------------------------------------------------------

Name           Target  State        Server                   State details      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.chad

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.net1.network

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.ons

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.proxy_advm

               OFFLINE OFFLINE      rac1                     STABLE

               OFFLINE OFFLINE      rac2                     STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac1                     STABLE

ora.VOTE.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.asm(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     Started,STABLE

      2        ONLINE  ONLINE       rac2                     Started,STABLE

ora.asmnet1.asmnetwork(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.cvu

      1        ONLINE  ONLINE       rac1                     STABLE

ora.qosmserver

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac2.vip

      1        ONLINE  ONLINE       rac2                     STABLE

ora.scan1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

--------------------------------------------------------------------------------

 

- asmcmd 에는 VOTE 만 보임.

 

[+ASM1]oracle@rac1:/home/oracle# asmcmd -p

ASMCMD [+] > lsdg

State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name

MOUNTED  NORMAL  N         512             512   4096  4194304      6132     5184             2044            1570              0             Y  VOTE/

 

7. ASM 접속해서 diskgroup mount 시킴

 

- 1번 노드 mount

[+ASM1]oracle@rac1:/home/oracle# sa

 SQL*Plus: Release 19.0.0.0.0 - Production on Thu May 20 21:40:19 2021

Version 19.10.0.0.0

Copyright (c) 1982, 2020, Oracle.  All rights reserved.

 

Connected to:

Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Version 19.10.0.0.0

 

SQL> alter diskgroup DATA mount;

Diskgroup altered.

 

SQL> alter diskgroup RECO mount;

Diskgroup altered.

 

- 2번 노드 mount

SQL>  alter diskgroup DATA mount;

Diskgroup altered.

 

SQL>  alter diskgroup RECO mount;

Diskgroup altered.

 

8. Diskgroup (DATA, RECO) 정상 Mount 됨을 확인

[root@rac1 ~]# crsctl stat res -t

--------------------------------------------------------------------------------

Name           Target  State        Server                   State details      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.chad

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.net1.network

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.ons

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.proxy_advm

               OFFLINE OFFLINE      rac1                     STABLE

               OFFLINE OFFLINE      rac2                     STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.DATA.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac1                     STABLE

ora.RECO.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.VOTE.dg(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.asm(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     Started,STABLE

      2        ONLINE  ONLINE       rac2                     Started,STABLE

ora.asmnet1.asmnetwork(ora.asmgroup)

      1        ONLINE  ONLINE       rac1                     STABLE

      2        ONLINE  ONLINE       rac2                     STABLE

ora.cvu

      1        ONLINE  ONLINE       rac1                     STABLE

ora.qosmserver

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac2.vip

      1        ONLINE  ONLINE       rac2                     STABLE

ora.scan1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

--------------------------------------------------------------------------------

 

9. Database 를 등록시키고 Start 함

[TEST1]oracle@rac1:/home/oracle# srvctl add database -d TEST -o /u01/app/oracle/product/19.3.0.0/dbhome_1

[TEST1]oracle@rac1:/home/oracle# srvctl add instance -d TEST -i TEST1 -n rac1

[TEST1]oracle@rac1:/home/oracle# srvctl add instance -d TEST -i TEST2 -n rac2

[TEST1]oracle@rac1:/home/oracle# srvctl start database -d TEST

 

10. 등록된 Database 상태 확인

ora.test.db

      1        ONLINE  ONLINE       rac1          Open,HOME=/u01/app/o

                                                             racle/product/19.3.0

                                                             .0/dbhome_1,STABLE

      2        ONLINE  ONLINE       rac2          Open,HOME=/u01/app/o

                                                             racle/product/19.3.0

                                                             .0/dbhome_1,STABLE

 

 - Deconfig 전 생성했던 tablespace 및 datafile 확인 가능.

                                                            

TABLESPACE_NAME      FILE_NAME                                           TOT_KB      FREE_KB USAGE_P

-------------------- --------------------------------------------- ------------ ------------ -------

SYSAUX               +DATA/TEST/DATAFILE/sysaux.261.1063728379          563,200      196,352    65.1

SYSTEM               +DATA/TEST/DATAFILE/system.260.1063728377          716,800      220,416    69.3

TEST                   +DATA/TEST/test01.dbf                                           102,400      101,376     1.0

UNDOTBS1          +DATA/TEST/DATAFILE/undotbs1.262.1063728379        337,920      231,296    31.6

UNDOTBS2          +DATA/TEST/DATAFILE/undotbs2.264.1063728385        204,800      193,088     5.7

USERS                 +DATA/TEST/DATAFILE/users.265.1063728385             5,120        4,096    20.0

 

테스트 끝!!

 

 

 

 

 

 

 

 

 

 

Posted by pat98

11-27 00:38
Flag Counter
Yesterday
Today
Total

글 보관함

최근에 올라온 글

달력

 « |  » 2024.11
1 2
3 4 5 6 7 8 9
10 11 12 13 14 15 16
17 18 19 20 21 22 23
24 25 26 27 28 29 30

최근에 달린 댓글