RAC One Node:Can't relocate DB when using 'srvctl relocate db'
(Doc ID 2697542.1)
Last updated on SEPTEMBER 30, 2021
Applies to:
Oracle Database - Enterprise Edition - Version 19.0.0.0 and laterInformation in this document applies to any platform.
Symptoms
When using "srvctl relocate database" to relocate 19c CDB with a PDB in RAC One Node, the shutdown of the instance was stalled for 11 minutes due to the mount lock being held by the process shutting down the PDB.
[2020-07-02 15:38:36.009] [oracle@<hostname>1]$ srvctl relocate database -db <db_name> -node <hostname>2
[2020-07-02 15:50:46.039] [oracle@<hostname>1]$
[2020-07-02 15:50:46.039] [oracle@<hostname>1]$
And following message appears in DB alert log.
2020-07-02T15:38:45.177097+09:00
Shutting down ORACLE instance (immediate) (OS id: xxxx)
2020-07-02T15:38:45.190234+09:00
Shutdown is initiated by oraagent.bin@<hostname>1.<domain_name> (TNS V1.
2020-07-02T15:38:47.737402+09:00
Stopping background process SMCO
2020-07-02T15:38:48.761868+09:00
Shutting down instance: further logons disabled
2020-07-02T15:38:48.788793+09:00
Stopping background process CJQ0
Stopping background process MMNL
2020-07-02T15:38:48.903998+09:00
Process termination requested for pid xxxxx [source = rdbms], [info = 2] [request issued by pid: xxxx, uid: xxxx]
2020-07-02T15:38:49.904080+09:00
Stopping background process MMON
2020-07-02T15:38:51.955583+09:00
alter pluggable database all close immediate
2020-07-02T15:38:51.996620+09:00
PDB1(3):JIT: pid xxxx requesting stop
2020-07-02T15:50:14.305775+09:00
sculkget: failed to lock /u01/app/oracle/product/19.0.0/dbhome_1/dbs/lkinstorcl exclusive
sculkget: lock held by PID: xxxx <==== lock held by the process of shutting down the DB
Oracle Instance Shutdown operation failed. Another process may be attempting to startup or shutdown this Instance.
Failed to acquire instance startup/shutdown serialization primitive
2020-07-02T15:50:16.337076+09:00
License high water mark = 11
2020-07-02T15:50:16.337446+09:00
USER(xxx) (ospid: xxxxxx): terminating the instance
2020-07-02T15:50:17.401703+09:00
Instance terminated by USER(xxx), pid = xxxxxx
Shutting down ORACLE instance (immediate) (OS id: xxxx)
2020-07-02T15:38:45.190234+09:00
Shutdown is initiated by oraagent.bin@<hostname>1.<domain_name> (TNS V1.
2020-07-02T15:38:47.737402+09:00
Stopping background process SMCO
2020-07-02T15:38:48.761868+09:00
Shutting down instance: further logons disabled
2020-07-02T15:38:48.788793+09:00
Stopping background process CJQ0
Stopping background process MMNL
2020-07-02T15:38:48.903998+09:00
Process termination requested for pid xxxxx [source = rdbms], [info = 2] [request issued by pid: xxxx, uid: xxxx]
2020-07-02T15:38:49.904080+09:00
Stopping background process MMON
2020-07-02T15:38:51.955583+09:00
alter pluggable database all close immediate
2020-07-02T15:38:51.996620+09:00
PDB1(3):JIT: pid xxxx requesting stop
2020-07-02T15:50:14.305775+09:00
sculkget: failed to lock /u01/app/oracle/product/19.0.0/dbhome_1/dbs/lkinstorcl exclusive
sculkget: lock held by PID: xxxx <==== lock held by the process of shutting down the DB
Oracle Instance Shutdown operation failed. Another process may be attempting to startup or shutdown this Instance.
Failed to acquire instance startup/shutdown serialization primitive
2020-07-02T15:50:16.337076+09:00
License high water mark = 11
2020-07-02T15:50:16.337446+09:00
USER(xxx) (ospid: xxxxxx): terminating the instance
2020-07-02T15:50:17.401703+09:00
Instance terminated by USER(xxx), pid = xxxxxx
The attribution "RELOCATE_KIND" of the DB service shows 'ONLINE'.
[oracle@<hostname>1]$ crsctl stat res <service name> -p | grep RELOCATE_KIND
RELOCATE_KIND=online
RELOCATE_KIND=online
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |