Can't Connect After Node Reboots
(Doc ID 2627181.1)
Last updated on DECEMBER 02, 2022
Applies to:
Oracle Database Cloud Service - Version N/A to N/A [Release 1.0]Information in this document applies to any platform.
Symptoms
Unable to connect to one of the OCI DBaaS node using ssh
The DB BM instance is not coming up since server is panic at the boot process, issue happens only when we try to patch the DB server from APRIL PSU to JULY PSU or OCT PSU.
We can see the issue is happening with the below CALL TRACE from boot log enabled with ssh -vvv option from serial console connection.
Starting jexec servicesStarting ohasd:
CRS-4123: Oracle High Availability Services has been started.
[ 202.920332] oracleoks: module license 'Proprietary' taints kernel.
[ 202.994117] Disabling lock debugging due to kernel taint
[ 203.064266] OKSK-00028: In memory kernel log buffer address: 0xffff88bccffd87c0, size: 10485760
[ 203.173050] OKSK-00027: Oracle kernel distributed lock manager hash size is 2000000
[ 203.281903] OKSK-00004: Module load succeeded. Build information: (LOW DEBUG) USM_18.7.0.0.0ACFSRU_LINUX.X64_190614 2019/06/14 06:44:34
[ 204.953403] ADVMK-0001: Module load succeeded. Build information: (LOW DEBUG) - USM_18.7.0.0.0ACFSRU_LINUX.X64_190614 built on 2019/06/14 07:16:37.
[ 205.112999] asmInit: rval=0 mode=0 asm_request_based=1
[ 207.059669] ACFSK-0037: Module load succeeded. Build information: (LOW DEBUG) USM_18.7.0.0.0ACFSRU_LINUX.X64_190614 2019/06/14 08:07:48
Oracle Linux Server release 6.10
Kernel 4.1.12-124.24.5.el6uek.x86_64 on an x86_64
proddbsystem1 login: [ 233.676454] smpboot: CPU 19 is now offline
[ 233.743237] CPU 13 offline: Remove Rx thread
[ 233.814700] smpboot: CPU 71 is now offline
[ 233.885005] CPU 47 offline: Remove Rx thread
[ 233.956967] Broke affinity for irq 235
[ 234.003049] smpboot: CPU 20 is now offline
[ 234.072337] CPU 14 offline: Remove Rx thread
[ 234.136354] Broke affinity for irq 144
[ 234.181291] Broke affinity for irq 279
[ 234.227316] smpboot: CPU 72 is now offline
[ 234.370455] CPU 48 offline: Remove Rx thread
[ 234.449375] smpboot: CPU 21 is now offline
[ 234.520832] CPU 15 offline: Remove Rx thread
[ 234.590397] Broke affinity for irq 120
[ 234.635190] Broke affinity for irq 151
[ 234.681408] smpboot: CPU 73 is now offline
[ 234.756680] CPU 49 offline: Remove Rx thread
[ 234.837888] Broke affinity for irq 148
[ 234.882726] Broke affinity for irq 206
[ 234.927526] Broke affinity for irq 244
[ 234.973609] smpboot: CPU 22 is now offline
[ 235.041209] CPU 16 offline: Remove Rx thread
[ 235.116128] Broke affinity for irq 163
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |