My Oracle Support Banner

Can't Connect After Node Reboots (Doc ID 2627181.1)

Last updated on JANUARY 23, 2020

Applies to:

Oracle Database Cloud Service - Version N/A to N/A [Release 1.0]
Information in this document applies to any platform.

Symptoms

Unable to connect to one of the OCI DBaaS node using ssh

The DB  BM instance is not coming up since server is panic at the boot process, issue happens only when we try to patch the DB server from APRIL PSU to JULY PSU or OCT PSU.

We can see the issue is happening with the below  CALL TRACE from boot log enabled with ssh -vvv option from serial console connection.


Starting jexec servicesStarting ohasd:

CRS-4123: Oracle High Availability Services has been started.
[  202.920332] oracleoks: module license 'Proprietary' taints kernel.
[  202.994117] Disabling lock debugging due to kernel taint
[  203.064266] OKSK-00028: In memory kernel log buffer address: 0xffff88bccffd87c0, size: 10485760
[  203.173050] OKSK-00027: Oracle kernel distributed lock manager hash size is 2000000
[  203.281903] OKSK-00004: Module load succeeded. Build information:   (LOW DEBUG) USM_18.7.0.0.0ACFSRU_LINUX.X64_190614 2019/06/14 06:44:34
[  204.953403] ADVMK-0001: Module load succeeded. Build information:  (LOW DEBUG) - USM_18.7.0.0.0ACFSRU_LINUX.X64_190614 built on 2019/06/14 07:16:37.
[  205.112999] asmInit: rval=0 mode=0 asm_request_based=1
[  207.059669] ACFSK-0037: Module load succeeded. Build information:   (LOW DEBUG) USM_18.7.0.0.0ACFSRU_LINUX.X64_190614 2019/06/14 08:07:48

Oracle Linux Server release 6.10
Kernel 4.1.12-124.24.5.el6uek.x86_64 on an x86_64

proddbsystem1 login: [  233.676454] smpboot: CPU 19 is now offline
[  233.743237] CPU 13 offline: Remove Rx thread
[  233.814700] smpboot: CPU 71 is now offline
[  233.885005] CPU 47 offline: Remove Rx thread
[  233.956967] Broke affinity for irq 235
[  234.003049] smpboot: CPU 20 is now offline
[  234.072337] CPU 14 offline: Remove Rx thread
[  234.136354] Broke affinity for irq 144
[  234.181291] Broke affinity for irq 279
[  234.227316] smpboot: CPU 72 is now offline
[  234.370455] CPU 48 offline: Remove Rx thread
[  234.449375] smpboot: CPU 21 is now offline
[  234.520832] CPU 15 offline: Remove Rx thread
[  234.590397] Broke affinity for irq 120
[  234.635190] Broke affinity for irq 151
[  234.681408] smpboot: CPU 73 is now offline
[  234.756680] CPU 49 offline: Remove Rx thread
[  234.837888] Broke affinity for irq 148
[  234.882726] Broke affinity for irq 206
[  234.927526] Broke affinity for irq 244
[  234.973609] smpboot: CPU 22 is now offline
[  235.041209] CPU 16 offline: Remove Rx thread
[  235.116128] Broke affinity for irq 163

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Changes
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.