My Oracle Support Banner

Exadata: System Crash or Hang Showing 100% CPU Utilization on Background Process: apx_vi00_+APX1 (Doc ID 2430498.1)

Last updated on AUGUST 15, 2018

Applies to:

Oracle Database Cloud Exadata Service - Version N/A and later
Oracle Database Exadata Express Cloud Service - Version N/A and later
Oracle Database Cloud Schema Service - Version N/A and later
Oracle Database Cloud Service - Version N/A and later
Oracle Database Backup Service - Version N/A and later
Linux x86-64
Information in this document applies to any platform.

Symptoms

Exadata system may crash or hang with 100% CPU utilization on background process apx_vi00_+

Exawatcher top logs (/opt/oracle.ExaWatcher/archive/Top.ExaWatcher) show that the apx_vi00_+APX1 shoot up to 100% CPU in few seconds and Node is hung after this occurrence. apx_vi00_+APX1 is Exadata specific background process for ACFS:

top - 04:02:15 up 1 day, 23:26, 1 user, load average: 4.14, 4.08, 3.68
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
348695 grid 20 0 1506m 70m 58m S 0.6 0.0 0:27.49 apx_vi00_+APX1 <<<<<<<<<< 0.6 % CPU

top - 04:02:31 up 1 day, 23:26, 1 user, load average: 5.68, 4.41, 3.79
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
348695 grid 20 0 1506m 70m 58m R 100.0 0.0 0:37.81 apx_vi00_+APX1 <<<<<<<<<< 100 % CPU

 

OS messages file (/var/log/messages) reports stalls on tasks:

Jul 19 04:03:22 kernel: [170838.041019] INFO: rcu_sched detected
stalls on CPUs/tasks: { 4} (detected by 15, t=60002 jiffies, g=29250404, 
c=29250403, q=0)
Jul 19 04:03:22  kernel: [170838.041035] Task dump for CPU 4:
Jul 19 04:03:22 1 kernel: [170838.041037] apx_vi00_+apx1 R running
task 0 348695 1 0x00000088
Jul 19 04:03:22 kernel: [170838.041040] 0000000000000286
ffff883372befa48 ffff883372befa08 ffffffff810f223b
Jul 19 04:03:22  kernel: [170838.041044] 0000000000000000
0000000000000286 ffff883372befac8 ffff883372befa48
Jul 19 04:03:22 kernel: [170838.041047] 0000000000000000

 

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.