AIX: 11.2.0.3 GI node reboot due to osysmond.bin process (Doc ID 1488838.1)

Last updated on SEPTEMBER 05, 2012

Applies to:

Oracle Server - Enterprise Edition - Version 11.2.0.3 and later
IBM AIX on POWER Systems (64-bit)

Symptoms

11.2.0.3 Grid Infrastructure on AIX experiences node reboot due to osysmond.bin process.

Based on AIX kernel dump analysis, when the kernel allocate socket or file handle for osysmond.bin, AIX LFS(Logical File system) detected that the file pointer invalid due to corrupt or overwrite. This is causing AIX to assert to prevent corruption of the per processor file table free list.

Below is the call stack generated in core file:

(14)> f
pvthread+097000 STACK:
[005A698C]fpget+00034C (F1000A0010CFE100, 0000000000000000,
F1000A0010CFE100 [??])
[005A7D54]fpalloc+000054 (??, ??, ??, ??, ??)
[004C7074]socksetup+000134 (??, ??)
[004E2BEC]socketpair+00058C (??, ??, ??, ??)
[00003850]ovlya_addr_sc_flih_main+000130 ()
[kdb_get_virtual_memory] no real storage 111388A60
[9000000016C6160]09000000016C6160 ()
[kdb_read_mem] no real storage FFFFFFFFFFF9570

(14)>
(14)> dr iar
iar : 00000000005A698C
.fpget+00034C tweqi r0,0 r0=0

pvthread+097000 2416*osysmond RUN 170018D 000 14 0

(14)> ppid
SLOT NAME STATE PID PPID ADSPACE CL #THS

pvproc+227000 2204*osysmond ACTIVE 09C0226 0000001 0000000A20223510 0 000E

NAME....... osysmond.bin
STATE...... stat :07 .... xstat :0000
FLAGS...... flag :00200001 LOAD EXECED
........... flag2 :02000001 64BIT INHERITED
........... flag3 :00000102 NOSWAP FIXPRI
........... atomic :00040000 ORPHANPGRP
........... secflag:0001 ROOT

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms