RAC database Instance failed to started with error "kjxgm_pngreq_SubmitMap: failed to start oraping"
(Doc ID 2659175.1)
Last updated on APRIL 17, 2023
Applies to:
Oracle Database - Enterprise Edition - Version 12.2.0.1 and laterInformation in this document applies to any platform.
Symptoms
RAC DB instance failed to start
<DB_NAME>2_lmon_24773.trc
=================================
*** 2020-04-05T17:30:45.115019+05:30
IPCLW:[0.0]{E}[WAIT]:PROTO: [1586088045114901]ACNH 0x7f16569b8ab0: 2 attempts to connect, timeout in CTIME IN PAST!
*** 2020-04-05T17:30:46.470506+05:30
=====================================================
kjxgmpoll: CGS state (0 1) start 0x5e89c869 cur 0x5e89c86e rcfgtm 5 sec
kjxgmpngin: could not start oraping: error: 4 (2 skgping_read, , errno: 11)
kjxgm_pngreq_SubmitMap: failed to start oraping
kjxgm_osnetcheck: failed to submit oraping job, err: 0x4
*** 2020-04-05T17:30:51.138926+05:30
IPCLW:[0.1]{E}[WAIT]:PROTO: [1586088051138853]ACNH 0x7f16569b8ab0: 4 attempts to connect, timeout in CTIME IN PAST!
*** 2020-04-05T17:30:51.490173+05:30
=====================================================
kjxgmpoll: CGS state (0 1) start 0x5e89c869 cur 0x5e89c873 rcfgtm 10 sec
===================
Db instance alert
==============
diagnostic_dest = "<ORACLE_BASE>"
2020-04-05T17:30:40.157443+05:30
Cluster Communication is configured to use IPs from: GPnP
IP: 169.xxx.9.7 Subnet: 169.xxx.0.0
IP: 169.xxx.26.118 Subnet: 169.xxx.16.0
KSIPC Loopback IP addresses(OSD):
127.0.0.1
KSIPC Available Transports: UDP:TCP
KSIPC: Client: KCL Transport: UDP
..
PXMN started with pid=54, OS id=24838
Starting background process RBAL
2020-04-05T17:30:41.960369+05:30
RBAL started with pid=57, OS id=24842
Starting background process ASMB
Starting background process FENC
2020-04-05T17:30:41.971032+05:30
ASMB started with pid=58, OS id=24844
2020-04-05T17:30:41.982983+05:30
FENC started with pid=59, OS id=24846
Starting background process MMON
2020-04-05T17:30:41.993802+05:30
MMON started with pid=60, OS id=24848
Starting background process MMNL
2020-04-05T17:30:42.005464+05:30
MMNL started with pid=61, OS id=24852
2020-04-05T17:30:42.007099+05:30
NOTE: ASMB (index:0) registering with ASM instance as Flex client 0xffffffffffffffff (reg:3483887017) (startid:1036949439) (new connection)
2020-04-05T17:30:42.047443+05:30
My CSS node number is 2
My CSS hostname is srdcb1898wmsdb
lmon registered with NM - instance number 2 (internal mem no 1)
2020-04-05T17:30:44.549916+05:30
Using default pga_aggregate_limit of 25000 MB
2020-04-05T17:31:52.414678+05:30
PMON (ospid: 24726): terminating the instance due to ORA error 481
2020-04-05T17:31:52.414826+05:30
Cause - 'Instance is being terminated due to fatal process death (pid: 22, ospid: 24773, LMON)'
2020-04-05T17:31:52.440128+05:30
System state dump requested by (instance=2, osid=24726 (PMON)), summary=[abnormal instance termination]. error - 'Instance is terminating.
'
System State dumped to trace file <ORACLE_BASE>/diag/rdbms/<DB_NAME>/<DB_NAME>2/trace/<DB_NAME>2_diag_24754.trc
2020-04-05T17:31:52.804634+05:30
Dumping diagnostic data in directory=[cdmp_20200405173152], requested by (instance=2, osid=24726 (PMON)), summary=[abnormal instance termination].
2020-04-05T17:31:53.922568+05:30
Instance terminated by PMON, pid = 24726
2020-04-05T19:04:06.617645+05:30
Starting ORACLE instance (normal) (OS id: 43260)
2020-04-05T19:04:06.857422+05:30
****************************************************
Sys-V shared memory will be used for creating SGA
****************************************************
2020-04-05T19:04:06.858159+05:30
**********************************************************************
2020-04-05T19:04:06.858209+05:30
Dump of system resources acquired for SHARED GLOBAL AREA (SGA)
======================
=================================
*** 2020-04-05T17:30:45.115019+05:30
IPCLW:[0.0]{E}[WAIT]:PROTO: [1586088045114901]ACNH 0x7f16569b8ab0: 2 attempts to connect, timeout in CTIME IN PAST!
*** 2020-04-05T17:30:46.470506+05:30
=====================================================
kjxgmpoll: CGS state (0 1) start 0x5e89c869 cur 0x5e89c86e rcfgtm 5 sec
kjxgmpngin: could not start oraping: error: 4 (2 skgping_read, , errno: 11)
kjxgm_pngreq_SubmitMap: failed to start oraping
kjxgm_osnetcheck: failed to submit oraping job, err: 0x4
*** 2020-04-05T17:30:51.138926+05:30
IPCLW:[0.1]{E}[WAIT]:PROTO: [1586088051138853]ACNH 0x7f16569b8ab0: 4 attempts to connect, timeout in CTIME IN PAST!
*** 2020-04-05T17:30:51.490173+05:30
=====================================================
kjxgmpoll: CGS state (0 1) start 0x5e89c869 cur 0x5e89c873 rcfgtm 10 sec
===================
Db instance alert
==============
diagnostic_dest = "<ORACLE_BASE>"
2020-04-05T17:30:40.157443+05:30
Cluster Communication is configured to use IPs from: GPnP
IP: 169.xxx.9.7 Subnet: 169.xxx.0.0
IP: 169.xxx.26.118 Subnet: 169.xxx.16.0
KSIPC Loopback IP addresses(OSD):
127.0.0.1
KSIPC Available Transports: UDP:TCP
KSIPC: Client: KCL Transport: UDP
..
PXMN started with pid=54, OS id=24838
Starting background process RBAL
2020-04-05T17:30:41.960369+05:30
RBAL started with pid=57, OS id=24842
Starting background process ASMB
Starting background process FENC
2020-04-05T17:30:41.971032+05:30
ASMB started with pid=58, OS id=24844
2020-04-05T17:30:41.982983+05:30
FENC started with pid=59, OS id=24846
Starting background process MMON
2020-04-05T17:30:41.993802+05:30
MMON started with pid=60, OS id=24848
Starting background process MMNL
2020-04-05T17:30:42.005464+05:30
MMNL started with pid=61, OS id=24852
2020-04-05T17:30:42.007099+05:30
NOTE: ASMB (index:0) registering with ASM instance as Flex client 0xffffffffffffffff (reg:3483887017) (startid:1036949439) (new connection)
2020-04-05T17:30:42.047443+05:30
My CSS node number is 2
My CSS hostname is srdcb1898wmsdb
lmon registered with NM - instance number 2 (internal mem no 1)
2020-04-05T17:30:44.549916+05:30
Using default pga_aggregate_limit of 25000 MB
2020-04-05T17:31:52.414678+05:30
PMON (ospid: 24726): terminating the instance due to ORA error 481
2020-04-05T17:31:52.414826+05:30
Cause - 'Instance is being terminated due to fatal process death (pid: 22, ospid: 24773, LMON)'
2020-04-05T17:31:52.440128+05:30
System state dump requested by (instance=2, osid=24726 (PMON)), summary=[abnormal instance termination]. error - 'Instance is terminating.
'
System State dumped to trace file <ORACLE_BASE>/diag/rdbms/<DB_NAME>/<DB_NAME>2/trace/<DB_NAME>2_diag_24754.trc
2020-04-05T17:31:52.804634+05:30
Dumping diagnostic data in directory=[cdmp_20200405173152], requested by (instance=2, osid=24726 (PMON)), summary=[abnormal instance termination].
2020-04-05T17:31:53.922568+05:30
Instance terminated by PMON, pid = 24726
2020-04-05T19:04:06.617645+05:30
Starting ORACLE instance (normal) (OS id: 43260)
2020-04-05T19:04:06.857422+05:30
****************************************************
Sys-V shared memory will be used for creating SGA
****************************************************
2020-04-05T19:04:06.858159+05:30
**********************************************************************
2020-04-05T19:04:06.858209+05:30
Dump of system resources acquired for SHARED GLOBAL AREA (SGA)
======================
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Changes |
Cause |
Solution |
References |