High OCSSD CPU Usage/ ERROR: unrecoverable error ORA-29701 raised in ASM I/O path; terminating process {nnnnn}
(Doc ID 1491852.1)
Last updated on JULY 30, 2023
Applies to:
Oracle Database - Enterprise Edition - Version 11.2.0.1 and laterOracle Database Cloud Schema Service - Version N/A and later
Oracle Database Exadata Express Cloud Service - Version N/A and later
Oracle Database Exadata Cloud Machine - Version N/A and later
Oracle Cloud Infrastructure - Database Service - Version N/A and later
Information in this document applies to any platform.
Symptoms
11gR2 Grid Infrastructure environment, error ORA-29701 reported in ASM or databases(including pre-11.2 databases)
- ASM/database alert.log
ERROR: unrecoverable error ORA-29701 raised in ASM I/O path; terminating process nnnnn
OR
ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process nnnnn
- ASM/database trace file
2012-07-12 14:59:23.784: [ CSSCLNT]clssscConnect: gipcWait failed with 16 (12)
2012-07-12 14:59:23.795: [ CSSCLNT]clsssInitNative: connect to (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ssm0115_)) failed, rc 16
kgxgncin: CLSS init failed with status 3
kgxgncin: return status 3 (1311719766 SKGXN not av) from CLSS
NOTE: kfmsInit: ASM failed to initialize group services
Error ORA-29701 signaled at ksedsts()+960<-kgepop()+480<-ksesecl0()+68<-kfmsInit()+228<-kfmsSlvReg()+456<-kfmdSlvOpPriv()+7780<-kfmdWriteSubmitted()+780<-kfk_process_an_ioq()+236<-kfk_submit_io()+44<-kfk_io1()+916<-kfk_transitIO()+2496<-kffPreFormat2()+804<-_$c1A.kffPreFormat()+216<-kffFdAddImap()+3572<-kffFdAddMap()+784<-kffFileResize()+8992<-kffFileCreate()+7264<-kffCreate()+1924<-kfnsFileCreate()+1716<-kfnDispatch()+1580<-opiodr()+1164<-ttcpip()+916<-opitsk()+1640<-opiino()+924<-opiodr()+1164<-opidrv()+1032<-sou2o()+88<-opimai_real()+504<-ssthrdmain()+316<-main()+316<-_start()+380
ERROR: unrecoverable error ORA-29701 raised in ASM I/O path; terminating process 20757
----- Abridged Call Stack Trace -----
ksedsts()+1296<-kfk_io1()+2976<-kfk_transitIO()+2496<-kffPreFormat2()+804<-_$c1A.kffPreFormat()+216<-kffFdAddImap()+3572<-kffFdAddMap()+784<-kffFileResize()+8992<-kffFileCreate()+7264<-kffCreate()+1924<-kfnsFileCreate()+1716<-kfnDispatch()+1580<-opiodr()+1164
<-ttcpip()+916<-opitsk()+1640<-opiino()+924<-opiodr()+1164<-opidrv()+1032<-sou2o()+88<-opimai_real()+504<-ssthrdmain()+316<-main()+316<-_start()+380
----- End of Abridged Call Stack Trace -----
2012-07-12 14:59:23.795: [ CSSCLNT]clsssInitNative: connect to (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ssm0115_)) failed, rc 16
kgxgncin: CLSS init failed with status 3
kgxgncin: return status 3 (1311719766 SKGXN not av) from CLSS
NOTE: kfmsInit: ASM failed to initialize group services
Error ORA-29701 signaled at ksedsts()+960<-kgepop()+480<-ksesecl0()+68<-kfmsInit()+228<-kfmsSlvReg()+456<-kfmdSlvOpPriv()+7780<-kfmdWriteSubmitted()+780<-kfk_process_an_ioq()+236<-kfk_submit_io()+44<-kfk_io1()+916<-kfk_transitIO()+2496<-kffPreFormat2()+804<-_$c1A.kffPreFormat()+216<-kffFdAddImap()+3572<-kffFdAddMap()+784<-kffFileResize()+8992<-kffFileCreate()+7264<-kffCreate()+1924<-kfnsFileCreate()+1716<-kfnDispatch()+1580<-opiodr()+1164<-ttcpip()+916<-opitsk()+1640<-opiino()+924<-opiodr()+1164<-opidrv()+1032<-sou2o()+88<-opimai_real()+504<-ssthrdmain()+316<-main()+316<-_start()+380
ERROR: unrecoverable error ORA-29701 raised in ASM I/O path; terminating process 20757
----- Abridged Call Stack Trace -----
ksedsts()+1296<-kfk_io1()+2976<-kfk_transitIO()+2496<-kffPreFormat2()+804<-_$c1A.kffPreFormat()+216<-kffFdAddImap()+3572<-kffFdAddMap()+784<-kffFileResize()+8992<-kffFileCreate()+7264<-kffCreate()+1924<-kfnsFileCreate()+1716<-kfnDispatch()+1580<-opiodr()+1164
<-ttcpip()+916<-opitsk()+1640<-opiino()+924<-opiodr()+1164<-opidrv()+1032<-sou2o()+88<-opimai_real()+504<-ssthrdmain()+316<-main()+316<-_start()+380
----- End of Abridged Call Stack Trace -----
- $GRID_HOME/log/<node>/cssd/ocssd.log
2012-07-12 14:59:29.862: [GIPCXCPT][5] gipcmodClscCallback: async request failed req 10f8e43d0 [000000000da1c332] { gipcSendRequest : addr '', data 10ef6a9d0, len 48, olen 0, parentEndp 10de74f10, ret gipcretConnectionLost (12), objFlags 0x0, reqFlags 0x224 }, ret gipcretConnectionLost (12)
2012-07-12 14:59:29.863: [GIPCXCPT][5] gipcmodMuxTransferAccept: internal accept request failed endp 10028f650, child 10de74f10, ret gipcretConnectionInvalid (13)
2012-07-12 14:59:29.863: [ GIPCMUX][5] gipcmodMuxTransferAccept: EXCEPTION[ ret gipcretConnectionInvalid (13) ] error during accept on endp 10028f650
2012-07-12 14:59:29.863: [GIPCXCPT][5] gipcmodMuxTransferAccept: internal accept request failed endp 10028f650, child 10de74f10, ret gipcretConnectionInvalid (13)
2012-07-12 14:59:29.863: [ GIPCMUX][5] gipcmodMuxTransferAccept: EXCEPTION[ ret gipcretConnectionInvalid (13) ] error during accept on endp 10028f650
- High number of concurrent connections
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Cause |
Solution |
References |