12.1.0.2 ocssd.bin high CPU usage in clsdadr_bucketThread thread

(Doc ID 2235698.1)

Last updated on SEPTEMBER 19, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.2 and later
Information in this document applies to any platform.

Symptoms

12.1.0.2 Grid Infrastructure, ocssd.bin is using high CPU:

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6735 grid RT 0 2713m 209m 87m S 100.9 0.1 657:51.07 ocssd.bin

 

Thread level CPU usage show's the high CPU is caused by clsdadr_bucketThread thread:

#5 0x00007f0b76feb0bc in clsdadr_process_bucket () from /u01/app/12.1.0.2/grid/lib/libhasgen12.so
#6 0x00007f0b76feac23 in clsdadr_bucketThread () from /u01/app/12.1.0.2/grid/lib/libhasgen12.so

 

During the incident period, same trace is being repeatedly dumped in ocssd.trc over and over again:

2017-01-26 15:20:52.200153 : CSSD:1319745280: clssgmpcMemberDataUpdt: grockName HB+ASM memberID 9:2:2, datatype 1 datasize 4
2017-01-26 15:20:52.200877 : CSSD:1313695488: clssgmcpDataUpdtCmpl: Status 0 mbr data updt memberID 9:2:2 from clientID 2:34:4
2017-01-26 15:20:53.607343 : CSSD:1316849408: clssgmMbrDataUpdt: Processing member data change type 1, size 401 for group GR+DB_+ASM, memberID 37:2:1
2017-01-26 15:20:53.607358 : CSSD:1316849408: clssgmMbrDataUpdt: Sending member data change to GMP for group GR+DB_+ASM, memberID 37:2:1
====>>>> went back and repeating
2017-01-26 14:52:20.851467 : CSSD:1316849408: clssgmMbrDataUpdt: Sending member data change to GMP for group HB+ASM, memberID 9:2:2
2017-01-26 14:52:20.851875 : CSSD:1319745280: clssgmpcMemberDataUpdt: grockName HB+ASM memberID 9:2:2, datatype 1 datasize 4
2017-01-26 14:52:20.852639 : CSSD:1313695488: clssgmcpDataUpdtCmpl: Status 0 mbr data updt memberID 9:2:2 from clientID 2:34:4
2017-01-26 14:52:22.904710 : CSSD:1316849408: clssgmMbrDataUpdt: Processing member data change type 1, size 4 for group HB+ASM, memberID 9:2:2
2017-01-26 14:52:22.904724 : CSSD:1316849408: clssgmMbrDataUpdt: Sending member data change to GMP for group HB+ASM, memberID 9:2:2
....
2017-01-26 15:20:52.200153 : CSSD:1319745280: clssgmpcMemberDataUpdt: grockName HB+ASM memberID 9:2:2, datatype 1 datasize 4
2017-01-26 15:20:52.200877 : CSSD:1313695488: clssgmcpDataUpdtCmpl: Status 0 mbr data updt memberID 9:2:2 from clientID 2:34:4
2017-01-26 15:20:53.607343 : CSSD:1316849408: clssgmMbrDataUpdt: Processing member data change type 1, size 401 for group GR+DB_+ASM, memberID 37:2:1
2017-01-26 15:20:53.607358 : CSSD:1316849408: clssgmMbrDataUpdt: Sending member data change to GMP for group GR+DB_+ASM, memberID 37:2:1
2017-01-26 15:20:53.607840 : CSSD:1319745280: clssgmpcMemberDataUpdt: grockName GR+DB_+ASM memberID 37:2:1, datatype 1 datasize 401
====>>>> went back again...
2017-01-26 14:52:20.851467 : CSSD:1316849408: clssgmMbrDataUpdt: Sending member data change to GMP for group HB+ASM, memberID 9:2:2
2017-01-26 14:52:20.851875 : CSSD:1319745280: clssgmpcMemberDataUpdt: grockName HB+ASM memberID 9:2:2, datatype 1 datasize 4
2017-01-26 14:52:20.852639 : CSSD:1313695488: clssgmcpDataUpdtCmpl: Status 0 mbr data updt memberID 9:2:2 from clientID 2:34:4
2017-01-26 14:52:22.904710 : CSSD:1316849408: clssgmMbrDataUpdt: Processing member data change type 1, size 4 for group HB+ASM, memberID 9:2:2
2017-01-26 14:52:22.904724 : CSSD:1316849408: clssgmMbrDataUpdt: Sending member data change to GMP for group HB+ASM, memberID 9:2:2

 

Available trace files shows the same log entry was dumped 601 times

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms