My Oracle Support Banner

ODA: CRS Could Not Start on Second ODA Node Due to Invalid ASM Credentials for The "crsuser__asm_001" Clusterware User (Doc ID 2139591.1)

Last updated on AUGUST 04, 2018

Applies to:

Oracle Database Appliance Software - Version 2.1.0.1 to 12.1.2.6 [Release 2.1 to 12.1]
Oracle Database - Enterprise Edition - Version 11.2.0.1 to 12.1.0.2 [Release 11.2 to 12.1]
Information in this document applies to any platform.

Symptoms

1) CRS (clusterware) could not start on the second ODA node due to the next errors (as reported in the clusterware alert.log):

.
.
.
2016-05-17 16:25:28.420 [OCTSSD(15491)]CRS-2401: The Cluster Time Synchronization Service started on host asmcloud2.
2016-05-17 16:25:28.454 [OCTSSD(15491)]CRS-2409: The clock on host asmcloud2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
2016-05-17 16:25:42.360 [ORAROOTAGENT(14660)]CRS-5019: All OCR locations are on ASM disk groups [RECO], and none of these disk groups are mounted. Details are at "(:CLSN00140:)" in "/u01/app/grid/diag/crs/asmcloud2/crs/trace/ohasd_orarootagent_root.trc".
.
.
.

 

2) "ohasd_orarootagent_root.trc" reports that the ASM credentials are not present:

.
.
.
2016-05-17 16:34:05.131647*:kgfn.c@5281: kgfnGetBeqData: kgfnTgtInit failed, inst=NULL flags=0x6000
2016-05-17 16:34:05.147179 : CLSNS:368556352: clsns_SetTraceLevel:trace level set to 1.
2016-05-17 16:34:05.167937 : GPNP:368556352: clsgpnp_dbmsGetItem_profile: [at clsgpnp_dbms.c:345] Result: (0) CLSGPNP_OK. (:GPNP00401:)got ASM-Profile.Mode='remote'
2016-05-17 16:34:05.169362 : default:368556352: Inited LSF context: 0x7fb5102e23c0
2016-05-17 16:34:05.170801 : CLSCRED:368556352: clsCredCommonInit: Inited singleton credctx.
2016-05-17 16:34:05.170808 : CLSCRED:368556352: (:CLSCRED0101:)clsCredDomInitRootDom: Using user given storage context for repository access.
2016-05-17 16:34:05.199781 : USRTHRD:368556352: {0:9:3} 6425 Error 4 querying length of attr ASM_DISCOVERY_ADDRESS

2016-05-17 16:34:05.205101 : USRTHRD:368556352: {0:9:3} 6425 Error 4 querying length of attr ASM_STATIC_DISCOVERY_ADDRESS

2016-05-17 16:34:05.251694 : CLSCRED:368556352: (:CLSCRED1079:)clsCredOcrKeyExists: Obj dom : SYSTEM.credentials.domains.root.ASM.Self.af16666db1decf60bfda990c1a2fee1d.root not found
2016-05-17 16:34:05.251777 : USRTHRD:368556352: {0:9:3} 6210 Error 4 opening dom root in 0x7fb51026f530

2016-05-17 16:34:05.251777*:kgfn.c@6356: kgfnGetNodeType: flags=0x10
2016-05-17 16:34:05.251777*:kgfn.c@6369: kgfnGetNodeType: ntyp=1
2016-05-17 16:34:05.251777*:kgfn.c@4644: kgfnConnect2: kgfnGetBeqData failed
2016-05-17 16:34:05.251777*:kgfn.c@4680: kgfnConnect: srvr valid
2016-05-17 16:34:05.251777*:kgfn.c@5972: kgfnConnect2Int: sysasm=0 envflags=0x10 srvrflags=0x1 unam=crsuser__asm_001 password is NOT NULL pstr=_ocr
2016-05-17 16:34:05.251777*:kgfn.c@6121: kgfnConnect2Int: hosts=1
2016-05-17 16:34:05.251777*:kgfn.c@6134: kgfnConnect2Int: cstr=(DESCRIPTION=(TRANSPORT_CONNECT_TIMEOUT=60)(EXPIRE_TIME=1)(LOAD_BALANCE=ON)(ADDRESS_LIST=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.16.24)(PORT=1522)))(CONNECT_DATA=(SERVICE_NAME=+ASM)))
2016-05-17 16:34:05.251777*:kgfn.c@6200: kgfnConnect2Int: OCISessionBegin failed
2016-05-17 16:34:05.251777*:kgfn.c@1602: kgfnRecordErrPriv: status=-1 at kgfn.c:6284
2016-05-17 16:34:05.251777*:kgfn.c@1648: kgfnRecordErrPriv: 1017 error=ORA-01017: invalid username/password; logon denied
.
.
.

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.