11gR2 Grid Infrastructure Fails to Start on Second Node with Error "Policy Engine is not initialized yet!"

(Doc ID 985588.1)

Last updated on AUGUST 24, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 11.2.0.1 and later
Generic UNIX
Generic Linux

Symptoms

11gR2 Grid Infrastructure comes up fine on first node, but fails on other nodes:


Check crs output on other node:


$GRID_HOME/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
..

$GRID_HOME/log/$HOST/crsd/crsd.log on first node:


2010-05-11 19:21:27.782: [ COMMCRS][1149888832]clsc_answer: (0xcd79780) Error on conn 0xda04f30

2010-05-11 19:21:27.782: [ COMMCRS][1149888832]Error info: ns op 65 rsn=12546, rsn2=12560, transport (516, 0, 0)

2010-05-11 19:21:27.782: [ COMMCRS][1149888832]clsc_event_hndlr: (0xcd79780) answer error, rc 15

$GRID_HOME/log/$HOST/crsd/crsd.log on other node:


2010-05-11 19:21:27.742: [  OCRSRV][4291867120]th_init: Failure in smwait. Waiting to be signalled by Master elector thread.
2010-05-11 19:21:27.781: [  OCRSRV][1267460416]th_not_master_change: Master change callback not registered
2010-05-11 19:21:27.782: [  OCRMAS][1267460416]proath_connect_master:1: could not connect to master  clsc_ret1 = 11, clsc_ret2 = 11
2010-05-11 19:21:27.782: [  OCRMAS][1267460416]th_master:11: Could not connect to the new master
2010-05-11 19:21:57.375: [ CRSMAIN][1110112576] Policy Engine is not initialized yet!
2010-05-11 19:22:27.378: [ CRSMAIN][1110112576] Policy Engine is not initialized yet!
2010-05-11 19:22:57.389: [ CRSMAIN][1110112576] Policy Engine is not initialized yet!

$GRID_HOME/log/$HOST/ohasd/ohasd.log on first node:


2010-05-11 19:20:20.894: [  CRSCCL][1410537792]Trying to establish connection with nodeid 845: (ADDRESS=(PROTOCOL=tcp)(HOST=XX.XXX.XX.XXX)(PORT=59836)).
2010-05-11 19:20:20.894: [  CRSCCL][1410537792]WFCC peer(845, 1273617492), con state = 4
2010-05-11 19:20:20.894: [ COMMCRS][1389558080]clsc_send_msg: (0x2aaab026eb20) NS err (12541, 12541), transport (0, 0, 0)
..
2010-05-11 19:21:33.694: [  CRSCCL][1410537792]Trying to establish connection with nodeid 294: (ADDRESS=(PROTOCOL=tcp)(HOST=XX.XXX.XX.2)(PORT=60975)).
2010-05-11 19:21:33.694: [  CRSCCL][1410537792]WFCC peer(294, 1273620050), con state = 4
2010-05-11 19:21:33.694: [  CRSCCL][1410537792]Failed waiting for connection to complete con = 0x2aaab0275750, clsc err: 11
2010-05-11 19:21:33.694: [  CRSCCL][1410537792]WFCC: Failed connecting to peer(294, 1273620050). err=2
2010-05-11 19:21:33.694: [  CRSCCL][1410537792]Disconnecting connection to member 294 node node2.
2010-05-11 19:21:33.694: [  CRSCCL][1410537792]clsdisc con = 0x2aaab0275750.
2010-05-11 19:21:33.695: [  CRSCCL][1410537792]_S: No connection to node: 294. Retrying msgid = 0.
..
2010-05-11 19:22:37.575: [ COMMCRS][1389558080]Error info: ns op 65 rsn=12546, rsn2=12560, transport (516, 0, 0)

2010-05-11 19:22:37.576: [ COMMCRS][1389558080]clsc_event_hndlr: (0x2aaab00314b0) answer error, rc 15

2010-05-11 19:22:38.577: [ COMMCRS][1389558080]clsc_answer: (0x2aaab00314b0) Error on conn 0x178b1180

$GRID_HOME/log/$HOST/ohasd/ohasd.log on other node:


2010-05-11 19:22:18.536: [  CRSCCL][1406527808]Trying to establish connection with nodeid 660: (ADDRESS=(PROTOCOL=tcp)(HOST=XX.XXX.XX.XXX)(PORT=17221)).
2010-05-11 19:22:18.537: [  CRSCCL][1406527808]WFCC peer(660, 1273617369), con state = 4
2010-05-11 19:22:18.537: [  CRSCCL][1406527808]Failed waiting for connection to complete con = 0x8b5a310, clsc err: 11
2010-05-11 19:22:18.537: [  CRSCCL][1406527808]WFCC: Failed connecting to peer(660, 1273617369). err=2
2010-05-11 19:22:18.537: [  CRSCCL][1406527808]Disconnecting connection to member 660 node node1.
2010-05-11 19:22:18.537: [  CRSCCL][1406527808]clsdisc con = 0x8b5a310.
2010-05-11 19:22:18.537: [  CRSCCL][1406527808]_S: No connection to node: 660. Retrying msgid = 0.

2010-05-11 19:22:18.787: [ COMMCRS][1385548096]clsc_answer: (0x2aaaac177540) Error on conn 0x8b5a310

2010-05-11 19:22:18.787: [ COMMCRS][1385548096]Error info: ns op 65 rsn=12546, rsn2=12560, transport (516, 0, 0)

2010-05-11 19:22:18.787: [ COMMCRS][1385548096]clsc_event_hndlr: (0x2aaaac177540) answer error, rc 15

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms