My Oracle Support Banner

Siebel Application & Srvrmgr fails when one of the leader node is down in 3 node gateway clustering (Doc ID 2683839.1)

Last updated on JUNE 29, 2020

Applies to:

Siebel CRM - Version 19.9 and later
Information in this document applies to any platform.

Symptoms

3 node gateway cluster is implemented with Siebel 19.9 and also applied POC for Bug 30060726 - APPLICATION CAN FAIL TO LOAD IF ONE OF THE ZOOKEEPER ENSEMBLE NODES IS DOWN is fixed in 19.11 update.

 Siebel application login and srvrmgr connectivity was fine till services went down on crmcgw1 and rmcgw2. But facing server busy error and unable to connect srvrmgr once the gateway services down in crmcbi1 which is leader node.

[siebel@crmcgw1]/globalsiebgw/siebelgw/# echo mntr|nc localhost 9111|grep zk_server_state
zk_server_state follower

[siebel@crmcgw2]/siebelgwc/siebel/gtwysrvr# echo mntr|nc localhost 9111|grep zk_server_state
zk_server_state follower

[siebel@crmcbi1]/siebelgwc/siebel/# echo mntr|nc localhost 9111|grep zk_server_state
zk_server_state leader

server.1=crmcbi1:9112:9113
server.2=crmgw1:9112:9113
server.3=crmgw2:9112:9113

Siebel application login and srvrmgr connectivity was fine till services went down on crmcgw1 and rmcgw2 and if any of the node acts as leader node. 
But if the leader node changed to no. 1 and this node is brought down, ideally the remaining 2 servers - 2 & 3 - should have provided high availability and kept the application up, but it did not. 


STEPS
-----------------------
The issue can be reproduced at will with the following steps:
1. Install Siebel 19.x
2. Install 3 node cluster & deploy
3. If one of node brought down, application access & srvrmgr failing

zk_client.log

2020-04-11 07:43:43,642 [myid:] - ERROR [https-jsse-nio-9011-exec-5-EventThread:ClientCnxn$EventThread@532] - Error while calling watcher
java.lang.NullPointerException
at java.lang.String.<init>(String.java:554)
at com.siebel.opcgw.cloudgateway.ServerDataWatch.process(ServerDataWatch.java:50)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

2020-04-11 07:43:48,024 [myid:] - ERROR [https-jsse-nio-9011-exec-5-EventThread:ClientCnxn$EventThread@532] - Error while calling watcher
java.lang.NullPointerException
at java.lang.String.<init>(String.java:554)
at com.siebel.opcgw.cloudgateway.ServerDataWatch.process(ServerDataWatch.java:50)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Changes
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.