Oracle Virtual Desktop Infrastructure MySQL DB: Missed Heartbeat And Node Disconnect (Doc ID 1507190.1)

Last updated on MAY 02, 2017

Applies to:

Oracle Virtual Desktop Infrastructure - Version 3.2.2 to 3.2.2 [Release 3.0]
Information in this document applies to any platform.

Symptoms

In a mutli-node Oracle Virtual Desktop Infrastructure (VDI) / MySQL DB cluster, one would see following ALERT messages indicating missed Heartbeat and Node disconnect in 'ndb_*_cluster.log' files (by default found in: /var/opt/SUNWvda/mysql-cluster):

2012-10-03 21:59:51 [MgmtSrvr] ALERT -- Node 1: Node 3 Disconnected
2012-10-03 21:59:52 [MgmtSrvr] WARNING -- Node 2: Node 3 missed heartbeat 4
2012-10-03 21:59:52 [MgmtSrvr] ALERT -- Node 2: Node 3 declared dead due to missed heartbeat
2012-10-03 21:59:52 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 closed
2012-10-03 21:59:52 [MgmtSrvr] ALERT -- Node 2: Network partitioning - arbitration required
2012-10-03 21:59:52 [MgmtSrvr] INFO -- Node 2: President restarts arbitration thread [state=7]
2012-10-03 21:59:52 [MgmtSrvr] ALERT -- Node 2: Arbitration won - positive reply from node 1
2012-10-03 21:59:52 [MgmtSrvr] ALERT -- Node 2: Node 3 Disconnected
2012-10-03 21:59:52 [MgmtSrvr] INFO -- Node 2: Started arbitrator node 1 [ticket=43a6000458d5ed91]
2012-10-03 21:59:53 [MgmtSrvr] ALERT -- Node 3: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.
2012-10-03 22:00:01 [MgmtSrvr] INFO -- Mgmt server state: nodeid 3 reserved for ip 10.20.30.142, m_reserved_nodes 00000000000000000000000000000000000000000000000000000000000000fa.
2012-10-03 22:00:01 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 opened
2012-10-03 22:00:02 [MgmtSrvr] INFO -- Node 1: Node 3 Connected
2012-10-03 22:00:03 [MgmtSrvr] INFO -- Node 2: Node 3 Connected

2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Mgmt server state: nodeid 3 freed, m_reserved_nodes 00000000000000000000000000000000000000000000000000000000000000f2.
2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Node 2: Node 3: API mysql-5.1.37 ndb-7.0.8
2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Node 3: Node 2 Connected
2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Node 3: CM_REGCONF president = 2, own Node = 3, our dynamic id = 4
2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Node 3: Node 2: API mysql-5.1.37 ndb-7.0.8
2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Node 3: Start phase 1 completed
2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Node 3: Receive arbitrator node 1 [ticket=43a6000458d5ed91]
2012-10-03 22:00:03 [MgmtSrvr] INFO     -- Node 3: Start phase 2 completed (node restart)
2012-10-03 22:00:04 [MgmtSrvr] INFO     -- Node 2: DICT: locked by node 3 for NodeRestart
2012-10-03 22:00:04 [MgmtSrvr] INFO     -- Node 3: Start phase 3 completed (node restart)
2012-10-03 22:00:04 [MgmtSrvr] INFO     -- Node 3: Start phase 4 completed (node restart)
2012-10-03 22:00:20 [MgmtSrvr] INFO     -- Node 3: Starting to restore schema
2012-10-03 22:00:36 [MgmtSrvr] INFO     -- Node 3: Restore of schema complete

  

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms