Oracle VM: OVM Manager showing VMs' status as "Stopped" although VMs are running (Doc ID 2514324.1)

Last updated on DECEMBER 28, 2023

Applies to:

Symptoms

On one of  the Oracle  VM server , all the VMs' state are shown as "stopped" in Oracle VM Manager console.

[1]  VMs are up and running and xm list on Oracle VM Server also shows that VMs are up.  Start a VM on Oracle VM Manager UI, get following error below:

OVMRU_005007E Virtual Machine: XXX, cannot be started/resumed on Server: <HOSTNAME>. Reasons: - The cluster on Server: <HOSTNAME>, is DOWN. [Tue Mar 05 13:30:19 MYT 2019]

[2] ovs-agent log /var/log/ovs-agent.log on Oracle VM server shows error below:

16986 [2019-03-02 06:46:17 5127] ERROR (monitor:45) Error in monitor process: Lock file /etc/ovs-agent/db/server failed: timeout occurred.
16987 Traceback (most recent call last):
16988   File "/usr/lib64/python2.6/site-packages/agent/daemon/monitor.py", line 31, in serve_forever
16989     saved_cluster_state = read_item(LOCAL_SERVER_DB, "cluster_state")
16990   File "/usr/lib64/python2.6/site-packages/agent/lib/db.py", line 90, in read_item
16991     db = AgentDB(db_name, db_home)
16992   File "/usr/lib64/python2.6/site-packages/agent/lib/db.py", line 45, in __init__
16993     self.lock.acquire(wait=10, delay=0.1)
16994   File "/usr/lib64/python2.6/site-packages/agent/lib/filelock.py", line 58, in acquire
16995     self.filename)
16996 LockError: Lock file /etc/ovs-agent/db/server failed: timeout occurred.
16997 [2019-03-02 06:47:58 10497] ERROR (xmlrpc:133) Unauthorized access attempt from ('10.71.2.223', 59258)!
16998 Traceback (most recent call last):
16999   File "/usr/lib64/python2.6/site-packages/agent/daemon/xmlrpc.py", line 130, in do_POST
17000     auth_ip(src_ip)
17001   File "/usr/lib64/python2.6/site-packages/agent/daemon/xmlrpc.py", line 103, in auth_ip
17002     if ip != "127.0.0.1" and ip not in get_pool_member_ip_list():
17003   File "/usr/lib64/python2.6/site-packages/agent/lib/settings.py", line 128, in get_pool_member_ip_list
17004     state = get_membership_state()
17005   File "/usr/lib64/python2.6/site-packages/agent/lib/settings.py", line 106, in get_membership_state
17006     if get_cluster_flag():
17007   File "/usr/lib64/python2.6/site-packages/agent/lib/settings.py", line 79, in get_cluster_flag
17008     return read_item(LOCAL_SERVER_DB, "clustered")
17009   File "/usr/lib64/python2.6/site-packages/agent/lib/db.py", line 90, in read_item
17010     db = AgentDB(db_name, db_home)
17011   File "/usr/lib64/python2.6/site-packages/agent/lib/db.py", line 45, in __init__
17012     self.lock.acquire(wait=10, delay=0.1)
17013   File "/usr/lib64/python2.6/site-packages/agent/lib/filelock.py", line 58, in acquire
17014     self.filename)
17015 LockError: Lock file /etc/ovs-agent/db/server failed: timeout occurred.

Changes

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.