My Oracle Support Banner

Customised udev rule changes default Device-Mapper Multipath devices' name which fails OVS joining into pool with error: <type 'exceptions.OSError'>:[Errno 2] No such file or directory (Doc ID 2142482.1)

Last updated on AUGUST 04, 2018

Applies to:

Oracle VM - Version 3.3.1 and later
Information in this document applies to any platform.

Symptoms

When try to join an OVS into existing pool, encounter below error:

OVMAPI_4010E Attempt to send command: configure_server_for_cluster to server: ovs-3 failed. OVMAPI_4004E Sync command failed on server: 10.165.10.201. Command: configure_server_for_cluster, Server error: org.apache.xmlrpc.XmlRpcException: <type 'exceptions.OSError'>:[Errno 2] No such file or directory [Tue May 17 23:50:41 EDT 2016] [Tue May 17 23:50:41 EDT 2016]

 

From the ovs-agent log on this OVS:

[2016-05-17 23:51:43 8322] DEBUG (service:75) call start: join_server_pool('Culpeper', '0004fb0000020000d1c11860b8b36bcc', '10.165.10.50', 3, 'ovs-3', '10.165.10.201', 'utility,xen')
[2016-05-17 23:51:43 8322] DEBUG (service:77) call complete: join_server_pool
[2016-05-17 23:51:45 8323] DEBUG (service:75) call start: configure_server_for_cluster({'O2CB_HEARTBEAT_THRESHOLD': '61', 'O2CB_RECONNECT_DELAY_MS': '2000', 'O2CB_KEEPALIVE_DELAY_MS': '2000', 'O2CB_BOOTCLUSTER': 'd1c11860b8b36bcc', 'O2CB_IDLE_TIMEOUT_MS': '60000', 'O2CB_ENABLED': 'true', 'O2CB_STACK': 'o2cb'}, {'node': [{'ip_port': 7777, 'cluster': 'd1c11860b8b36bcc', 'ip_address': '10.165.10.218', 'name': 'ovs-1', 'number': 1}, {'ip_port': 7777, 'cluster': 'd1c11860b8b36bcc', 'ip_address': '10.165.10.200', 'name': 'ovs-0', 'number': 0}, {'ip_port': 7777, 'cluster': 'd1c11860b8b36bcc', 'ip_address': '10.165.10.212', 'name': 'ovs-2', 'number': 2}, {'ip_port': 7777, 'cluster': 'd1c11860b8b36bcc', 'ip_address': '10.165.10.201', 'name': 'ovs-3', 'number': 3}], 'heartbeat': [{'cluster': 'd1c11860b8b36bcc', 'region': '0004FB0000050000C168ACAB223624C5'}], 'cluster': [{'heartbeat_mode': 'global', 'node_count': 4, 'name': 'd1c11860b8b36bcc'}]}, 'lun', '/dev/mapper/36006048c3ee43935cd276e0015d97c46', '0004fb0000050000c168acab223624c5', '')
[2016-05-17 23:51:45 8323] ERROR (service:97) catch_error: [Errno 2] No such file or directory
Traceback (most recent call last):
File "/usr/lib64/python2.6/site-packages/agent/lib/service.py", line 95, in wrapper
return func(*args)
File "/usr/lib64/python2.6/site-packages/agent/api/cluster/o2cb.py", line 103, in configure_server_for_cluster
contents = ocfs2_file_read(poolfs_target, POOLFS_META)
File "/usr/lib64/python2.6/site-packages/agent/lib/ocfs2.py", line 402, in ocfs2_file_read
fs = OVSOCFS2Extension.open(device)
OSError: [Errno 2] No such file or directory
[2016-05-17 23:51:48 8324] DEBUG (service:75) call start: leave_server_pool('0004fb0000020000d1c11860b8b36bcc',)
[2016-05-17 23:51:48 8324] DEBUG (service:77) call complete: leave_server_pool

 

From pool member ovs-1, poolfs is on /dev/mapper/36006048c3ee43935cd276e0015d97c46:

# mount | grep poolfs
/dev/mapper/36006048c3ee43935cd276e0015d97c46 on /poolfsmnt/0004fb0000050000c168acab223624c5 type ocfs2 (rw,_netdev,heartbeat=global) [OVS_POOL_FILESYSTEM]

 

The LUN /dev/mapper/36006048c3ee43935cd276e0015d97c46 actually exists on ovs-3:

# multipath_-v4_-ll | grep -A4 36006048c3ee43935cd276e0015d97c46
36006048c3ee43935cd276e0015d97c46 dm-1 EMC,Celerra
size=40G features='0' hwhandler='0' wp=rw
'-+- policy='round-robin 0' prio=1 status=active
'- 8:0:0:5 sdm 8:192 active ready running
May 18 00:06:16 | wwid 36006048c3ee43935cd276e0015d97c46 already in wwids file
May 18 00:06:16 | params = 0 0 1 1 round-robin 0 1 1 8:240 1
May 18 00:06:16 | status = 2 0 0 0 1 1 A 0 1 0 8:240 A 0
May 18 00:06:16 | *word = 0, len = 1
May 18 00:06:16 | *word = 0, len = 1

 

However cannot find the File System on the Device-Mapper Multipath device:

# blkid | grep -i pool
/dev/sdm: LABEL="OVS_POOL_FILESYSTEM" UUID="0004fb00-0005-0000-c168-acab223624c5" TYPE="ocfs2"

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.