[ PCA ] Provisioning or Re-Provisioning a Compute Node Fails with "ERROR (nodestateserver:615) Error while retrieving the MAC address for server: x ILOM: x

Last updated on JANUARY 11, 2018

Applies to:

Symptoms

 On Oracle Private Cloud Appliance, when provisioning or re-provisioning a compute node, the reprovision fails at stage initializing_stage_dhcp and prints these errors in loop :

[2017-12-21 17:36:44 9728] DEBUG (nodestateserver:593) set_dhcp_info: mac=00:10:e0:d8:c2:bb, nodeinfo={'name': '', 'ip': '192.168.4.190', 'state': 'initializing_stage_d
hcp', 'link': '', 'type': '', 'loop': None}
[2017-12-21 17:36:44 9728] DEBUG (opus:253) Looking for mac: 00:10:e0:d8:c2:bb
[2017-12-21 17:36:45 9728] DEBUG (opus:108) Looking for mac: 00:10:e0:d8:c2:bb on opus 192.168.4.200
[2017-12-21 17:36:45 9728] DEBUG (opus:112) MAC address table: # show mac-address-table address 00:10:e0:d8:c2:bb

Vlan Mac Address Type Ports
---- ----------- ---- -----
1 00:10:e0:d8:c2:bb Learnt Ex0/3

Total Mac Addresses displayed: 1

^Movcasw21ar1
[2017-12-21 17:36:45 9728] DEBUG (opus:263) returned port=3
[2017-12-21 17:36:45 9728] DEBUG (opus:276) mac: 00:10:e0:d8:c2:bb found on opus switch: OPUS-1 port: 3.
[2017-12-21 17:36:46 9728] WARNING (nodestateserver:606) Connecting to 00:10:e0:d8:c2:bb as ILOM Session
[2017-12-21 17:36:56 9728] ERROR (nodestateserver:615) Error while retrieving the MAC address for server: 192.168.4.6. ILOM: 192.168.4.190.
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/ovca/daemon/nodestateserver.py", line 611, in set_dhcp_info
host_mac = ilom_session.get_HOST_MAC()
File "/usr/lib/python2.6/site-packages/ovca/ilom.py", line 306, in get_HOST_MAC
return self.__getIlomProperty('/System', 'host_primary_mac_address')
File "/usr/lib/python2.6/site-packages/ovca/ilom.py", line 43, in __getIlomProperty
tgtProperty = self.sendCommand(cmd)
File "/usr/lib/python2.6/site-packages/ovca/session.py", line 135, in sendCommand
self.spawnId.sendline(cmd)
File "/usr/lib/python2.6/site-packages/pexpect.py", line 961, in sendline
n = self.send(s)
File "/usr/lib/python2.6/site-packages/pexpect.py", line 953, in send
c = os.write(self.child_fd, s)
OSError: [Errno 9] Bad file descriptor
[2017-12-21 17:36:56 9728] ERROR (nodestateserver:828) Error handling compute node 00:10:e0:d8:c2:bb.
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/ovca/daemon/nodestateserver.py", line 825, in main_thread
if handle_one_ilom_node(k, v):
File "/usr/lib/python2.6/site-packages/ovca/daemon/nodestateserver.py", line 1494, in handle_one_ilom_node
if func(mac, nodeinfo):
File "/usr/lib/python2.6/site-packages/ovca/daemon/nodestateserver.py", line 616, in set_dhcp_info
raise err
OSError: [Errno 9] Bad file descriptor

Changes

 Change of the password used for the ILOMs of the compute nodes to a non-default one.

Cause