Flooding of ovmd related Messages in Oracle Linux 6 and 7 VMs (Doc ID 2574769.1)

Last updated on SEPTEMBER 08, 2022

Applies to:

Symptoms

Huge number ovmd related messages causing queue size to increase and eventually causing ovmm to become unresponsive.

journalctl output in Oracle Linux 7 VM:
 
-- The start-up result is done.
 CROND[19989]: (root) CMD (run-parts /etc/cron.hourly)
<hostname> run-parts(/etc/cron.hourly)[19992]: starting 0anacron
<hostname> run-parts(/etc/cron.hourly)[19998]: finished 0anacron
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1

When checking ovmd status in Oracle Linux 7 VMs:
 
# service ovmd status
Redirecting to /bin/systemctl status ovmd.service
● ovmd.service - Oracle VM guest daemon
Loaded: loaded (/usr/lib/systemd/system/ovmd.service; enabled; vendor preset: enabled)
Active: active (running) since xxx xxxx-xx-xx xx:xx:xx UTC; x min ago
Process: 5888 ExecStart=/usr/sbin/ovmd $OVMD_ARGS (code=exited, status=0/SUCCESS)
Process: 5870 ExecStartPre=/usr/sbin/modprobe ovmapi (code=exited, status=0/SUCCESS)
Main PID: 5890 (ovmd)
CGroup: /system.slice/ovmd.service
└─5890 /usr/sbin/ovmd
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1
<hostname> ovmd[xxxx]: sendIPChangeInfoMessage: ERROR: SIOCGIFMTU returned err = -1

Ovs-agent log of OVM Server on which Linux 6 or 7 VMs are hosted showing warning:
 
WARNING (notificationserver:146) Event queue is full. Drop new event: {DOMAIN} 0004fb00-0006-0000-7a81-8f61e6xxxxxx {VMAPI} VMAPIEvent {"VMAPIEvent":{"severity":5,"subsystem":"ovmdSS","process":"ovmd","type":"system","payload":{"type":"IPChange","IPChange":{"intrface":"eth1286","mac":"<mac address>","ipv4info":{"ipinfo":[]},"ipv6info":{"ipinfo":[]}}}}} {}
WARNING (notificationserver:146) Event queue is full. Drop new event: {DOMAIN} 0004fb00-0006-0000-6cf7-85dfe4xxxxxx {VMAPI} VMAPIEvent {"VMAPIEvent":{"severity":5,"subsystem":"ovmdSS","process":"ovmd","type":"system","payload":{"type":"IPChange","IPChange":{"intrface":"eth646_","mac":"<mac address>","ipv4info":{"ipinfo":[]},"ipv6info":{"ipinfo":[]}}}}} {}
WARNING (notificationserver:146) Event queue is full. Drop new event: {DOMAIN} 0004fb00-0006-0000-6cf7-85dfe4xxxxxx {VMAPI} VMAPIEvent {"VMAPIEvent":{"severity":5,"subsystem":"ovmdSS","process":"ovmd","type":"system","payload":{"type":"IPChange","IPChange":{"intrface":"eth1286","mac":"<mac address>","ipv4info":{"ipinfo":[]},"ipv6info":{"ipinfo":[]}}}}} {}
WARNING (notificationserver:146) Event queue is full. Drop new event: {DOMAIN} 0004fb00-0006-0000-0ef6-702476xxxxxx {VMAPI} VMAPIEvent {"VMAPIEvent":{"severity":5,"subsystem":"ovmdSS","process":"ovmd","type":"system","payload":{"type":"IPChange","IPChange":{"intrface":"eth646_","mac":"<mac address>","ipv4info":{"ipinfo":[]},"ipv6info":{"ipinfo":[]}}}}} {}

 
AdminServer log from OVM Manager flooded with "Received ip change messages" :

####<YYYY-MM-DDTHH:MM:SS.MS+/-TZ> <Info> <com.oracle.ovm.mgr.event.ovs.Domain> <hostname of OVM Manager> <AdminServer> <EventProcessor-5> <> <> <db623d4d-fc90-4028-800e-15f5f1xxxxxx-00000004> <1563869182337> <BEA-000000> <Server <hostname of OVM Server>. VM: <hostname of Linux 6 or 7 VM>. Received ip change message>
####<YYYY-MM-DDTHH:MM:SS.MS+/-TZ> <Info> <com.oracle.ovm.mgr.event.ovs.Domain> <hostname of OVM Manager> <AdminServer> <EventProcessor-5> <> <> <db623d4d-fc90-4028-800e-15f5f1xxxxxx-00000004> <1563869183761> <BEA-000000> <Server <hostname of OVM Server>. VM: <hostname of Linux 6 or 7 VM>. Received ip change message>
####<YYYY-MM-DDTHH:MM:SS.MS+/-TZ> <Info> <com.oracle.ovm.mgr.event.ovs.Domain> <hostname of OVM Manager> <AdminServer> <EventProcessor-5> <> <> <0e9294a9-a323-4628-861f-0619e3xxxxxx-00000004> <1565014735198> <BEA-000000> <Server <hostname of OVM Server>. VM: <hostname of Linux 6 or 7 VM>. Received ip change message>
    

Note: 3 occurrences of "Received ip change message" lines are normally seen on Manager admin log, whenever a guest with ovmd reboots ( or ovmd restarts). This is Normal is not be concerned about.
Generally flooding of messages is to be concerned about only if the messages related to a Vm is more than this and causing event queue to be filled and causing issue.

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.