OLVM: The hosted-engine is constantly restarting (Doc ID 2926035.1)

Last updated on FEBRUARY 19, 2023

Applies to:

Symptoms

The hosted-engine on Oracle Linux Virtualization Manager (OLVM) keeps restarting despite sufficient storage space being available. Please find further details below.

Engine Host

/var/log/messages:
Feb 3 16:24:23 my-hosted-engine kernel: falcon_nf_netcontain: module license 'Proprietary' taints kernel. <======== taints the kernel found here..!!!
Feb 3 16:24:23 my-hosted-engine kernel: Disabling lock debugging due to kernel taint <====
Feb 3 16:32:16 my-hosted-engine kernel: twnotify: loading out-of-tree module taints kernel. <======== taints the kernel found here..!!!
Feb 3 16:32:16 my-hosted-engine kernel: twnotify: module verification failed: signature and/or required key missing - <======== taints the kernel found here..!!!
Feb 3 16:32:17 my-hosted-engine kernel: falcon_nf_netcontain: module license 'Proprietary' taints kernel. <======== taints the kernel found here..!!!
Feb 3 16:32:17 my-hosted-engine kernel: Disabling lock debugging due to kernel taint <===
Feb 3 16:44:41 my-hosted-engine kernel: twnotify: loading out-of-tree module taints kernel. <===
Feb 3 16:44:41 my-hosted-engine kernel: twnotify: module verification failed: signature and/or required key missing - tainting kernel <======== tainting kernel found here..!!!
Feb 3 16:44:42 my-hosted-engine kernel: falcon_nf_netcontain: module license 'Proprietary' taints kernel. <======== taints the kernel found here..!!!
Feb 3 16:44:42 my-hosted-engine kernel: Disabling lock debugging due to kernel taint
Feb 3 16:56:52 my-hosted-engine kernel: twnotify: loading out-of-tree module taints kernel. <===
Feb 3 16:56:52 my-hosted-engine kernel: twnotify: module verification failed: signature and/or required key missing - tainting kernel <======== tainting kernel found here..!!!
Feb 3 16:56:53 my-hosted-engine kernel: falcon_nf_netcontain: module license 'Proprietary' taints kernel. <======== taints the kernel found here..!!!
Feb 3 16:56:53 my-hosted-engine kernel: Disabling lock debugging due to kernel taint <===

KVM Host:

/var/log/messages:
<=== The KVM Host OS kernel is also currently experiencing tainted kernel.
Feb 3 13:15:07 my-kvmhost01 kernel: twnotify: loading out-of-tree module taints kernel.
Feb 3 13:15:07 my-kvmhost01 kernel: twnotify: module verification failed: signature and/or required key missing - tainting kernel
Feb 3 13:15:10 my-kvmhost01 kernel: falcon_nf_netcontain: module license 'Proprietary' taints kernel.
Feb 3 13:15:10 my-kvmhost01 kernel: Disabling lock debugging due to kernel taint

<=== tainted on HostedEngine has been reported by the KVM Host, that resulted to HostedEngine constantly restarting...!!!
Feb 3 13:19:49 my-kvmhost01 journal[5182]: Domain id=1 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:22:59 my-kvmhost01 journal[5182]: Domain id=1 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:24:49 my-kvmhost01 journal[5182]: Domain id=1 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:27:59 my-kvmhost01 journal[5182]: Domain id=1 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:32:59 my-kvmhost01 journal[5182]: Domain id=2 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:35:54 my-kvmhost01 journal[5182]: Domain id=2 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:38:00 my-kvmhost01 journal[5182]: Domain id=2 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:40:55 my-kvmhost01 journal[5182]: Domain id=2 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:45:55 my-kvmhost01 journal[5182]: Domain id=3 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:48:35 my-kvmhost01 journal[5182]: Domain id=3 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:53:35 my-kvmhost01 journal[5182]: Domain id=4 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 13:58:20 my-kvmhost01 journal[5182]: Domain id=5 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 14:03:20 my-kvmhost01 journal[5182]: Domain id=5 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 14:03:20 my-kvmhost01 journal[5182]: Domain id=5 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 14:08:21 my-kvmhost01 journal[5182]: Domain id=5 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command
Feb 3 14:08:21 my-kvmhost01 journal[5182]: Domain id=5 name='HostedEngine' uuid=e455a304-2c99-420f-a81e-685f058db780 is tainted: custom-ga-command

<==== tainted kernel is also have seen here...!!!
Feb 3 21:30:06 my-kvmhost01 kernel: twnotify: loading out-of-tree module taints kernel.
Feb 3 21:30:06 my-kvmhost01 kernel: twnotify: module verification failed: signature and/or required key missing - tainting kernel
Feb 3 21:30:09 my-kvmhost01 kernel: falcon_nf_netcontain: module license 'Proprietary' taints kernel.
Feb 3 21:30:09 my-kvmhost01 kernel: Disabling lock debugging due to kernel taint

--HostedEgnine log (/var/log/libvirt/qemu/HostedEngine.log) <============== The OS tainting kernel issue has resulted the HostedEngine to shutdown/reboot constantly...!!!!
2023-02-04 03:34:52.878+0000: Domain id=1 is tainted: custom-ga-command
2023-02-04 03:37:38.191+0000: Domain id=1 is tainted: custom-ga-command
2023-02-04 03:39:53.498+0000: Domain id=1 is tainted: custom-ga-command
2023-02-04 03:42:38.692+0000: Domain id=1 is tainted: custom-ga-command
2023-02-04T03:42:56.124306Z qemu-system-x86_64: terminating on signal 15 from pid 5370 (/usr/sbin/libvirtd)
2023-02-04 03:42:56.432+0000: shutting down, reason=shutdown

2023-02-03 19:32:59.898+0000: Domain id=2 is tainted: custom-ga-command
2023-02-03 19:35:54.992+0000: Domain id=2 is tainted: custom-ga-command
2023-02-03 19:38:00.062+0000: Domain id=2 is tainted: custom-ga-command
2023-02-03 19:40:55.157+0000: Domain id=2 is tainted: custom-ga-command
2023-02-03T19:43:05.750776Z qemu-system-x86_64: terminating on signal 15 from pid 5182 (/usr/sbin/libvirtd)
2023-02-03 19:43:06.019+0000: shutting down, reason=shutdown

2023-02-03 19:45:55.445+0000: Domain id=3 is tainted: custom-ga-command
2023-02-03 19:48:35.535+0000: Domain id=3 is tainted: custom-ga-command
2023-02-03T19:49:22.788761Z qemu-system-x86_64: terminating on signal 15 from pid 5182 (/usr/sbin/libvirtd)
2023-02-03 19:49:23.080+0000: shutting down, reason=shutdown

2023-02-04 03:47:40.674+0000: Domain id=4 is tainted: custom-ga-command
2023-02-04 03:50:01.470+0000: Domain id=4 is tainted: custom-ga-command
2023-02-04 03:52:42.308+0000: Domain id=4 is tainted: custom-ga-command
2023-02-04T03:53:38.594959Z qemu-system-x86_64: terminating on signal 15 from pid 5370 (/usr/sbin/libvirtd)
2023-02-04 03:53:38.899+0000: shutting down, reason=shutdown

2023-02-03 19:58:20.804+0000: Domain id=5 is tainted: custom-ga-command
2023-02-03 20:03:20.975+0000: Domain id=5 is tainted: custom-ga-command
2023-02-03 20:03:20.978+0000: Domain id=5 is tainted: custom-ga-command
2023-02-03 20:08:21.166+0000: Domain id=5 is tainted: custom-ga-command
2023-02-03 20:08:21.171+0000: Domain id=5 is tainted: custom-ga-command
2023-02-03T20:10:34.691397Z qemu-system-x86_64: terminating on signal 15 from pid 5182 (/usr/sbin/libvirtd)
2023-02-03 20:10:34.962+0000: shutting down, reason=shutdown

Changes

OLVM update.

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.