My Oracle Support Banner

OLVM: Grafana Service Is Down After The Update Of The OLVM Engine (Doc ID 3062244.1)

Last updated on DECEMBER 07, 2024

Applies to:

Linux OS - Version Oracle Linux 8.10 with Unbreakable Enterprise Kernel [5.15.0] and later
Information in this document applies to any platform.
Linux x86-64

Symptoms

On Oracle Linux Virtualization Manager(OLVM), the grafana-server has been manually restarted after the update, but the grafana login is not loading and it shows "Not Found: The requested URL was not found on this server". Please refer to the error below, for more information.


ERROR

-------------------------------
ovirt-engine-setup****.log:
-------------------------------
2024-12-04 13:53:20,592-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'status', 'grafana-server.service') stderr:
2024-12-04 13:53:20,592-0500 INFO otopi.plugins.ovirt_engine_common.base.system.hostile_services hostile_services._transaction_begin:71 Stopping service: grafana-server
2024-12-04 13:53:20,593-0500 DEBUG otopi.plugins.otopi.services.systemd systemd.state:170 stopping service grafana-server
2024-12-04 13:53:20,593-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:813 execute: ('/usr/bin/systemctl', 'stop', 'grafana-server.service'), executable='None', cwd='None', env=None
2024-12-04 13:53:20,611-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'stop', 'grafana-server.service'), rc=0
2024-12-04 13:53:20,611-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:921 execute-output: ('/usr/bin/systemctl', 'stop', 'grafana-server.service') stdout:
:
2024-12-04 13:53:20,615-0500 DEBUG otopi.context context._executeMethod:127 Stage transaction-prepare METHOD otopi.plugins.ovirt_engine_setup.ovirt_engine_dwh.core.single_etl.Plugin._transactionBegin
2024-12-04 13:53:20,616-0500 DEBUG otopi.ovirt_engine_setup.engine_common.database database.execute:235 Database: 'None', Statement: '
select * from GetDwhHistoryTimekeepingByVarName(
%(name)s
)
', args: {'name': 'DwhCurrentlyRunning'}
:
2024-12-04 13:55:16,485-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'grafana-server.service') stderr:
Job for grafana-server.service failed because the control process exited with error code.
See "systemctl status grafana-server.service" and "journalctl -xe" for details.
:
2024-12-04 13:55:16,486-0500 DEBUG otopi.context context._executeMethod:145 method exception
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod
method['method']()
File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-common/base/system/hostile_services.py", line 97, in _closeup
state=True
File "/usr/share/otopi/plugins/otopi/services/systemd.py", line 181, in state
service=name,
RuntimeError: Failed to start service 'grafana-server'
2024-12-04 13:55:16,491-0500 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Closing up': Failed to start service 'grafana-server'
-----------
messages: 
-----------
Dec 4 16:46:01 olvm-mgr-lab grafana-server[2404754]: {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2024-12-04T16:46:01.742872-05:00","queryType":"random_walk_with_error"}
Dec 4 16:46:01 olvm-mgr-lab grafana-server[2404754]: {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2024-12-04T16:46:01.742878-05:00","queryType":"server_error_500"}
Dec 4 16:46:01 olvm-mgr-lab grafana-server[2404754]: t=2024-12-04T16:46:01-0500 lvl=eror msg="can't read datasource provisioning files from directory" logger=provisioning.datasources path=/etc/grafana/provisioning/datasources error="open /etc/grafana/provisioning/datasources:
no such file or directory"
Dec 4 16:46:01 olvm-mgr-lab grafana-server[2404754]: t=2024-12-04T16:46:01-0500 lvl=eror msg="Failed to read plugin provisioning files from directory" logger=provisioning.plugins path=/etc/grafana/provisioning/plugins error="open /etc/grafana/provisioning/plugins: no such file or directory"
Dec 4 16:46:01 olvm-mgr-lab grafana-server[2404754]: t=2024-12-04T16:46:01-0500 lvl=eror msg="Can't read alert notification provisioning files from directory" logger=provisioning.notifiers path=/etc/grafana/provisioning/notifiers error="open /etc/grafana/provisioning/notifiers: no such file or directory"
Dec 4 16:46:01 olvm-mgr-lab grafana-server[2404754]: t=2024-12-04T16:46:01-0500 lvl=eror msg="can't read dashboard provisioning files from directory" logger=provisioning.dashboard path=/etc/grafana/provisioning/dashboards error="open /etc/grafana/provisioning/dashboards: no such file or directory"
Dec 4 16:46:33 olvm-mgr-lab grafana-server[2404784]: {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2024-12-04T16:46:33.720491-05:00","queryType":"random_walk_with_error"}
Dec 4 16:46:33 olvm-mgr-lab grafana-server[2404784]: {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2024-12-04T16:46:33.720498-05:00","queryType":"server_error_500"}
Dec 4 16:46:33 olvm-mgr-lab grafana-server[2404784]: t=2024-12-04T16:46:33-0500 lvl=eror msg="can't read datasource provisioning files from directory" logger=provisioning.datasources path=/etc/grafana/provisioning/datasources error="open /etc/grafana/provisioning/datasources: no such file or directory"
Dec 4 16:46:33 olvm-mgr-lab grafana-server[2404784]: t=2024-12-04T16:46:33-0500 lvl=eror msg="Failed to read plugin provisioning files from directory" logger=provisioning.plugins path=/etc/grafana/provisioning/plugins error="open /etc/grafana/provisioning/plugins: no such file or directory"
Dec 4 16:46:33 olvm-mgr-lab grafana-server[2404784]: t=2024-12-04T16:46:33-0500 lvl=eror msg="Can't read alert notification provisioning files from directory" logger=provisioning.notifiers path=/etc/grafana/provisioning/notifiers error="open /etc/grafana/provisioning/notifiers: no such file or directory"
Dec 4 16:46:33 olvm-mgr-lab grafana-server[2404784]: t=2024-12-04T16:46:33-0500 lvl=eror msg="can't read dashboard provisioning files from directory" logger=provisioning.dashboard path=/etc/grafana/provisioning/dashboards error="open /etc/grafana/provisioning/dashboards: no such file or directory"
-------------
grafana.log: 
-------------
t=2024-12-04T16:46:01-0500 lvl=info msg="Starting plugin search" logger=plugins
t=2024-12-04T16:46:01-0500 lvl=eror msg="can't read datasource provisioning files from directory" logger=provisioning.datasources path=/etc/grafana/provisioning/datasources error="open /etc/grafana/provisioning/datasources: no such file or directory"
t=2024-12-04T16:46:01-0500 lvl=eror msg="Failed to read plugin provisioning files from directory" logger=provisioning.plugins path=/etc/grafana/provisioning/plugins error="open /etc/grafana/provisioning/plugins: no such file or directory"
t=2024-12-04T16:46:01-0500 lvl=eror msg="Can't read alert notification provisioning files from directory" logger=provisioning.notifiers path=/etc/grafana/provisioning/notifiers error="open /etc/grafana/provisioning/notifiers: no such file or directory"
t=2024-12-04T16:46:01-0500 lvl=eror msg="can't read dashboard provisioning files from directory" logger=provisioning.dashboard path=/etc/grafana/provisioning/dashboards error="open /etc/grafana/provisioning/dashboards: no such file or directory"
t=2024-12-04T16:46:01-0500 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=http subUrl= socket=
t=2024-12-04T16:46:10-0500 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated"
t=2024-12-04T16:46:33-0500 lvl=info msg="Starting Grafana" logger=server version=7.5.17 commit=31bb0ec41e branch=HEAD compiled=2023-10-13T09:09:02-0500
t=2024-12-04T16:46:33-0500 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2024-12-04T16:46:33-0500 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2024-12-04T16:46:33-0500 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2024-12-04T16:46:33-0500 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2024-12-04T16:46:33-0500 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2024-12-04T16:46:33-0500 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2024-12-04T16:46:33-0500 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2024-12-04T16:46:33-0500 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2024-12-04T16:46:33-0500 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2024-12-04T16:46:33-0500 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins
t=2024-12-04T16:46:33-0500 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2024-12-04T16:46:33-0500 lvl=info msg="App mode production" logger=settings
t=2024-12-04T16:46:33-0500 lvl=info msg="Writing PID file" logger=server path=/var/run/grafana/grafana-server.pid pid=2404784
t=2024-12-04T16:46:33-0500 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2024-12-04T16:46:33-0500 lvl=info msg="Starting DB migrations" logger=migrator
t=2024-12-04T16:46:33-0500 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=279 duration=851.645µs
t=2024-12-04T16:46:33-0500 lvl=info msg="Starting plugin search" logger=plugins
t=2024-12-04T16:46:33-0500 lvl=eror msg="can't read datasource provisioning files from directory" logger=provisioning.datasources path=/etc/grafana/provisioning/datasources error="open /etc/grafana/provisioning/datasources: no such file or directory"
t=2024-12-04T16:46:33-0500 lvl=eror msg="Failed to read plugin provisioning files from directory" logger=provisioning.plugins path=/etc/grafana/provisioning/plugins error="open /etc/grafana/provisioning/plugins: no such file or directory"
t=2024-12-04T16:46:33-0500 lvl=eror msg="Can't read alert notification provisioning files from directory" logger=provisioning.notifiers path=/etc/grafana/provisioning/notifiers error="open /etc/grafana/provisioning/notifiers: no such file or directory"
t=2024-12-04T16:46:33-0500 lvl=eror msg="can't read dashboard provisioning files from directory" logger=provisioning.dashboard path=/etc/grafana/provisioning/dashboards error="open /etc/grafana/provisioning/dashboards: no such file or directory"
t=2024-12-04T16:46:33-0500 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=http subUrl= socket=

Changes

The engine was updated to the latest 4.5.5.x release.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Changes
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.