EM 13c: Webtier Fails to Start with Error "nzos call nzosSetCredential returned" if Custom SSL Certificate has Expired (Doc ID 2191775.1)

Last updated on FEBRUARY 23, 2024

Applies to:

Symptoms

13c OMS fails to start with the below error:

emctl start oms
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation. All rights reserved.
Starting Oracle Management Server...
WebTier Could Not Be Started.
Error Occurred: WebTier Could Not Be Started.
Please check <PATH>/gc_inst/em/EMGC_OMS1/sysman/log/emctl.log for error details 

-  The <gc_inst>/em/EMGC_OMS1/sysman/log/emctl.log reports:

2016-10-04 10:23:26,162 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>NMProcess: Oct 04, 2016 10:23:26 AM oracle.ohs.plugin.nodemanager.OhsProcessManagementPlugin$ProcessImpl 
buildIoException
2016-10-04 10:23:26,162 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>NMProcess: SEVERE: Failed to start the server ohs1
2016-10-04 10:23:26,164 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>NMProcess: <Oct 4, 2016 10:23:26 AM SGT> <WARNING> <Server start command for OHS server 'ohs1' 
failed due to: [Failed to start the server ohs1
2016-10-04 10:23:26,165 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>NMProcess: Check log file 
<PATH>/gc_inst/user_projects/domains/GCDomain/system_components/OHS/ohs_nm.log
2016-10-04 10:23:26,165 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>NMProcess: Check log file 
<PATH>/gc_inst/user_projects/domains/GCDomain/servers/ohs1/logs/ohs1.log]. Please check Node Manager log and/or server 'ohs1' log for detailed information.>
2016-10-04 10:23:26,167 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>Error Starting server ohs1: weblogic.nodemanager.NMException: 
Received error message from Node Manager Server: [Server start command for OHS server 'ohs1' failed due to: [Failed to start the server ohs1
2016-10-04 10:23:26,167 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>Check log file <PATH>/gc_inst/user_projects/domains/GCDomain/system_components/OHS/ohs_nm.log
2016-10-04 10:23:26,168 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>Check log file <PATH>/em13c/gc_inst/user_projects/domains/GCDomain/servers/ohs1/logs/ohs1.log]. 
Please check Node Manager log and/or server 'ohs1' log for detailed information.]. Please check Node Manager log for details.
2016-10-04 10:23:26,169 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>new status of OHS:
2016-10-04 10:23:26,176 [Thread-2] INFO commands.BaseCommand run.605 - <ERR>_END_
2016-10-04 10:23:26,177 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>
2016-10-04 10:23:26,177 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>FAILED
2016-10-04 10:23:26,177 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>
2016-10-04 10:23:26,177 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>status of node manager:
2016-10-04 10:23:26,177 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>Currently connected to Node Manager to monitor the domain GCDomain.
2016-10-04 10:23:26,178 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>1
2016-10-04 10:23:26,178 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>Successfully disconnected from Node Manager.
2016-10-04 10:23:26,178 [Thread-1] INFO commands.BaseCommand run.605 - <OUT>_END_
2016-10-04 10:23:26,503 [main] ERROR commands.BaseCommand logAndPrint.651 - WebTier Could Not Be Started.
2016-10-04 10:23:26,503 [main] ERROR wls.OMSController main.253 - OMSController failed for start oms
2016-10-04 10:23:26,505 [main] ERROR wls.OMSController main.254 - OMSController Error: WebTier Could Not Be Started.
java.lang.Exception: WebTier Could Not Be Started.

-  The <gc_inst>/user_projects/domains/GCDomain/servers/ohs1/logs/ohs1.log shows:

[2016-10-04T10:02:24.1374+08:00] [OHS] [ERROR:32] [OHS-2171] [mod_ssl.c] [host_id: cloud-control] [host_addr: 10.10.10.10] [pid: 6039] [tid: 139826638464832] 
[user: oem12cc] [VirtualHost: omshost.domain:9851] NZ Library Error: Unknown error

[2016-10-04T10:23:26.1069+08:00] [OHS] [ERROR:32] [OHS-2057] [mod_ssl.c] [host_id: cloud-control] [host_addr: 10.10.10.10] [pid: 8938] [tid: 139763041081152] 
[user: oem12cc] [VirtualHost: omshost.domain:9851] Init: (omshost.domain:9851) Unable to initialize SSL environment, nzos call nzosSetCredential returned 28791

[2016-10-04T10:23:26.1071+08:00] [OHS] [ERROR:32] [OHS-2171] [mod_ssl.c] [host_id: cloud-control] [host_addr: 10.10.10.10] [pid: 8938] [tid: 139763041081152] 
[user: oem12cc] [VirtualHost: omshost.domain:9851] NZ Library Error: Unknown error

-  The details for the SSL error are:

SSL-28791:certificate verification failure
Cause: Verification of the certificate, which the user supplied, failed.

-  The OMS and WLS components are secured with a third party SSL certificate, which has expired. This can be verified by the below command:

This output was collected in Oct 2016 and shows that the validity of the certificate has expired in Sept 2016 itself.

-  The Admin server also fails to start with the below error in the <gc_inst>/user_projects/domains/GCDomain/servers/EMGC_ADMINSERVER/logs/EMGC_ADMINSERVER.out:

Oct 06, 2016 10:32:05 AM oracle.dms.servlet.DMSServletFilter setEagerlySetContextValues
INFO: The setting that controls the eager fetching of some types of execution context data has been set to true.
<Oct 6, 2016 10:32:05 AM SGT> <Alert> <Security> <BEA-090154> <Identity certificate has expired: [
[

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.