ODA 19.14 server patching fails with DCS-10001:Internal error encountered: Failed to execute command: srvctl stop instance -d <dbname> -i <dbname>;. (Doc ID 2864514.1)

Last updated on APRIL 26, 2023

Applies to:

Symptoms

You are attempting to upgrade your Oracle Database Appliance to 19.14

odacli update-server -v 19.14.0.0.0

and encounter the following error -

Message: DCS-10001:Internal error encountered: Failed to execute command: srvctl stop instance -d <dbname>  -i <dbname>;.

# odacli describe-job -i <job_id>

Job details
----------------------------------------------------------------
  ID: <job_id>
  Description: Server Patching
  Status: Failure
  Created: April 21, 2022 10:21:19 AM CDT
  Message: DCS-10001:Internal error encountered: Failed to execute command: srvctl stop instance -d <dbname> -i <dbname>;.

Task Name Start Time End Time Status
---------------------------------------- ----------------------------------- ----------------------------------- ----------
Server patching April 21, 2022 10:21:36 AM CDT April 21, 2022 10:24:36 AM CDT Failure
Validating GI user metadata April 21, 2022 10:21:36 AM CDT April 21, 2022 10:21:36 AM CDT Success
Validate ILOM server reachable April 21, 2022 10:21:36 AM CDT April 21, 2022 10:24:31 AM CDT Success
Server patching April 21, 2022 10:24:32 AM CDT April 21, 2022 10:24:36 AM CDT Failure
Server patching April 21, 2022 10:24:32 AM CDT April 21, 2022 10:24:36 AM CDT Failure
Update database START and STOP dependencies April 21, 2022 10:24:32 AM CDT April 21, 2022 10:24:36 AM CDT Failure

The prepatch report shows the following -

# odacli describe-prepatchreport -i <job_id>

Patch pre-check report
------------------------------------------------------------------------
  Job ID: <job_id>
  Description: Patch pre-checks for [OS, ILOM, GI, ORACHKSERVER]
  Status: FAILED
  Created: April 21, 2022 10:04:57 AM CDT
  Result: One or more pre-checks failed for [ORACHK]

Node Name
---------------
<hostname>

Pre-Check Status Comments
------------------------------ -------- --------------------------------------
__OS__
Validate supported versions Success Validated minimum supported versions.
Validate patching tag Success Validated patching tag: 19.14.0.0.0.
Is patch location available Success Patch location is available.
Verify OS patch Success Verified OS patch
Validate command execution Success Validated command execution

__ILOM__
Validate ILOM server reachable Success Successfully connected with ILOM
  server using USB interconnect
Validate supported versions Success Validated minimum supported versions.
Validate patching tag Success Validated patching tag: 19.14.0.0.0.
Is patch location available Success Patch location is available.
Checking Ilom patch Version Success Successfully verified the versions
Patch location validation Success Successfully validated location
Validate command execution Success Validated command execution

__GI__
Validate GI metadata Success Successfully validated GI metadata
Validate supported GI versions Success Validated minimum supported versions.
Validate available space Success Validated free space under /u01
Is clusterware running Success Clusterware is running
Validate patching tag Success Validated patching tag: 19.14.0.0.0.
Is system provisioned Success Verified system is provisioned
Validate ASM in online Success ASM is online
Validate kernel log level Success Successfully validated the OS log
  level
Validate minimum agent version Success GI patching enabled in current
  DCSAGENT version
Validate Central Inventory Success oraInventory validation passed
Validate patching locks Success Validated patching locks
Validate clones location exist Success Validated clones location
Validate DB start dependencies Alert Cluster Ready Services attribute
  START_DEPENDENCIES for database
  [<dbname>] is incorrect and
  will be corrected as part of server
  patching.
Validate DB stop dependencies Alert Cluster Ready Services attribute
  STOP_DEPENDENCIES for database
  [<dbname>] is incorrect and
  will be corrected as part of server
  patching.
Evaluate GI patching Success Successfully validated GI patching
Validate command execution Success Validated command execution

__ORACHK__
Running orachk Failed Failed to run Orachk: Failed to run
  orachk:
  '/opt/oracle/dcs/oracle.ahf/data/
  <hostname>/orachk/user_root/work'
  temporary directory is not available.
  Run 'ahfctl access add –user root' to
  register user and then re-run orachk.
Validate command execution Success Validated command execution

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.