OCI DBCS - Patch Precheck Failed With DCS-10001 and ProductDriverException: Failed to get file owner for : /tmp/patchingsummary.xml
(Doc ID 2653186.1)
Last updated on AUGUST 30, 2023
Applies to:
Oracle Cloud Infrastructure - Database Service - Version N/A to N/A [Release 1.0]Linux x86-64
Symptoms
Customer complained their patch precheck failed with DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <nodename>.
From Job details
Job details
----------------------------------------------------------------
ID: 8bd4ad26-9c6c-496c-a0b2-c93d902f1755
Description: Server Patching
Status: Failure
Created: March 18, 2020 8:31:52 PM CET
Message: DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
Task Name Start Time End Time Status
---------------------------------------- ----------------------------------- ----------------------------------- ----------
Server Patching March 18, 2020 8:31:52 PM CET March 18, 2020 8:35:44 PM CET Failure
Create Patching Repository Directories[<node>] March 18, 2020 8:31:52 PM CET March 18, 2020 8:31:52 PM CET Success
Download latest patch metadata[<node>] March 18, 2020 8:31:52 PM CET March 18, 2020 8:32:13 PM CET Success
Update Patching Repository[<node>] March 18, 2020 8:32:13 PM CET March 18, 2020 8:33:32 PM CET Success
task:TaskSequential_784 March 18, 2020 8:33:32 PM CET March 18, 2020 8:35:44 PM CET Failure
Opatch updation[<node>] March 18, 2020 8:33:33 PM CET March 18, 2020 8:33:38 PM CET Success
Patch conflict check[<node>] March 18, 2020 8:33:38 PM CET March 18, 2020 8:35:43 PM CET Success
task:TaskSequential_812 March 18, 2020 8:35:43 PM CET March 18, 2020 8:35:44 PM CET Failure
apply clusterware patch[<node>] March 18, 2020 8:35:43 PM CET March 18, 2020 8:35:44 PM CET Failure
----------------------------------------------------------------
ID: 8bd4ad26-9c6c-496c-a0b2-c93d902f1755
Description: Server Patching
Status: Failure
Created: March 18, 2020 8:31:52 PM CET
Message: DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
Task Name Start Time End Time Status
---------------------------------------- ----------------------------------- ----------------------------------- ----------
Server Patching March 18, 2020 8:31:52 PM CET March 18, 2020 8:35:44 PM CET Failure
Create Patching Repository Directories[<node>] March 18, 2020 8:31:52 PM CET March 18, 2020 8:31:52 PM CET Success
Download latest patch metadata[<node>] March 18, 2020 8:31:52 PM CET March 18, 2020 8:32:13 PM CET Success
Update Patching Repository[<node>] March 18, 2020 8:32:13 PM CET March 18, 2020 8:33:32 PM CET Success
task:TaskSequential_784 March 18, 2020 8:33:32 PM CET March 18, 2020 8:35:44 PM CET Failure
Opatch updation[<node>] March 18, 2020 8:33:33 PM CET March 18, 2020 8:33:38 PM CET Success
Patch conflict check[<node>] March 18, 2020 8:33:38 PM CET March 18, 2020 8:35:43 PM CET Success
task:TaskSequential_812 March 18, 2020 8:35:43 PM CET March 18, 2020 8:35:44 PM CET Failure
apply clusterware patch[<node>] March 18, 2020 8:35:43 PM CET March 18, 2020 8:35:44 PM CET Failure
From DCS Agent log
2020-03-18 20:35:24,069DEBUG[Patch conflict check[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.c.CommandExecutor:Attribute :numberOfNodes value is : 1
2020-03-18 20:35:24,071DEBUG[Patch conflict check[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.CommonsUtils:
run: cmd= '[/u01/app/12.2.0.1/grid/OPatch/opatchauto,
apply,
-phBaseDir,
/u01/odaPatchingTempDir/30501932/analyzePatches,
-analyze,
-oh,
/u01/app/12.2.0.1/grid,
-log,
/tmp/opatchAutoAnalyzePatch.log,
-nonrolling]'
2020-03-18 20:35:27,524INFO[dw-55][]c.o.d.c.t.CustomSslContextFactory:entering SSLEngine
..........
OPatchauto session is initiated at Wed Mar 18 20:35:24 2020
System initialization log file is /u01/app/12.2.0.1/grid/cfgtoollogs/opatchautodb/systemconfig2020-03-18_08-35-34PM.log.
Session log file is /tmp/opatchAutoAnalyzePatch.log
oracle.dbsysmodel.driver.sdk.productdriver.ProductDriverException: Failed to get file owner for : /tmp/patchingsummary.xml <---------------
OPatchAuto failed.
OPatchauto session completed at Wed Mar 18 20:35:42 2020
Time taken to complete the session 0 minute,
18 seconds
opatchauto failed with error code 42
...............
2020-03-18 20:35:43,104DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.CommonsUtils:
run: cmd= '[su,
-,
oracle,
-c,
export ORACLE_BASE=/u01/app/oracle;
export ORACLE_HOME=/u01/app/oracle/product/12.2.0.1/dbhome_1;
export LANG=en_US.UTF-16;
/u01/app/oracle/product/12.2.0.1/dbhome_1/bin/srvctl stop home -o /u01/app/oracle/product/12.2.0.1/dbhome_1 -s /tmp/srvctl_status_home2020-03-18_20-35-43-4622733843893544295.temp -n <node>]'
2020-03-18 20:35:44,311DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.c.CommandExecutor:Return code: 1
2020-03-18 20:35:44,311DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.CommonsUtils:Output :
PRKO-3243 : The '-statfile <state_file>' option value "/tmp/srvctl_status_home2020-03-18_20-35-43-4622733843893544295.temp" is a file under a non-writable directory
..........
2020-03-18 20:35:44,330ERROR[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.j.JsonRequestProcessor:RPC request invocation failed on request: {"classz":"com.oracle.dcs.agent.rpc.service.patching.BmsPatchingActions",
"method":"applyPatchWithTag",
"params":[{"type":"java.lang.String",
"value":"gi"},
{"type":"java.lang.String",
"value":""},
{"type":"java.lang.String",
"value":"12.2.0.1.200114"}],
"revertable":false,
"threadId":145}
! com.oracle.dcs.commons.exception.DcsException: DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
! at com.oracle.dcs.commons.exception.DcsException$Builder.build(DcsException.java:69)
! at com.oracle.dcs.agent.rpc.service.patching.BmsPatchingActions.applyGiPatch(BmsPatchingActions.java:766)
! at com.oracle.dcs.agent.rpc.service.patching.BmsPatchingActions.applyPatchWithTag(BmsPatchingActions.java:89)
............
2020-03-18 20:35:44,330DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.a.z.DCSZooKeeper:DCS node id is - node_0
2020-03-18 20:35:44,330DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.a.t.TaskZJsonRpc:Task[TaskZJsonRpcExt_813] RPC request 'Local:node_0@applyPatchWithTag()' completed: Failure
2020-03-18 20:35:44,330DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.a.t.TaskZJsonRpcExt:Task[id: TaskZJsonRpcExt_813, TaskName: apply clusterware patch[<node>]] got exception:
! com.oracle.dcs.commons.exception.DcsTaskFailureException: DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
! at com.oracle.dcs.agent.task.TaskZJsonRpc.processJsonResponse(TaskZJsonRpc.java:62)
! at com.oracle.dcs.agent.task.TaskZJsonRpcExt.callInternal(TaskZJsonRpcExt.java:60)
.............
2020-03-18 20:35:44,331DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.r.ServiceJobReport:process TaskDetail this.jobid= 8bd4ad26-9c6c-496c-a0b2-c93d902f1755 d.jobid=8bd4ad26-9c6c-496c-a0b2-c93d902f1755 d.taskid=TaskZJsonRpcExt_813 this.msg=null d.res=DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>. d.subtasks.isempty=true d.status=Failure
2020-03-18 20:35:44,331DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.TaskBuilder:Add task parallel(id: ReportRecorder_TaskParallel_1206, jobId: null, status: Created, result: null, on_failure: FailOnAny):
..........
2020-03-18 20:35:44,378INFO[Server Patching : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.TaskSequential:Task[id: TaskSequential_845, TaskName: Server Patching] completed: Failure
2020-03-18 20:35:44,379DEBUG[Server Patching : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.TaskDetail:set task result as DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
...........
2020-03-18 20:35:24,071DEBUG[Patch conflict check[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.CommonsUtils:
run: cmd= '[/u01/app/12.2.0.1/grid/OPatch/opatchauto,
apply,
-phBaseDir,
/u01/odaPatchingTempDir/30501932/analyzePatches,
-analyze,
-oh,
/u01/app/12.2.0.1/grid,
-log,
/tmp/opatchAutoAnalyzePatch.log,
-nonrolling]'
2020-03-18 20:35:27,524INFO[dw-55][]c.o.d.c.t.CustomSslContextFactory:entering SSLEngine
..........
OPatchauto session is initiated at Wed Mar 18 20:35:24 2020
System initialization log file is /u01/app/12.2.0.1/grid/cfgtoollogs/opatchautodb/systemconfig2020-03-18_08-35-34PM.log.
Session log file is /tmp/opatchAutoAnalyzePatch.log
oracle.dbsysmodel.driver.sdk.productdriver.ProductDriverException: Failed to get file owner for : /tmp/patchingsummary.xml <---------------
OPatchAuto failed.
OPatchauto session completed at Wed Mar 18 20:35:42 2020
Time taken to complete the session 0 minute,
18 seconds
opatchauto failed with error code 42
...............
2020-03-18 20:35:43,104DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.CommonsUtils:
run: cmd= '[su,
-,
oracle,
-c,
export ORACLE_BASE=/u01/app/oracle;
export ORACLE_HOME=/u01/app/oracle/product/12.2.0.1/dbhome_1;
export LANG=en_US.UTF-16;
/u01/app/oracle/product/12.2.0.1/dbhome_1/bin/srvctl stop home -o /u01/app/oracle/product/12.2.0.1/dbhome_1 -s /tmp/srvctl_status_home2020-03-18_20-35-43-4622733843893544295.temp -n <node>]'
2020-03-18 20:35:44,311DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.c.CommandExecutor:Return code: 1
2020-03-18 20:35:44,311DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.u.CommonsUtils:Output :
PRKO-3243 : The '-statfile <state_file>' option value "/tmp/srvctl_status_home2020-03-18_20-35-43-4622733843893544295.temp" is a file under a non-writable directory
..........
2020-03-18 20:35:44,330ERROR[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.j.JsonRequestProcessor:RPC request invocation failed on request: {"classz":"com.oracle.dcs.agent.rpc.service.patching.BmsPatchingActions",
"method":"applyPatchWithTag",
"params":[{"type":"java.lang.String",
"value":"gi"},
{"type":"java.lang.String",
"value":""},
{"type":"java.lang.String",
"value":"12.2.0.1.200114"}],
"revertable":false,
"threadId":145}
! com.oracle.dcs.commons.exception.DcsException: DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
! at com.oracle.dcs.commons.exception.DcsException$Builder.build(DcsException.java:69)
! at com.oracle.dcs.agent.rpc.service.patching.BmsPatchingActions.applyGiPatch(BmsPatchingActions.java:766)
! at com.oracle.dcs.agent.rpc.service.patching.BmsPatchingActions.applyPatchWithTag(BmsPatchingActions.java:89)
............
2020-03-18 20:35:44,330DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.a.z.DCSZooKeeper:DCS node id is - node_0
2020-03-18 20:35:44,330DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.a.t.TaskZJsonRpc:Task[TaskZJsonRpcExt_813] RPC request 'Local:node_0@applyPatchWithTag()' completed: Failure
2020-03-18 20:35:44,330DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.a.t.TaskZJsonRpcExt:Task[id: TaskZJsonRpcExt_813, TaskName: apply clusterware patch[<node>]] got exception:
! com.oracle.dcs.commons.exception.DcsTaskFailureException: DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
! at com.oracle.dcs.agent.task.TaskZJsonRpc.processJsonResponse(TaskZJsonRpc.java:62)
! at com.oracle.dcs.agent.task.TaskZJsonRpcExt.callInternal(TaskZJsonRpcExt.java:60)
.............
2020-03-18 20:35:44,331DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.r.ServiceJobReport:process TaskDetail this.jobid= 8bd4ad26-9c6c-496c-a0b2-c93d902f1755 d.jobid=8bd4ad26-9c6c-496c-a0b2-c93d902f1755 d.taskid=TaskZJsonRpcExt_813 this.msg=null d.res=DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>. d.subtasks.isempty=true d.status=Failure
2020-03-18 20:35:44,331DEBUG[apply clusterware patch[<node>] : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.TaskBuilder:Add task parallel(id: ReportRecorder_TaskParallel_1206, jobId: null, status: Created, result: null, on_failure: FailOnAny):
..........
2020-03-18 20:35:44,378INFO[Server Patching : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.TaskSequential:Task[id: TaskSequential_845, TaskName: Server Patching] completed: Failure
2020-03-18 20:35:44,379DEBUG[Server Patching : JobId=8bd4ad26-9c6c-496c-a0b2-c93d902f1755][]c.o.d.c.t.TaskDetail:set task result as DCS-10001:Internal error encountered: stop the oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1 on node <node>.
...........
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Changes |
Cause |
Solution |