OID 12c: Creating oid2 of HA Cluster Fails with: Error while Activating changes. : Timed out waiting for completion: Activate State: STATE_DISTRIBUTING Target Servers States: oid2 STATE_DEFERRED / Checking with "oid_instanceStatus" Command Hangs
(Doc ID 2832081.1)
Last updated on AUGUST 29, 2023
Applies to:
Oracle Internet Directory - Version 12.2.1.3.0 and laterInformation in this document applies to any platform.
Symptoms
Creating a 2 node High Availability (HA) cluster for Oracle Internet Directory (OID) 12c using shared storage (e.g., "config/domains/oid") for the domain.
Following: OID 12c: Installation And Configuration Of A Collocated Clustered Oracle Internet Directory (OID) 12.2.1.3.0 On A Supported Linux Host (With Screenshots) (Doc ID 2326373.1)
oid1 on node1 is running fine
oid2 instance creation/start fails
On the step "Create the 'oid2' instance (from Server1)" from Doc ID 2326373.1 it fails with:
$ ./wlst.sh
Initializing WebLogic Scripting Tool (WLST) ...
Welcome to WebLogic Server Administration Scripting Shell
Type help() for help on available commands
wls:/offline> connect(<etc>)
Connecting to <etc>...
Successfully connected to Admin Server "AdminServer" that belongs to domain "oid".
Warning: An insecure protocol was used to connect to the server.
To ensure on-the-wire security, the SSL port or Admin port should be used instead.
wls:/oid/serverConfig/> oid_createInstance(instanceName='oid2', machine='oidhost2', port=<nonssl_port>, sslPort=<ssl_port>,host=<hostname2>')
Location changed to edit custom tree. This is a writable tree with No root.
For more help, use help('editCustom')
Starting an edit session ...
Started edit session, be sure to save and activate your changes once you are done.
Saving all your changes ...
Saved all your changes successfully.
Activating all your changes, this may take a while ...
The edit lock associated with this edit session is released once the activation is completed.
The node manager for "oid2" is not reachable. Changes will be completed when the node manager is available.
The node manager error is: Connection timed out (Connection timed out). Could not connect to NodeManager. Check that it is running at <etc>.
Traceback (innermost last):
File "<console>", line 1, in ?
File "/u01/fmw/oid/oid/plugins/wlst/oid-wlst-dependencies.jar!/wlstScriptDir/OidCustomCommands.py", line 25, in oid_createInstance
File "/u01/fmw/oid/oid/plugins/wlst/oid-wlst-dependencies.jar/wlstScriptDir/oid_handler.py", line 189, in oid_createOIDInstance
File "/tmp/wlst_module11961866495391520064.py", line 481, in activate
File "/tmp/wlst_module36651586180707788336.py", line 240, in raiseWLSTException
WLSTException: Error occurred while performing activate : Error while Activating changes. : Timed out waiting for completion: Activate State: STATE_DISTRIBUTING Target Servers States: oid2 STATE_DEFERRED
Use dumpStack() to view the full stacktrace :
Initializing WebLogic Scripting Tool (WLST) ...
Welcome to WebLogic Server Administration Scripting Shell
Type help() for help on available commands
wls:/offline> connect(<etc>)
Connecting to <etc>...
Successfully connected to Admin Server "AdminServer" that belongs to domain "oid".
Warning: An insecure protocol was used to connect to the server.
To ensure on-the-wire security, the SSL port or Admin port should be used instead.
wls:/oid/serverConfig/> oid_createInstance(instanceName='oid2', machine='oidhost2', port=<nonssl_port>, sslPort=<ssl_port>,host=<hostname2>')
Location changed to edit custom tree. This is a writable tree with No root.
For more help, use help('editCustom')
Starting an edit session ...
Started edit session, be sure to save and activate your changes once you are done.
Saving all your changes ...
Saved all your changes successfully.
Activating all your changes, this may take a while ...
The edit lock associated with this edit session is released once the activation is completed.
The node manager for "oid2" is not reachable. Changes will be completed when the node manager is available.
The node manager error is: Connection timed out (Connection timed out). Could not connect to NodeManager. Check that it is running at <etc>.
Traceback (innermost last):
File "<console>", line 1, in ?
File "/u01/fmw/oid/oid/plugins/wlst/oid-wlst-dependencies.jar!/wlstScriptDir/OidCustomCommands.py", line 25, in oid_createInstance
File "/u01/fmw/oid/oid/plugins/wlst/oid-wlst-dependencies.jar/wlstScriptDir/oid_handler.py", line 189, in oid_createOIDInstance
File "/tmp/wlst_module11961866495391520064.py", line 481, in activate
File "/tmp/wlst_module36651586180707788336.py", line 240, in raiseWLSTException
WLSTException: Error occurred while performing activate : Error while Activating changes. : Timed out waiting for completion: Activate State: STATE_DISTRIBUTING Target Servers States: oid2 STATE_DEFERRED
Use dumpStack() to view the full stacktrace :
Tried deleting the oid2 instance, cleaning up the ODS process table and removing /oid2 folders, then recreating it but it hangs for a long time.
Doing control+c and then checking status of oid1 fails with:
wls:/oid/serverConfig/> oid_instanceStatus(instanceName = 'oid1')
Location changed to edit custom tree. This is a writable tree with No root.
For more help, use help('editCustom')
Starting an edit session ...
Started edit session, be sure to save and activate your changes once you are done.
Instance name, Host name, State
==================================
oid1, <hostname1>, RUNNING
==================================
Saving all your changes ...
Traceback (innermost last):
File "<console>", line 1, in ?
File "/u01/fmw/oid/oid/plugins/wlst/oid-wlst-dependencies.jar!/wlstScriptDir/OidCustomCommands.py", line 75, in oid_instanceStatus
File "/u01/fmw/oid/oid/plugins/wlst/oid-wlst-dependencies.jar/wlstScriptDir/oid_handler.py", line 511, in oid_instanceOIDStatus
File "/tmp/wlst_module11746069071578956263.py", line 505, in save
java.lang.RuntimeException: weblogic.management.provider.EditSaveChangesFailedException: Can not save changes while prepare changes are still in progress
at weblogic.utils.StackTraceDisabled.unknownMethod()
Caused by: weblogic.management.provider.EditSaveChangesFailedException: Can not save changes while prepare changes are still in progress
... 1 more
java.lang.RuntimeException: java.lang.RuntimeException: weblogic.management.provider.EditSaveChangesFailedException: Can not save changes while prepare changes are still in progress
wls:/oid/editCustom/oracle.oid.mbeans/oracle.oid.mbeans:type=OIDSystemComponent,name=OIDComponentManager>
wls:/oid/editCustom/oracle.oid.mbeans/oracle.oid.mbeans:type=OIDSystemComponent,name=OIDComponentManager> exit()
You have an edit session open and you will lose all
outstanding changes and your edit session will be stopped if
you exit. Are you sure you would like to exit? (y/n)y
y
Exiting WebLogic Scripting Tool.
Checking status of oid2 hangs:
wls:/oid/serverConfig/> oid_instanceStatus(instanceName = 'oid2')
Location changed to edit custom tree. This is a writable tree with No root.
For more help, use help('editCustom')
Starting an edit session ...
Started edit session, be sure to save and activate your changes once you are done.
Instance name, Host name, State
==================================
oid2, <hostname2>, START
==================================
Saving all your changes ...
Saved all your changes successfully.
Activating all your changes, this may take a while ...
The edit lock associated with this edit session is released once the activation is completed.
Location changed to edit custom tree. This is a writable tree with No root.
For more help, use help('editCustom')
Starting an edit session ...
Started edit session, be sure to save and activate your changes once you are done.
Instance name, Host name, State
==================================
oid2, <hostname2>, START
==================================
Saving all your changes ...
Saved all your changes successfully.
Activating all your changes, this may take a while ...
The edit lock associated with this edit session is released once the activation is completed.
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |