PRCG-1241:RHPCTL fails with "Failed to execute a remote operation on the Rapid Home Provisioning Server"

(Doc ID 2275630.1)

Last updated on JULY 06, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 12.1.0.2 and later
Information in this document applies to any platform.

Symptoms

The "rhpctl add workingcopy -client " is failed as RHP was getting blocked if there is a firewall between the two clusters (RHP server on 12.2.0.1.0 GRID and the RHP client is using 12.1.0.2 another GRID cluster) as the port used for communication was blocked by firewall.

RHPS Output :

[crsusr@rws00fxi:/u01/crshome/bin][0]$ date;./rhpctl add workingcopy -workingcopy wcdb121_rwsak10 -image db121 -oraclebase /scratch/dbhome -path /scratch/dbhome/121/dbhome -user crsusr -client rwsak10 -groups "OSDBA=oinstall,OSOPER=oinstall";date

rws00fxi.us.oracle.com: Option storagetype is set to the following default value: LOCAL.
rws00fxi.us.oracle.com: Adding storage for working copy ...
rws00fxi.us.oracle.com: Storing metadata in repository for working copy "wcdb121_rwsak10" ...
rws00fxi.us.oracle.com: Finding ACFS file system of the image "db121" ...
rws00fxi.us.oracle.com: Creating snapshot ...
rws00fxi.us.oracle.com: Adding export file system for image "wcdb121_rwsak10"
...
rws00fxi.us.oracle.com: Starting export file system...
rws00fxi.us.oracle.com: Connecting to RHPC...
rws00fxi.us.oracle.com: Starting client-side action for 'add workingcopy'... rws00fxi.us.oracle.com: Client-side action completed.
PRCG-1241 : failed to execute a remote operation on the Rapid Home Provisioning Server
PRGO-1558 : Rapid Home Provisioning Server (RHPS) is not reachable.
PRGO-1068 : Failed to connect to Rapid Home Provisioning Server (RHPS)

 RHPC log: 

[UID:-1169149670] [RMI TCP Connection(769)-10.208.149.193]

[ 2017-04-19 07:45:24.644 UTC ] [GHJMXConnector.getConnector:99] IOException: Connection refused to host: 10.208.149.193; nested exception is:java.net.ConnectException: Connection timed out [UID:-1169149670] [RMI TCP Connection(769)-10.208.149.193]

[ 2017-04-19 07:45:24.644 UTC ] [ServerProxy.newInstance:298] ServerProxy.newInstance():Connection refused to host: 10.208.149.193; nested exception is:java.net.ConnectException: Connection timed out [UID:-1169149670] [RMI TCP Connection(769)-10.208.149.193]

[ 2017-04-19 07:45:24.645 UTC ] [ServerProxy.newInstance:309] GHS not reachable:Connection refused to host: 10.208.149.193; nested exception is:
java.net.ConnectException: Connection timed out oracle.cluster.impl.gridhome.client.GHJMXConnector.getConnector(GHJMXConnector .java:100)
oracle.gridhome.impl.operation.ServerProxy.newInstance(ServerProxy.java:281)
oracle.gridhome.impl.operation.ServerProxy.newInstance(ServerProxy.java:338)
oracle.gridhome.impl.operation.GHOperationCommonImpl.connect(GHOperationCommonImpl.java:969)
oracle.gridhome.impl.operation.GHOperationCommonImpl.invokeRHPS(GHOperationCommonImpl.java:4832)
oracle.gridhome.impl.operation.BaseOperationImpl.invokeRHPS(BaseOperationImpl.java:858)
oracle.gridhome.impl.operation.WorkingCopyOperationImpl.addInternalRHPC(WorkingCopyOperationImpl.java:2929)
oracle.gridhome.impl.operation.ClientOperationImpl.addWorkingCopyGHC(ClientOperationImpl.java:510)
oracle.gridhome.impl.mbean.ClientMBeanImpl.addWorkingCopyGHC(ClientMBeanImpl.java:143)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71)
sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275)
javax.management.modelmbean.RequiredModelMBean$4.run(RequiredModelMBean.java:1252)
java.security.AccessController.doPrivileged(Native Method)
java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:76)
javax.management.modelmbean.RequiredModelMBean.invokeMethod(RequiredModelMBean.java:1246)
javax.management.modelmbean.RequiredModelMBean.invoke(RequiredModelMBean.java:1085)
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819)
com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:801)
javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1468)
javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1309) java.security.AccessController.doPrivileged(Native Method)
javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1408)
javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:829)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:324)
sun.rmi.transport.Transport$1.run(Transport.java:200)
sun.rmi.transport.Transport$1.run(Transport.java:197)
java.security.AccessController.doPrivileged(Native Method)
sun.rmi.transport.Transport.serviceCall(Transport.java:196)
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
java.security.AccessController.doPrivileged(Native Method)
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

java.lang.Thread.run(Thread.java:745)
[UID:-1169149670] [RMI TCP Connection(769)-10.208.149.193] [ 2017-04-19
07:45:24.645 UTC ] [GHOperationCommonImpl.connect:980] Operation exception:PRGO-1068 : Failed to connect to Rapid Home Provisioning Server (RHPS)
[UID:-1169149670] [RMI TCP Connection(769)-10.208.149.193]

[ 2017-04-1907:45:24.645 UTC ] [GHOperationCommonImpl.invokeRHPS:4840]OperationException while invoking update WCInfo: PRGO-1558 : Rapid Home Provisioning Server (RHPS) is not reachable.

PRGO-1068 : Failed to connect to Rapid Home Provisioning Server (RHPS) [UID:-1169149670] [RMI TCP Connection(769)-10.208.149.193]

[ 2017-04-19 07:45:24.725 UTC ] [ClientOperationImpl.addWorkingCopyGHC:521] OperationException: PRCG-1241 : failed to execute a remote operation on the Rapid Home Provisioning Server

PRGO-1558 : Rapid Home Provisioning Server (RHPS) is not reachable.
PRGO-1068 : Failed to connect to Rapid Home Provisioning Server (RHPS)

 Query image fails if access RHP Server from RHP Client machine.

/opt/oracle/12.2.0.1/grid/bin/rhpctl query image
PRCG-1241 : failed to execute a remote operation on the Rapid Home Provisioning Server
PRGO-1558 : Rapid Home Provisioning Server (RHPS) is not reachable.
PRGO-1068 : Failed to connect to Rapid Home Provisioning Server (RHPS)

The RHPC service online :

 

Changes

Disabling the firewall , the same command "./rhpctl add workingcopy -workingcopy" succeeds

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms