Upgrade to BDA V4.4 Fails at Step 6 with AuditVault Enabled if the Backing AV Server is Not Up (Doc ID 2104640.1)

Last updated on FEBRUARY 08, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.4.0 and later
Linux x86-64

Symptoms

During upgrade to BDA V4.4 on a cluster with the AVDF plugin enabled, step 6 (Installing the BDA Software)
fails as below:

************************************
Error [13201]: (//bdanode01.example.com//Stage[main]/Auditvault::Avsetup/Exec[avsetup]/returns) change from notrun
to 0 failed: /sbin/runuser -l -s /bin/bash -c "/opt/oracle/BDAMammoth/bdaconfig/tmp/avsetup.sh" oracle &> /opt/oracle/BDAMammoth/bdaconfig/tmp/avsetup_1454717922.out returned 1 instead of one of [0]
Error [13201]: (//bdanode01.example.com//Stage[main]/Auditvault::Avsetup/Exec[set_loglevel_debug_script]/returns)
change from notrun to 0 failed: /opt/oracle/BDAMammoth/bdaconfig/tmp/setlogleveldebug_script.sh &>
/opt/oracle/BDAMammoth/bdaconfig/tmp/setlogleveldebug_script_1454717922.out returned 1
instead of one of [0]
************************************

From the error above:

1. /opt/oracle/BDAMammoth/bdaconfig/tmp/avsetup_1454717922.out on Node 1 shows:

>AVCLI> ERROR:
>Exception occurred while getting connection: oracle.ucp.UniversalConnectionPoolException: Cannot get Connection from Datasource: >java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection
>AVCLI> ERROR:
>OAV-3006: not connected
full output:
++ basename /opt/oracle/bda/bin/OraAuditVaultBdaHadoopDeployPlugin.sh
+ prg=OraAuditVaultBdaHadoopDeployPlugin.sh
+ erc=0
+ avsecuredtargettype='Oracle BDA Hadoop Cluster'
+ jsonselect=json-select
+ uninstall=false
+ avpluginid=com.oracle.av.plugin.bda
+ '[' '' = - ']'
++ pwd
+ '[' /var/lib/oracle/AV '!=' /var/lib/oracle/AV ']'
+ '[' '!' -w /var/lib/oracle/AV ']'
+ read_parameters
+ read avsadmin
+ read avspasswd
+ read avahost
+ read avsecuredtarget
+ read avsserver
+ read avsport
+ read avsservice
+ '[' -z avadmin ']'
+ '[' -z bdanode01 ']'
++ json-select --jpx=BDADEPLOY/SERVERS/ADMIN_NETWORK/NAME --index-of-str=bdanode01 --deploy
+ avahostidx=
+ '[' '' ']'
+ '[' -z '' ']'
++ json-select --jpx=BDADEPLOY/SERVERS/CLIENT_NETWORK/NAME --index-of-str=bdanode01 --deploy
+ avahostidx=4
+ '[' -z 4 ']'
++ json-select '--jpx=BDADEPLOY/SERVERS[4]/CLIENT_NETWORK/IP' --deploy
+ avahostip=*.*.*.*
+ '[' -z *.*.*.* ']'
+ '[' false = false ']'
+ '[' -x bin/avcli ']'
+ break
+ PATH=./bin:/usr/lib64/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/loc
al/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/oracle/bda/bin:/usr/li
b/oracle/12.1/client64/bin:/usr/java/default/bin:/home/oracle/bin
++ which avcli
+ '[' -z /var/lib/oracle/AV/bin/avcli ']'
++ avcli
++ grep Release
++ cut '-d ' -f4
++ cut -d. -f1-3
+ av_version=12.2.0
+ case "$av_version" in
+ '[' false = false ']'
+ echo 'OraAuditVaultBdaHadoopDeployPlugin.sh: registering host +bdanode01+ w
ith ip +*.*.*.*+'
OraAuditVaultBdaHadoopDeployPlugin.sh: registering host +bdanode01+ with ip +
*.*.*.*+
+ avcli

AVCLI : Release 12.2.0.0.0 - Production on Fri Feb 5 17:15:22 PST 2016

Copyright (c) 1996, 2015 Oracle. All Rights Reserved.

AVCLI> ERROR:
Exception occurred while getting connection: oracle.ucp.UniversalConnectionPoolE
xception: Cannot get Connection from Datasource: java.sql.SQLRecoverableExceptio
n: IO Error: The Network Adapter could not establish the connection

AVCLI> ERROR:
OAV-3006: not connected

AVCLI> + avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst29945.out
+ echo 'OraAuditVaultBdaHadoopDeployPlugin.sh: deploy bda-plugin'
OraAuditVaultBdaHadoopDeployPlugin.sh: deploy bda-plugin
+ avcli

AVCLI : Release 12.2.0.0.0 - Production on Fri Feb 5 17:15:47 PST 2016

Copyright (c) 1996, 2015 Oracle. All Rights Reserved.

AVCLI> ERROR:
Exception occurred while getting connection: oracle.ucp.UniversalConnectionPoolException: Cannot get Connection from Datasource: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection

AVCLI> ERROR:
OAV-3006: not connected

AVCLI> + for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ fgrep -q com.oracle.av.plugin.bda avlst-r29945.out
+ echo '/opt/oracle/bda/bin/OraAuditVaultBdaHadoopDeployPlugin.sh: Failed to ins
tall av bda hadoop plugin'
/opt/oracle/bda/bin/OraAuditVaultBdaHadoopDeployPlugin.sh: Failed to install av
bda hadoop plugin
+ exit 1

2. /opt/oracle/BDAMammoth/bdac

onfig/tmp/setlogleveldebug_script_1454717922.out shows:

API Version used is
Error : No output returned
Failed. Full error log in : /opt/oracle/BDAMammoth/bdaconfig/tmp/clusters_<cluster-name>_services_hdfs_roleConfigGroups_hdfs-NAMENODE-BASE_config_1454721566.err

3./opt/oracle/BDAMammoth/bdaconfig/tmp/clusters_<cluster-name>_services_hdfs_roleConfigGroups_hdfs-NAMENODE BASE_config_1454721566.err shows:

curl: (7) couldn't connect to host

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms