My Oracle Support Banner

Upgrade to BDA V4.4 Fails at Step 6 with AuditVault Enabled if the Backing AV Server is Not Up (Doc ID 2104640.1)

Last updated on DECEMBER 26, 2019

Applies to:

Big Data Appliance Integrated Software - Version 4.4.0 and later
Linux x86-64

Symptoms

NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.

During upgrade to BDA V4.4 on a cluster with the AVDF plugin enabled, step 6 (Installing the BDA Software) fails as below:

************************************
Error [13201]: (//<HOSTNAME1>.<DOMAIN>//Stage[main]/Auditvault::Avsetup/Exec[avsetup]/returns) change from notrun
to 0 failed: /sbin/runuser -l -s /bin/bash -c "/opt/oracle/BDAMammoth/bdaconfig/tmp/avsetup.sh" oracle &> /opt/oracle/BDAMammoth/bdaconfig/tmp/avsetup_<TIMESTAMP>.out returned 1 instead of one of [0]
Error [13201]: (//<HOSTNAME1>.<DOMAIN>//Stage[main]/Auditvault::Avsetup/Exec[set_loglevel_debug_script]/returns)
change from notrun to 0 failed: /opt/oracle/BDAMammoth/bdaconfig/tmp/setlogleveldebug_script.sh &>
/opt/oracle/BDAMammoth/bdaconfig/tmp/setlogleveldebug_script_<TIMESTAMP>.out returned 1
instead of one of [0]
************************************

From the error above:

1. /opt/oracle/BDAMammoth/bdaconfig/tmp/avsetup_<TIMESTAMP>.out on Node 1 shows:

>AVCLI> ERROR:
>Exception occurred while getting connection: oracle.ucp.UniversalConnectionPoolException: Cannot get Connection from Datasource: >java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection
>AVCLI> ERROR:
>OAV-3006: not connected
full output:
++ basename /opt/oracle/bda/bin/OraAuditVaultBdaHadoopDeployPlugin.sh
+ prg=OraAuditVaultBdaHadoopDeployPlugin.sh
+ erc=0
+ avsecuredtargettype='Oracle BDA Hadoop Cluster'
+ jsonselect=json-select
+ uninstall=false
+ avpluginid=<DOMAIN>.av.plugin.bda
+ '[' '' = - ']'
++ pwd
+ '[' /var/lib/oracle/AV '!=' /var/lib/oracle/AV ']'
+ '[' '!' -w /var/lib/oracle/AV ']'
+ read_parameters
+ read avsadmin
+ read avspasswd
+ read avahost
+ read avsecuredtarget
+ read avsserver
+ read avsport
+ read avsservice
+ '[' -z avadmin ']'
+ '[' -z <HOSTNAME1> ']'
++ json-select --jpx=BDADEPLOY/SERVERS/ADMIN_NETWORK/NAME --index-of-str=<HOSTNAME1> --deploy
+ avahostidx=
+ '[' '' ']'
+ '[' -z '' ']'
++ json-select --jpx=BDADEPLOY/SERVERS/CLIENT_NETWORK/NAME --index-of-str=<HOSTNAME1> --deploy
+ avahostidx=4
+ '[' -z 4 ']'
++ json-select '--jpx=BDADEPLOY/SERVERS[4]/CLIENT_NETWORK/IP' --deploy
+ avahostip=*.*.*.*
+ '[' -z *.*.*.* ']'
+ '[' false = false ']'
+ '[' -x bin/avcli ']'
+ break
+ PATH=./bin:/usr/lib64/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/loc
al/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/oracle/bda/bin:/usr/li
b/oracle/12.1/client64/bin:/usr/java/default/bin:/home/oracle/bin
++ which avcli
+ '[' -z /var/lib/oracle/AV/bin/avcli ']'
++ avcli
++ grep Release
++ cut '-d ' -f4
++ cut -d. -f1-3
+ av_version=12.2.0
+ case "$av_version" in
+ '[' false = false ']'
+ echo 'OraAuditVaultBdaHadoopDeployPlugin.sh: registering host +<HOSTNAME1>+ w
ith ip +*.*.*.*+'
OraAuditVaultBdaHadoopDeployPlugin.sh: registering host +<HOSTNAME1>+ with ip +
*.*.*.*+
+ avcli

AVCLI : Release 12.2.0.0.0 - Production on Fri Feb 5 17:15:22 PST 2016

Copyright (c) 1996, 2015 Oracle. All Rights Reserved.

AVCLI> ERROR:
Exception occurred while getting connection: oracle.ucp.UniversalConnectionPool
Exception: Cannot get Connection from Datasource: java.sql.SQLRecoverableException:
IO Error: The Network Adapter could not establish the connection

AVCLI> ERROR:
OAV-3006: not connected

AVCLI> + avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>av.plugin.bda avlst29945.out
+ echo 'OraAuditVaultBdaHadoopDeployPlugin.sh: deploy bda-plugin'
OraAuditVaultBdaHadoopDeployPlugin.sh: deploy bda-plugin
+ avcli

AVCLI : Release 12.2.0.0.0 - Production on Fri Feb 5 17:15:47 PST 2016

Copyright (c) 1996, 2015 Oracle. All Rights Reserved.

AVCLI> ERROR:
Exception occurred while getting connection: oracle.ucp.UniversalConnectionPoolException: Cannot get Connection from Datasource: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection

AVCLI> ERROR:
OAV-3006: not connected

AVCLI> + for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ for i in 1 2 3 4 5 6 7 8 9 10
+ sleep 10
+ avcli
OAV-3006: not connected
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ fgrep -q <DOMAIN>.av.plugin.bda avlst-r29945.out
+ echo '/opt/oracle/bda/bin/OraAuditVaultBdaHadoopDeployPlugin.sh: Failed to ins
tall av bda hadoop plugin'
/opt/oracle/bda/bin/OraAuditVaultBdaHadoopDeployPlugin.sh: Failed to install av
bda hadoop plugin
+ exit 1

2. /opt/oracle/BDAMammoth/bdac

onfig/tmp/setlogleveldebug_script_1454717922.out shows:

API Version used is
Error : No output returned
Failed. Full error log in : /opt/oracle/BDAMammoth/bdaconfig/tmp/clusters_<CLUSTER_NAME>_services_hdfs_roleConfigGroups_hdfs-NAMENODE-BASE_config_<TIMESTAMP>.err

3./opt/oracle/BDAMammoth/bdaconfig/tmp/clusters_<CLUSTER_NAME>_services_hdfs_roleConfigGroups_hdfs-NAMENODE BASE_config_<TIMESTAMP>.err shows:

curl: (7) couldn't connect to host

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.