Upgrading BDA V4.4 to V4.8 Fails on Step 6 with: "Bigdatasql::Bigdatasqlsetup/Exec[bd_cell_cleanup]/returns) change from notrun to 0 failed: Command exceeded timeout" (Doc ID 2270573.1)

Last updated on MAY 29, 2017

Applies to:

Big Data Appliance Integrated Software - Version 4.4.0 and later
Linux x86-64

Symptoms

Step 6 of a BDA V4.4 to V4.8 upgrade with Big Data SQL installed fails with the output below on one or more nodes of the cluster:

Error [7826]: (//bdanode0x.domain.com//Stage[main]/Bigdatasql::Bigdatasqlsetup/Exec[bd_cell_cleanup]/returns)
change from notrun to 0 failed: Command exceeded timeout

INFO: Also check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bdanode0x-<timestamp>.log

1. The log file: in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bdanode0x-<timestamp>.log, reports output like:

May 26 00:36:10 bdanode0x puppet-master[7826]: (//bdanode0x.domain.com./Puppet) Command exceeded timeout
May 26 00:36:10 bdanode0x puppet-master[7826]: (//bdanode0x.domain.com/Puppet) Wrapped exception:
May 26 00:36:10 bdanode0x puppet-master[7826]: (//bdanode0x.domain.com/Puppet) execution expired
May 26 00:36:10 bdanode0x puppet-master[7826]: (//bdanode0x.domain.com//
Stage[main]/Bigdatasql::Bigdatasqlsetup/Exec[bd_cell_cleanup]/returns)
change from notrun to 0 failed: Command exceeded timeout
May 26 00:36:10 bdanode0x puppet-master[7826]: (//bdanode0x.domain.com//
Stage[main]/Bigdatasql::Bigdatasqlsetup/Exec[bd_cell_postinstall])
Dependency Exec[bd_cell_cleanup] has failures: true

2. The associated bdcellcleanup.out files on the failing node(s) show output like below:

# more ./bdadiagcluster_bdanode0x_<#>/tmp/bdcellcleanup.out

Stopping the BDSQLRS, BDSQLSRV and BDSQLMS services...
BDS-01513: CellCLI request to Restart Server (RS) has timed out.
The SHUTDOWN of ALL services was not successful. Error: Unknown Error
Getting the state of BDSQLSRV services... BDS-01513: CellCLI request to Restart Server (RS
) has timed out.
stopped
Getting the state of BDSQLMS services... BDS-01513: CellCLI request to Restart Server (RS)
has timed out.
stopped
Getting the state of BDSQLRS services... BDS-01513: CellCLI request to Restart Server (RS)
has timed out.
stopped
Force kill bdsql processes

Note: In the example here Big Data SQL 2.0 was installed.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms