Mammoth 2.0.1 Install Fails at Step 14 with Error "Command Exceeded Timeout"
(Doc ID 1522797.1)
Last updated on AUGUST 03, 2021
Applies to:
Big Data Appliance Integrated Software - Version 2.0.1 and laterLinux x86-64
Symptoms
NOTE: In the examples that follow, user details, table name, company name, email, hostnames, images, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.
Mammoth version 2.0.1 install fails at Step 14 with the following errors:
INFO: Step 14 InstallBDASoftware
INFO: Acquiring run lock ...
INFO: Creating nodelist files...
INFO: Creating environment.pp file ...
INFO: Making sure all puppet agents can be accessed.
INFO: Pinging puppet agents
INFO: Installing BDA software on cluster. This will take some time ...
INFO: Puppet script successfully sent to node bda01node01
INFO: Puppet script successfully sent to node bda01node02
INFO: Puppet script successfully sent to node bda01node03
INFO: Puppet script successfully sent to node bda01node04
INFO: Puppet script successfully sent to node bda01node05
INFO: Puppet script successfully sent to node bda01node06
INFO: Puppet script successfully sent to node bda01node07
INFO: Puppet script successfully sent to node bda01node08
INFO: Puppet script successfully sent to node bda01node09
INFO: Puppet script successfully sent to node bda01node10
INFO: Puppet script successfully sent to node bda01node11
INFO: Puppet script successfully sent to node bda01node12
INFO: Puppet script successfully sent to node bda01node13
INFO: Puppet script successfully sent to node bda01node14
INFO: Puppet script successfully sent to node bda01node15
INFO: Puppet script successfully sent to node bda01node16
INFO: Puppet script successfully sent to node bda01node17
INFO: Puppet script successfully sent to node bda01node18
INFO: Pinging puppet agents
INFO: Puppet agent run on node bda01node01 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node01-20130123114834.log
ERROR: Puppet agent run on node bda01node02 had errors. List of errors follows
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[deploykvstore]/returns) change from notrun to 0 failed: Command exceeded timeout at /opt/oracle/BDAMammoth/puppet/modules/nosqldb/manifests/nsdbsetup.pp:127INFO: Also check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node02-20130123114834.log
INFO: Puppet agent run on node bda01node03 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node03-20130123114834.log
INFO: Puppet agent run on node bda01node04 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node04-20130123114834.log
INFO: Puppet agent run on node bda01node05 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node05-20130123114834.log
INFO: Puppet agent run on node bda01node06 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node06-20130123114834.log
INFO: Puppet agent run on node bda01node07 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node07-20130123114834.log
INFO: Puppet agent run on node bda01node08 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node08-20130123114834.log
INFO: Puppet agent run on node bda01node09 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node09-20130123114834.log
INFO: Puppet agent run on node bda01node10 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node10-20130123114834.log
INFO: Puppet agent run on node bda01node11 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node11-20130123114834.log
INFO: Puppet agent run on node bda01node12 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node12-20130123114834.log
INFO: Puppet agent run on node bda01node13 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node13-20130123114834.log
INFO: Puppet agent run on node bda01node14 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node14-20130123114834.log
INFO: Puppet agent run on node bda01node15 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node15-20130123114834.log
INFO: Puppet agent run on node bda01node16 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node16-20130123114834.log
INFO: Puppet agent run on node bda01node17 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node17-20130123114834.log
INFO: Puppet agent run on node bda01node18 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node18-20130123114834.log
ERROR: Puppet script had errors.
ERROR: unable to continue with install until errors are fixed #Step 14#
INFO: Time spent in step 14 InstallBDASoftware is 439 seconds.
Exiting...
INFO: Acquiring run lock ...
INFO: Creating nodelist files...
INFO: Creating environment.pp file ...
INFO: Making sure all puppet agents can be accessed.
INFO: Pinging puppet agents
INFO: Installing BDA software on cluster. This will take some time ...
INFO: Puppet script successfully sent to node bda01node01
INFO: Puppet script successfully sent to node bda01node02
INFO: Puppet script successfully sent to node bda01node03
INFO: Puppet script successfully sent to node bda01node04
INFO: Puppet script successfully sent to node bda01node05
INFO: Puppet script successfully sent to node bda01node06
INFO: Puppet script successfully sent to node bda01node07
INFO: Puppet script successfully sent to node bda01node08
INFO: Puppet script successfully sent to node bda01node09
INFO: Puppet script successfully sent to node bda01node10
INFO: Puppet script successfully sent to node bda01node11
INFO: Puppet script successfully sent to node bda01node12
INFO: Puppet script successfully sent to node bda01node13
INFO: Puppet script successfully sent to node bda01node14
INFO: Puppet script successfully sent to node bda01node15
INFO: Puppet script successfully sent to node bda01node16
INFO: Puppet script successfully sent to node bda01node17
INFO: Puppet script successfully sent to node bda01node18
INFO: Pinging puppet agents
INFO: Puppet agent run on node bda01node01 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node01-20130123114834.log
ERROR: Puppet agent run on node bda01node02 had errors. List of errors follows
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[deploykvstore]/returns) change from notrun to 0 failed: Command exceeded timeout at /opt/oracle/BDAMammoth/puppet/modules/nosqldb/manifests/nsdbsetup.pp:127INFO: Also check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node02-20130123114834.log
INFO: Puppet agent run on node bda01node03 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node03-20130123114834.log
INFO: Puppet agent run on node bda01node04 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node04-20130123114834.log
INFO: Puppet agent run on node bda01node05 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node05-20130123114834.log
INFO: Puppet agent run on node bda01node06 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node06-20130123114834.log
INFO: Puppet agent run on node bda01node07 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node07-20130123114834.log
INFO: Puppet agent run on node bda01node08 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node08-20130123114834.log
INFO: Puppet agent run on node bda01node09 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node09-20130123114834.log
INFO: Puppet agent run on node bda01node10 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node10-20130123114834.log
INFO: Puppet agent run on node bda01node11 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node11-20130123114834.log
INFO: Puppet agent run on node bda01node12 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node12-20130123114834.log
INFO: Puppet agent run on node bda01node13 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node13-20130123114834.log
INFO: Puppet agent run on node bda01node14 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node14-20130123114834.log
INFO: Puppet agent run on node bda01node15 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node15-20130123114834.log
INFO: Puppet agent run on node bda01node16 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node16-20130123114834.log
INFO: Puppet agent run on node bda01node17 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node17-20130123114834.log
INFO: Puppet agent run on node bda01node18 completed successfully.
INFO: Check the log file in /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node18-20130123114834.log
ERROR: Puppet script had errors.
ERROR: unable to continue with install until errors are fixed #Step 14#
INFO: Time spent in step 14 InstallBDASoftware is 439 seconds.
Exiting...
The log file shows the following:
# cat /opt/oracle/BDAMammoth/bdaconfig/tmp/pagent-bda01node02-20130123114834.log
Jan 23 11:48:40 bda01node01 puppet-master[25994]: Compiled catalog for bda01node02.example.com in environment production in 0.99 seconds
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]//Node[default]/File_with_backup[mapred-site.xml]/File[mapred-site.xml]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]//Yumrepo[bda]/baseurl) baseurl changed 'http://bda01node01.example.com/bda' to 'http://bda01node01-master.example.com/bda'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Olh/Package[orahdfs]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Package[kv-ce]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kv_link]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File_with_backup[nsdbservice]/File[nsdbservice]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Package[rcuintegration]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Package[odiagent]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odi_agent_svc]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File_with_backup[mysqlodi]/File[mysqlodi]/ensure) defined content as '{md5}e802c499454597434c1e4fdcccee274f'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odi_hadoop_env]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Exec[odi_master_pwd]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Exec[odi_supervisor_pwd]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odiagent_params]/content) content changed '{md5}bcf5ec1b97ab29822a322d88370101f2' to '{md5}eb4aec5e5442acdf1c06f2be6109b8c9'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odiagent_params]/mode) mode changed '744' to '755'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odi_log_dir]/mode) mode changed '755' to '775'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Olh/Package[oraloader]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Oracler/Exec[install_orhc]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[pingscript]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kvroot]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[makebootconfig]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Service[startagent]/ensure) ensure changed 'stopped' to 'running'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[pingallagents]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kvscript]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kvplansscript]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[deploykvstore]/returns) change from notrun to 0 failed: Command exceeded timeout at /opt/oracle/BDAMammoth/puppet/modules/nosqldb/manifests/nsdbsetup.pp:127
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[repos_params]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com/Puppet) Finished catalog run in 379.71 seconds
Jan 23 11:48:40 bda01node01 puppet-master[25994]: Compiled catalog for bda01node02.example.com in environment production in 0.99 seconds
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]//Node[default]/File_with_backup[mapred-site.xml]/File[mapred-site.xml]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]//Yumrepo[bda]/baseurl) baseurl changed 'http://bda01node01.example.com/bda' to 'http://bda01node01-master.example.com/bda'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Olh/Package[orahdfs]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Package[kv-ce]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kv_link]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File_with_backup[nsdbservice]/File[nsdbservice]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Package[rcuintegration]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Package[odiagent]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odi_agent_svc]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File_with_backup[mysqlodi]/File[mysqlodi]/ensure) defined content as '{md5}e802c499454597434c1e4fdcccee274f'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odi_hadoop_env]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Exec[odi_master_pwd]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/Exec[odi_supervisor_pwd]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odiagent_params]/content) content changed '{md5}bcf5ec1b97ab29822a322d88370101f2' to '{md5}eb4aec5e5442acdf1c06f2be6109b8c9'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odiagent_params]/mode) mode changed '744' to '755'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[odi_log_dir]/mode) mode changed '755' to '775'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Olh/Package[oraloader]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Oracler/Exec[install_orhc]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[pingscript]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kvroot]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[makebootconfig]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Service[startagent]/ensure) ensure changed 'stopped' to 'running'
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[pingallagents]/returns) executed successfully
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kvscript]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/File[kvplansscript]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Nosqldb::Nsdbsetup/Exec[deploykvstore]/returns) change from notrun to 0 failed: Command exceeded timeout at /opt/oracle/BDAMammoth/puppet/modules/nosqldb/manifests/nsdbsetup.pp:127
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com//Stage[main]/Odi::Odisetup/File[repos_params]/ensure) created
Jan 23 11:55:00 bda01node01 puppet-master[25994]: (//bda01node02.example.com/Puppet) Finished catalog run in 379.71 seconds
Changes
This occurred by installing Mammoth version 2.0.1 after Mammoth version 1.0.3 was installed previously. The version 2.0.1 image was also installed prior to running Mammoth 2.0.1.
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |