My Oracle Support Banner

Step 5 of BDA Upgrade Fails with "MySQLSyntaxErrorException: Duplicate column name 'EXTERNAL_ACCOUNT_ID'" (Doc ID 2275585.1)

Last updated on JANUARY 16, 2020

Applies to:

Big Data Appliance Integrated Software - Version 4.5.0 and later
Miracle Linux x86-64


NOTE: In the examples that follow, user details, cluster names, hostnames, directory paths, filenames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner. 

Step 5 of a Mammoth upgrade fails with "MySQLSyntaxErrorException: Duplicate column name 'EXTERNAL_ACCOUNT_ID'". And Cloudera Manager will not start.

In the case here the upgrade was from BDA V4.5 to BDA V4.7.

1. The Mammoth upgrade fails with:

INFO: Step 5: Installing Hadoop Parcel
INFO: Making sure all puppet agents can be accessed.
INFO: Pinging puppet agents
INFO: Starting Cloudera Manager server/agents. This will take some time ...
INFO: Installing Hadoop Parcel. This will take some time ...
INFO: Creating environment.pp file ...
ERROR: Step 5 failed
ERROR: Cannot continue with operation
INFO: Time spent in step 5 InstallHadoop is 1513 seconds.
INFO: Running bdadiagcluster...

2. The associated log shows the error to be:

2017-06-10 02:00:17,625 INFO main:com.cloudera.enterprise.dbutil.DbUtil: Current database schema version: 5900
2017-06-10 02:00:17,731 FATAL main:org.hsqldb.cmdline.SqlFile: SQL Error at 'UTF-8' line 1:
"alter table AUDITS add column EXTERNAL_ACCOUNT_ID bigint"
Duplicate column name 'EXTERNAL_ACCOUNT_ID'
2017-06-10 02:00:17,731 ERROR main:com.cloudera.enterprise.dbutil.SqlFileRunner: Exception while executing ddl scripts.
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column name 'EXTERNAL_ACCOUNT_ID'
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
at java.lang.reflect.Constructor.newInstance(
at com.mysql.jdbc.Util.handleNewInstance(
at com.mysql.jdbc.Util.getInstance(
at com.mysql.jdbc.SQLError.createSQLException(
at com.mysql.jdbc.MysqlIO.checkErrorPacket(
at com.mysql.jdbc.MysqlIO.checkErrorPacket(
at com.mysql.jdbc.MysqlIO.sendCommand(
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(
at com.mysql.jdbc.ConnectionImpl.execSQL(
at com.mysql.jdbc.ConnectionImpl.execSQL(

at com.cloudera.server.cmf.Main.bootstrapSpringContext(
at com.cloudera.server.cmf.Main.<init>(
at com.cloudera.server.cmf.Main.main(
2017-06-10 02:00:17,735 ERROR main:com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean: Unable to upgrade schema to latest version.
java.lang.RuntimeException: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column name 'EXTERNAL_ACCOUNT_ID'
at com.cloudera.enterprise.dbutil.SqlFileRunner.runSqlFile(
at com.cloudera.enterprise.dbutil.SqlScriptRunnerFactory$
at com.cloudera.enterprise.dbutil.SqlScriptRunnerFactory$
at com.cloudera.enterprise.dbutil.SqlScriptRunnerFactory$
at com.cloudera.enterprise.dbutil.DbUtil.runScripts(




To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.