On Oracle Big Data Appliance, Navigator Metadata Server Crashes Frequently (Doc ID 2110221.1)

Last updated on OCTOBER 11, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.3.0 and later
Linux x86-64

Symptoms

On Oracle Big Data Appliance, frequent crashes of Cloudera Navigator Metadata Server (NAVMS) occur and this generates many critical alerts in Cloudera Manager(CM).

In the NAVMS role process stdout.log there are OOM errors ...

# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="/usr/lib64/cmf/service/common/killparent.sh"
# Executing /bin/sh -c "/usr/lib64/cmf/service/common/killparent.sh"...
Mon Feb 22 18:21:43 CET 2016
JAVA_HOME=/usr/java/default
Executing: /usr/java/default/bin/java -server -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=mgmt-cmf-mgmt-NAVIGATORMETASERVER-<BDANode03>.log.out -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -Xms2147483648 -Xmx2147483648 -XX:MaxPermSize=128m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/mgmt_mgmt-NAVIGATORMETASERVER-12f48d3bb68c25c6dc326734ea050feb_pid$$.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh -cp /usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/cloudera-navigator-server/nav-server.jar:/usr/share/cmf/cloudera-navigator-server/jars/*:/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar -Dlog4j.configuration=file:///var/run/cloudera-scm-agent/process/2188-cloudera-mgmt-NAVIGATORMETASERVER/log4j.properties -Dnavigator.auditModels.dir=/usr/share/cmf/cloudera-navigator-audit-server/auditModels com.cloudera.nav.server.NavServer /var/run/cloudera-scm-agent/process/2188-cloudera-mgmt-NAVIGATORMETASERVER/cloudera-navigator.properties /var/run/cloudera-scm-agent/process/2188-cloudera-mgmt-NAVIGATORMETASERVER/cloudera-navigator-cm-auth.properties /var/run/cloudera-scm-agent/process/2188-cloudera-mgmt-NAVIGATORMETASERVER/db.navms.properties


And the current heap space settings for NAVMS seems to be -Xms2147483648 equals to 2G.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms