On BDA V4.6/CDH 5.8.0 the Navigator Metadata Server Unexpectedly Exits Due to OutOfMemory Errors and Raises "java.lang.IllegalStateException: EndPoint1 EntityType must not be null unless unlinked" (Doc ID 2214590.1)

Last updated on DECEMBER 19, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.6.0 to 4.6.0 [Release 4.6]
Linux x86-64

Symptoms

On BDA V4.6/CDH 5.8.0 the Navigator Metadata Server unexpectedly exits due to OutOfMemory errors.

The Navigator Server log shows a lot of Errors like:

2016-11-23 14:05:28,850 ERROR com.cloudera.nav.hdfs.client.InotifyClient [CDHExecutor-0-CDHUrlClassLoader@***]:
Error handling event (txid: xxx): Renamed /hbase/data/test/images/***/tmp/*** to
/hbase/data/test/images/***/tmp/*** at time <timestamp>
2016-11-23 14:05:28,859 ERROR com.cloudera.nav.hdfs.client.InotifyClient [CDHExecutor-0-CDHUrlClassLoader@***]:
Error handling event (txid: yyy): Renamed /hbase/data/test/images/***/tmp/*** to
/hbase/archive/data/test/images/***/tmp/*** at time <timestamp>
2016-11-23 14:05:28,862 ERROR com.cloudera.nav.hdfs.client.InotifyClient [CDHExecutor-0-CDHUrlClassLoader@***]:
Error handling event (txid: zzz): Renamed /hbase/data/test/images/***/tmp/*** to
/hbase/archive/data/test/images/***/tmp/*** at time <timestamp>

 

Additionally the Navigator Server log also shows exceptions like below. These do not appear related to heap exhaustion:

java.lang.IllegalStateException: EndPoint2 EntityType must not be null unless unlinked
at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
at com.cloudera.nav.core.model.Relation.validate(Relation.java:287)
at com.cloudera.nav.persist.impl.RelationManagerImpl.toSolrInputDocument(RelationManagerImpl.java:137)
at com.cloudera.nav.persist.impl.RelationManagerImpl.toSolrInputDocument(RelationManagerImpl.java:63)
at com.cloudera.nav.persist.impl.AbstractSolrManager.persist(AbstractSolrManager.java:549)
at com.cloudera.nav.persist.impl.AbstractSolrManager.persist(AbstractSolrManager.java:542)
at com.cloudera.nav.hdfs.extractor.HdfsOperationHandler.save(HdfsOperationHandler.java:562)
at com.cloudera.nav.hdfs.extractor.HdfsOperationHandler.createParentChildRelation(HdfsOperationHandler.java:558)
at com.cloudera.nav.hdfs.extractor.HdfsOperationHandler.rename(HdfsOperationHandler.java:292)
at com.cloudera.nav.hdfs.client.InotifyClient.handleRenameEvent(InotifyClient.java:247)
at com.cloudera.nav.hdfs.client.InotifyClient.handleEvent(InotifyClient.java:115)
at com.cloudera.nav.hdfs.client.InotifyClient.doImport(InotifyClient.java:63)
at com.cloudera.nav.hdfs.client.InotifyExtractor.doImport(InotifyExtractor.java:34)
at com.cloudera.nav.hdfs.extractor.HdfsExtractorShim$2.run(HdfsExtractorShim.java:253)
at com.cloudera.nav.hdfs.extractor.HdfsExtractorShim$2.run(HdfsExtractorShim.java:250)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
at com.cloudera.cmf.cdh5client.security.UserGroupInformationImpl.doAs(UserGroupInformationImpl.java:41)
at com.cloudera.nav.hdfs.extractor.HdfsExtractorShim.doImport(HdfsExtractorShim.java:250)
at com.cloudera.nav.hdfs.extractor.HdfsExtractorShim.doExtraction(HdfsExtractorShim.java:228)
...

2016-11-24 08:45:06,371 ERROR com.cloudera.nav.hdfs.client.InotifyClient [CDHExecutor-0-CDHUrlClassLoader@***]:
Error handling event (txid: zzz): Renamed /hbase/data/testanalytics/subscribers/***/t/*** to
/hbase/archive/data/testanalytics/subscribers/***/t/*** at time <timestamp>
java.lang.IllegalStateException: EndPoint1 EntityType must not be null unless unlinked
at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
at com.cloudera.nav.core.model.Relation.validate(Relation.java:285)
at com.cloudera.nav.persist.impl.RelationManagerImpl.toSolrInputDocument(RelationManagerImpl.java:137)
at com.cloudera.nav.persist.impl.RelationManagerImpl.toSolrInputDocument(RelationManagerImpl.java:63)
at com.cloudera.nav.persist.impl.AbstractSolrManager.persist(AbstractSolrManager.java:549)
at com.cloudera.nav.persist.impl.AbstractSolrManager.persist(AbstractSolrManager.java:542)
at com.cloudera.nav.hdfs.extractor.HdfsOperationHandler.linkRenamedEntity(HdfsOperationHandler.java:426)
at com.cloudera.nav.hdfs.extractor.HdfsOperationHandler.rename(HdfsOperationHandler.java:289)
at com.cloudera.nav.hdfs.client.InotifyClient.handleRenameEvent(InotifyClient.java:247)

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms