My Oracle Support Banner

Navigator Metadata Server (beta) not Showing HDFS Source Types in CDH 5.0.1/BDA 3.0.1 with NameNode High Availability (Doc ID 1922368.1)

Last updated on DECEMBER 04, 2014

Applies to:

Big Data Appliance Integrated Software - Version 2.2.1 and later
Linux x86-64

Symptoms

On BDA 3.0.1 with NameNode HA support/CDH 5.0.1 Navigator Metadata Server (beta) does not show the 'hdfs' source type.  To see the issue:

1. Login to the Cloudera Navigator Web UI.

a) Login to the Cloudera Navigator Web UI by:

Navigating to the Navigator Web UI either directly at: http://<Navigator Metadata Server node>.example.com:7187
or
From CM: Home > mgmt > Instances > navigatormetaserver (bdanode<x>) > Navigator Web UI

b) Login to the Cloudera Navigator Web UI with the Cloudera Manager admin username and password.

2. Once logged in to the Cloudera Navigator Web UI, select "query builder"



3. On the sourceType page the available sourceTypes are:

hive
mapreduce
oozie
yarn


There is no sourceType for 'hdfs'.




However the Navigator Documentation for 5.0.1: Cloudera Navigator Metadata Server,  states that the Cloudera Navigator Metadata Server extracts metadata from the services managed by the Cloudera Manager Server. The following resource types are supported:

HDFS - Extracts HDFS metadata at the next scheduled extraction run after an HDFS checkpoint.
   However, if you have High Availability enabled, metadata is extracted as soon as it is written to the JournalNodes.
Hive - Extracts database and table metadata from Hive Metastore Server.
MapReduce - Extracts job metadata from the JobTracker. The default setting in Cloudera Manager retains a maximum of five jobs, which means if you run more than five jobs between Navigator extractions, the Navigator Metadata Server would extract the five most recent jobs.
YARN - Extracts job metadata from the Job History Server.
Oozie - Extracts Oozie workflows from the Oozie Server.
Pig - Extracts Pig script runs from the JobTracker or Job History Server.



Note: On BDA V3.0.1/CDH 5.0.1 NameNode HA is enabled.

2. The Navigator Metaserver logs found on the Navigator Metaserver node under /var/log/cloudera-scm-navigator show a warning like:

WARN com.cloudera.nav.extract.CmExtractorService: Exception while processing CM extractor factory com.cloudera.nav.hdfs.extractor.HdfsExtractorManager

Check for the warning in the Navigator Metaserver logs (on the Navigator Metaserver node) at:

/var/log/cloudera-scm-navigator/mgmt-cmf-mgmt-NAVIGATORMETASERVER-bdanode.example.com.log.out

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.