Navigator Metadata Server (beta) not Showing HDFS Source Types in CDH 5.0.1/BDA 3.0.1 with NameNode High Availability
Last updated on DECEMBER 04, 2014
Applies to:Big Data Appliance Integrated Software - Version 2.2.1 and later
On BDA 3.0.1 with NameNode HA support/CDH 5.0.1 Navigator Metadata Server (beta) does not show the 'hdfs' source type. To see the issue:
1. Login to the Cloudera Navigator Web UI.
a) Login to the Cloudera Navigator Web UI by:
Navigating to the Navigator Web UI either directly at: http://<Navigator Metadata Server node>.example.com:7187
From CM: Home > mgmt > Instances > navigatormetaserver (bdanode<x>) > Navigator Web UI
b) Login to the Cloudera Navigator Web UI with the Cloudera Manager admin username and password.
2. Once logged in to the Cloudera Navigator Web UI, select "query builder"
3. On the sourceType page the available sourceTypes are:
There is no sourceType for 'hdfs'.
However the Navigator Documentation for 5.0.1: Cloudera Navigator Metadata Server, states that the Cloudera Navigator Metadata Server extracts metadata from the services managed by the Cloudera Manager Server. The following resource types are supported:
However, if you have High Availability enabled, metadata is extracted as soon as it is written to the JournalNodes.
Hive - Extracts database and table metadata from Hive Metastore Server.
MapReduce - Extracts job metadata from the JobTracker. The default setting in Cloudera Manager retains a maximum of five jobs, which means if you run more than five jobs between Navigator extractions, the Navigator Metadata Server would extract the five most recent jobs.
YARN - Extracts job metadata from the Job History Server.
Oozie - Extracts Oozie workflows from the Oozie Server.
Pig - Extracts Pig script runs from the JobTracker or Job History Server.
Note: On BDA V3.0.1/CDH 5.0.1 NameNode HA is enabled.
2. The Navigator Metaserver logs found on the Navigator Metaserver node under /var/log/cloudera-scm-navigator show a warning like:
Check for the warning in the Navigator Metaserver logs (on the Navigator Metaserver node) at:
Sign In with your My Oracle Support account
Don't have a My Oracle Support account? Click to get started
My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms