Oracle Big Data Appliance Port Numbers for BDA V3.*/CDH 5.* and Higher Client/Edge Servers (Doc ID 1909282.1)

Last updated on MARCH 24, 2017

Applies to:

Big Data Appliance Hardware - Version All Versions and later
Big Data Appliance Integrated Software - Version 3.0 and later
x86_64

Goal

The goal is to identify the port numbers you will need to be aware of for configuring a BDA V3.*/CDH 5.* client/edge server.

The port numbers you will need to be aware of for CDH 5 can be found in the Cloudera documentation: "Configuring Ports for Cloudera Manager".

A list is also included in the Oracle Big Data Appliance Software User's Guide Release 3 (3.0) Section on: Port Numbers Used on Oracle Big Data Appliance.

Two Cloudera blogs with additional information are:

Migrating to MapReduce 2 on YARN (For Operators)  and  Migrating to MapReduce 2 on YARN (For Users).

From the blogs additional internal CDH 5.* ports are:

8030 internal ResourceManager Scheduler RPC (for ApplicationMasters)
8033 internal ResourceManager Admin RPC
8031 internal ResourceManager Resource Tracker RPC (for NodeManagers)
8040 internal NodeManager Localizer RPC
10020 internal Job History RPC
13562 internal Shuffle HTTP

 
The list of ports included in the above documentation includes those for Cloudera Manager, CDH components, managed servcies and other components included with BDA V3.*.  Note that generally the same hold for BDA V3.* and higher.

When setting up a CDH client/edge server:
1.  The ports for the components you are using must be open.
2.  In the case of a firewall, like iptables, the firewall will need to be disabled as needed for the required ports.

Note: These ports are open by default on BDA servers.

Solution

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms