Sun Fire[TM] 12K/15K/E20K/E25K: Management Networks (MAN)

Last updated on APRIL 04, 2017

Applies to:

Goal

The Sun Fire[TM] 12K/15K/E20K/E25K platform has three distinct networks which together make up the Management (MAN) Network. The three networks are called the I1 Network, the I2 Network, and the Community (C) Network.

The System Controllers (SCs) on these platforms incorporate 22 ethernet interfaces to comprise the MAN network. The type of network interfaces in use depends on which type of SC is in use.

There are two different types of SCs used by these four platforms (the SC board itself is the same, but the SC CPU Board can differ):

• CP1500 (Nordica) - Used only on 12K/15K
• CP2140 (Othello+) - Used on 12K/15K/E20K/E25K

An SC with a CP1500 (Nordica) uses 20 RIO (eri) and two Cheerio (hme) based ethernet interfaces to comprise the MAN network.

An SC with a CP2140 (Othello+) uses 22 RIO (eri) based ethernet interfaces to comprise the MAN network.

These network interfaces are laid out as shown below:

Physical location of Network Interfaces:

• CP1500 hme interfaces are on CP1500 board; all other interfaces are on the SC board
• CP2140 eri0 and eri1 are located on the CP2140 board; all other interfaces are on the SC board.

The three networks which make up the MAN Network are described below:

1. C network - Consisting of two network interfaces connected to the SC front panel providing remote access to the SC. This network is often referred to as the COMMUNITY Network.
2. I1 network - Consisting of 18 separate RIO-based Ethernet interfaces between the SC and each I/O board on the platform. These 18 interfaces provide a highly available, secure network console interface to facilitate communication between a possible 18 domains and the SC. These RIO-based Ethernet chips, providing the repeater function on each I/O board, are only supported to run at half duplex; this network is also referred to as the DMAN network.
3. I2 network - Consisting of two Ethernet interfaces to the other SC to provide heartbeat and SC synchronization mechanism between the MAIN and SPARE SCs. This network is also referred to as the SCMAN network.

Due to limitations in capabilities of certain chips used in the Starcat internal networks, the I1 and I2 network setup must be left at their standard auto-negotiation setup.
The C Network was previously allowed to be tuned. However, design changes in hardware does now disallow any tuning of the C network. It must be set to auto-negotiate on both switch side and on the SC side.

NOTE
Most network equipments, such as switch, have many network tuning parameters.
In other than auto-negotiation environment, all combinations of these parameters are not certified. Some combinations may affect SMS behavior.
Be aware that due to some known features of the eri-driver, setting other then auto-negotiation for the C-network's eri interfaces, will affect the eri interfaces used in the I1 and I2 networks and render these networks unsupported.

Solution