My Oracle Support Banner

How to Change MTU Size in Exadata Environment (Doc ID 1586212.1)

Last updated on FEBRUARY 23, 2024

Applies to:

Exadata Database Machine X2-2 Hardware - Version All Versions and later
Exadata Database Machine V2 - Version All Versions and later
Exadata X3-2 Hardware - Version All Versions and later
Exadata Database Machine X2-8 - Version All Versions and later
Oracle Database - Enterprise Edition - Version 11.2.0.4 to 11.2.0.4 [Release 11.2]
Linux x86-64

Goal

Having a larger value for MTU such as 65520 bytes = 64kb will require more memory pages to support IPoIB, the large frame size is derived from HCA IB Card with driver support at the o/s level. In some cases it may be required to reduce the size of the frame to avoid memory page fragmentation issues.

Value of 65520 bytes would require 18 contiguous memory pages based on a default kernel pagesize.


IP over IB similar to TCP on Ethernet does contain additional packet overhead.

IPoIB Packet Frame consists of -->

 | Infiniband Header | IPoIB Header |  IP DATA |



Lets assume the kernel by default will use a pagesize of 4k, you can verify this value -->



For more in-depth analysis slabinfo can be used.

Solution

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.