How to Change MTU Size in Exadata Environment
(Doc ID 1586212.1)
Last updated on APRIL 14, 2022
Applies to:Oracle Exadata Hardware - Version 18.104.22.168 and later
Oracle Exadata Storage Server Software - Version 22.214.171.124.2 to 126.96.36.199.1 [Release 11.2]
Exadata Database Machine X2-2 Hardware - Version All Versions and later
Exadata Database Machine V2 - Version All Versions and later
Exadata X3-2 Hardware - Version All Versions and later
Having a larger value for MTU such as 65520 bytes = 64kb will require more memory pages to support IPoIB, the large frame size is derived from HCA IB Card with driver support at the o/s level. In some cases it may be required to reduce the size of the frame to avoid memory page fragmentation issues.
Value of 65520 bytes would require 18 contiguous memory pages based on a default kernel pagesize.
IP over IB similar to TCP on Ethernet does contain additional packet overhead.
| Infiniband Header | IPoIB Header | IP DATA |
Lets assume the kernel by default will use a pagesize of 4k, you can verify this value -->
For more in-depth analysis slabinfo can be used.
To view full details, sign in with your My Oracle Support account.
Don't have a My Oracle Support account? Click to get started!