Last updated on NOVEMBER 09, 2016
Applies to:Exadata X3-8 Hardware - Version All Versions and later
Oracle Exadata Hardware - Version 18.104.22.168 and later
Oracle Exadata Storage Server Software - Version 22.214.171.124.2 to 126.96.36.199.1 [Release 11.2]
Exadata Database Machine X2-2 Hardware - Version All Versions and later
Exadata Database Machine V2 - Version All Versions and later
Having a larger value for MTU such as 65520 bytes = 64kb will require more memory pages to support IPoIB, the large frame size is derived from HCA IB Card with driver support at the o/s level. In some cases it may be required to reduce the size of the frame to avoid memory page fragmentation issues.
Value of 65520 bytes would require 18 contiguous memory pages based on a default kernel pagesize.
IP over IB similar to TCP on Ethernet does contain additional packet overhead.
| Infiniband Header | EoIB Encapsulation Header | IPoIB Header | IP DATA |
Lets assume the kernel by default will use a pagesize of 4k, you can verify this value -->
For more in-depth analysis slabinfo can be used.
Sign In with your My Oracle Support account
Don't have a My Oracle Support account? Click to get started
Million Knowledge Articles and hundreds of Community platforms