nxge tuning with maximum RX / TX ring tuning may result in DMA allocation errors on Solaris 11 (Doc ID 1564053.1)

Last updated on DECEMBER 11, 2015

Applies to:

Solaris SPARC Operating System - Version 11 11/11 and later
Oracle Solaris on SPARC (64-bit)
Oracle Solaris on x86-64 (64-bit)

Symptoms

Attempts to maximize nxge RX or TX ring resources with:

     set nxge:nxge_tx_ring_size=8192
     set nxge:nxge_rbr_size=2048

tuning in /etc/system may fail on Solaris 11, due to the configuration exceeding pre-allocated driver memory limits.    

Should this happen, not all nxge interfaces will be available.  Attempts to plumb one or more interfaces will fail with messages similar to:

   <hostname> nxge: [ID 752849 kern.warning] WARNING: nxge9 : ==> nxge_alloc_rx_buf_dma: not enough for channel 15 allocated 0x9d8000 requested 0x1000000
   <hostname> nxge: [ID 752849 kern.warning] WARNING: nxge9 : ==> nxge_alloc_rx_buf_dma: not enough for channel 15 allocated 0x9d8000 requested 0x1000000
   <hostname> nxge: [ID 752849 kern.warning] WARNING: nxge9 : <== nxge_init_rxdma: status 0x40000000
   <hostname> nxge: [ID 752849 kern.warning] WARNING: nxge9 : <== nxge_init_rxdma: status 0x40000000
   <hostname> nxge: [ID 752849 kern.warning] WARNING: nxge9 : nxge_grp_dc_add(15): channel init failed
   <hostname> nxge: [ID 752849 kern.warning] WARNING: nxge9 : nxge_grp_dc_add(15): channel init failed
 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms