My Oracle Support Banner

Oracle Linux: RDS/IB Driver Cannot Allocate DMA Memory Causing CRS Restart (Doc ID 2483719.1)

Last updated on JUNE 01, 2020

Applies to:

Linux OS - Version Oracle Linux 6.9 and later
Linux x86-64

Symptoms


CRS restarted due to difficulty during RDS/IB driver allocating DMA memory.  The /var/log/messages system log shows:

Oct 30 00:44:07 hostname kernel: [3998290.936313] RDS/IB: connection <192.168.xx.22,192.168.xx.30,0> dropped due to 'qp event'
Oct 30 00:44:07 hostname kernel: [3998290.936329] RDS/IB: connection <192.168.xx.22,192.168.xx.30,0> dropped due to 'recv completion error'
Oct 30 00:44:52 hostname kernel: [3998335.574578] kworker/u224:2: page allocation failure: order:4, mode:0xd0 Oct 30 00:44:52 hostname kernel: [3998335.574583] CPU: 3 PID: 317151 Comm: kworker/u224:2 Tainted: P O 4.1.12-94.8.4.el6uek.x86_64 #2
Oct 30 00:44:52 hostname kernel: [3998335.574585] Hardware name: Oracle Corporation ORACLE SERVER X7-2/ASM, MB, X7-2, BIOS 41021500 03/21/2018
Oct 30 00:44:52 hostname kernel: [3998335.574603] Workqueue: rdma_cm cma_work_handler [rdma_cm]
Oct 30 00:44:52 hostname kernel: [3998335.574605] 0000000000000000 ffff8813677ff998 ffffffff816a9634 00000000000000d0
Oct 30 00:44:52 hostname kernel: [3998335.574607] 0000000000000004 ffff8813677ffa28 ffffffff8118d608 0000000000000040
Oct 30 00:44:52 hostname kernel: [3998335.574609] 0000000000000004 0000000000000040 ffff88ab9009d400 00000000000000d0
Oct 30 00:44:52 hostname kernel: [3998335.574612] Call Trace:
Oct 30 00:44:52 hostname kernel: [3998335.574617] [] dump_stack+0x63/0x81
Oct 30 00:44:52 hostname kernel: [3998335.574621] [] warn_alloc_failed+0xd8/0x140
Oct 30 00:44:52 hostname kernel: [3998335.574625] [] ? __alloc_pages_direct_compact+0x46/0x100
Oct 30 00:44:52 hostname kernel: [3998335.574628] [] __alloc_pages_nodemask+0x36e/0xaa0
Oct 30 00:44:52 hostname kernel: [3998335.574634] [] dma_generic_alloc_coherent+0x14f/0x1c0
Oct 30 00:44:52 hostname kernel: [3998335.574640] [] x86_swiotlb_alloc_coherent+0x21/0x50
Oct 30 00:44:52 hostname kernel: [3998335.574647] [] rds_ib_setup_qp+0x7df/0x910 [rds_rdma]
Oct 30 00:44:52 hostname kernel: [3998335.574653] [] ? rds_ib_match_acl+0x150/0x150 [rds_rdma]
Oct 30 00:44:52 hostname kernel: [3998335.574658] [] rds_ib_cm_initiate_connect+0x89/0x200 [rds_rdma]
Oct 30 00:44:52 hostname kernel: [3998335.574668] [] ? mlx4_ib_poll_cq+0xbb/0x1f0 [mlx4_ib]
Oct 30 00:44:52 hostname kernel: [3998335.574673] [] rds_rdma_cm_event_handler+0x92f/0xaf0 [rds_rdma]
Oct 30 00:44:52 hostname kernel: [3998335.574678] [] cma_work_handler+0x71/0xa0 [rdma_cm]
Oct 30 00:44:52 hostname kernel: [3998335.574680] [] process_one_work+0x161/0x490
Oct 30 00:44:52 hostname kernel: [3998335.574683] [] worker_thread+0x5b/0x540
Oct 30 00:44:52 hostname kernel: [3998335.574686] [] ? rescuer_thread+0x380/0x380
Oct 30 00:44:52 hostname kernel: [3998335.574688] [] kthread+0xcb/0xf0
Oct 30 00:44:52 hostname kernel: [3998335.574691] [] ? kthread_create_on_node+0x180/0x180
Oct 30 00:44:52 hostname kernel: [3998335.574695] [] ret_from_fork+0x42/0x90
Oct 30 00:44:52 hostname kernel: [3998335.574697] [] ? kthread_create_on_node+0x180/0x180
Oct 30 00:44:52 hostname kernel: [3998335.574753] Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 3*64kB (U) 0*128kB 1*256kB (U) 0*512kB 1*1024kB (U) 2*2048kB (UR) 2*4096kB (M) = 13784kB
Oct 30 00:44:52 hostname kernel: [3998335.574765] Node 0 DMA32: 8*4kB (M) 7*8kB (UM) 6*16kB (M) 5*32kB (UM) 2*64kB (M) 6*128kB (M) 6*256kB (M) 7*512kB (M) 6*1024kB (UM) 4*2048kB (MR) 285*4096kB (UMR) = 1188056kB
Oct 30 00:44:52 hostname kernel: [3998335.574778] Node 0 Normal: 177832*4kB (UEM) 141359*8kB (UEM) 6771369*16kB (UEM) 28443*32kB (UEM) 400*64kB (UEM) 206*128kB (EM) 87*256kB (UM) 26*512kB (M) 0*1024kB 0*2048kB 1*4096kB (R) = 111185928kB

Changes

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Changes
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.