Ping to the Server with Slow Response with Hundreds of Milliseconds (Doc ID 2690116.1)

Last updated on JULY 18, 2020

Applies to:

Linux OS - Version Oracle Linux 7.4 and later
Linux x86-64

Symptoms

Server with intermittent ping slow response of hundreds of milliseconds from other server Server Linux version is 3.10.0-1062.4.1.el7.x86_64.

64 bytes from xx.xx.xx.xx: icmp_seq=403 ttl=58 time=0.096 ms
64 bytes from xx.xx.xx.xx: icmp_seq=404 ttl=58 time=644 ms
64 bytes from xx.xx.xx.xx: icmp_seq=405 ttl=58 time=0.099 ms
64 bytes from xx.xx.xx.xx: icmp_seq=406 ttl=58 time=0.099 ms
64 bytes from xx.xx.xx.xx: icmp_seq=407 ttl=58 time=0.096 ms
64 bytes from xx.xx.xx.xx: icmp_seq=408 ttl=58 time=0.103 ms
64 bytes from xx.xx.xx.xx: icmp_seq=409 ttl=58 time=0.093 ms
64 bytes from xx.xx.xx.xx: icmp_seq=410 ttl=58 time=0.100 ms
64 bytes from xx.xx.xx.xx: icmp_seq=411 ttl=58 time=0.112 ms
64 bytes from xx.xx.xx.xx: icmp_seq=412 ttl=58 time=0.113 ms
64 bytes from xx.xx.xx.xx: icmp_seq=413 ttl=58 time=0.101 ms
64 bytes from xx.xx.xx.xx: icmp_seq=414 ttl=58 time=0.104 ms
64 bytes from xx.xx.xx.xx: icmp_seq=415 ttl=58 time=0.098 ms

From /var/log/messages, call trace is shown

Jun 23 16:35:07 hostname kernel: CPU: 10 PID: 58 Comm: watchdog/10 Tainted: G W L ------------ T 3.10.0-1062.4.1.el7.x86_64 #1
Jun 23 16:35:07 hostname kernel: Hardware name: New H3C Technologies Co., Ltd. UniServer R4900 G3/RS33M2C9SA, BIOS 1.00.44P01 11/22/2018
Jun 23 16:35:07 hostname kernel: task: ffff8e93f5db5230 ti: ffff8e93f5dd8000 task.ti: ffff8e93f5dd8000
Jun 23 16:35:07 hostname kernel: RIP: 0010:[<ffffffffac781125>] [<ffffffffac781125>] _raw_spin_unlock_irqrestore+0x15/0x20
Jun 23 16:35:07 hostname kernel: RSP: 0018:ffff8ec23ee831b8 EFLAGS: 00000257
Jun 23 16:35:07 hostname kernel: RAX: ffff8ec1ffdae618 RBX: ffff8e93f5565000 RCX: 0000000000000001
Jun 23 16:35:07 hostname kernel: RDX: 0000000000000001 RSI: 0000000000000257 RDI: 0000000000000257
Jun 23 16:35:07 hostname kernel: RBP: ffff8ec23ee831b8 R08: 0000000000000101 R09: ffffffffac5f2993
Jun 23 16:35:07 hostname kernel: R10: 0000000fff23161d R11: 0000000000000066 R12: ffff8ec23ee83128
Jun 23 16:35:07 hostname kernel: R13: ffffffffac78cefa R14: ffff8ec23ee831b8 R15: 0000000000000000
Jun 23 16:35:07 hostname kernel: FS: 0000000000000000(0000) GS:ffff8ec23ee80000(0000) knlGS:0000000000000000
Jun 23 16:35:07 hostname kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 23 16:35:07 hostname kernel: CR2: 000000c4b65fb318 CR3: 0000000113a10000 CR4: 00000000007607e0
Jun 23 16:35:07 hostname kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jun 23 16:35:07 hostname kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Jun 23 16:35:07 hostname kernel: PKRU: 00000000
Jun 23 16:35:07 hostname kernel: Call Trace:
Jun 23 16:35:07 hostname kernel: <IRQ>
Jun 23 16:35:07 hostname kernel: [<ffffffffac5f2ab3>] alloc_iova+0x153/0x180
Jun 23 16:35:07 hostname kernel: [<ffffffffac5f379b>] alloc_iova_fast+0x4b/0xb0
Jun 23 16:35:07 hostname kernel: [<ffffffffac5ff25f>] intel_alloc_iova+0xaf/0xe0
Jun 23 16:35:07 hostname kernel: [<ffffffffac603ad7>] __intel_map_single+0x97/0x160
Jun 23 16:35:07 hostname kernel: [<ffffffffac603bd3>] intel_map_page+0x33/0x40
Jun 23 16:35:07 hostname kernel: [<ffffffffc06df543>] ixgbevf_xmit_frame+0x353/0xb20 [ixgbevf]
Jun 23 16:35:07 hostname kernel: [<ffffffffac64d346>] dev_hard_start_xmit+0x246/0x3b0
Jun 23 16:35:07 hostname kernel: [<ffffffffac67b0ba>] sch_direct_xmit+0x11a/0x250
Jun 23 16:35:07 hostname kernel: [<ffffffffac67b27e>] __qdisc_run+0x8e/0x360
Jun 23 16:35:07 hostname kernel: [<ffffffffac650038>] __dev_queue_xmit+0x218/0x650
Jun 23 16:35:07 hostname kernel: [<ffffffffac650480>] dev_queue_xmit+0x10/0x20
Jun 23 16:35:07 hostname kernel: [<ffffffffc06b5d62>] bond_dev_queue_xmit+0x32/0x80 [bonding]
Jun 23 16:35:07 hostname kernel: [<ffffffffc06b6e5e>] bond_start_xmit+0x1be/0x420 [bonding]
Jun 23 16:35:07 hostname kernel: [<ffffffffac64d346>] dev_hard_start_xmit+0x246/0x3b0
Jun 23 16:35:07 hostname kernel: [<ffffffffac650339>] __dev_queue_xmit+0x519/0x650
Jun 23 16:35:07 hostname kernel: [<ffffffffc071fe48>] ? __nf_ct_refresh_acct+0x78/0xd0 [nf_conntrack]
Jun 23 16:35:07 hostname kernel: [<ffffffffac650480>] dev_queue_xmit+0x10/0x20
Jun 23 16:35:07 hostname kernel: [<ffffffffc0684da5>] vlan_dev_hard_start_xmit+0x95/0x120 [8021q]
Jun 23 16:35:07 hostname kernel: [<ffffffffac64d346>] dev_hard_start_xmit+0x246/0x3b0
Jun 23 16:35:07 hostname kernel: [<ffffffffac650339>] __dev_queue_xmit+0x519/0x650
Jun 23 16:35:07 hostname kernel: [<ffffffffc072a7e4>] ? nf_ct_deliver_cached_events+0xb4/0x110 [nf_conntrack]
Jun 23 16:35:07 hostname kernel: [<ffffffffac679d5b>] ? eth_header+0x2b/0xd0
Jun 23 16:35:07 hostname kernel: [<ffffffffac650480>] dev_queue_xmit+0x10/0x20
Jun 23 16:35:07 hostname kernel: [<ffffffffac65d299>] neigh_connected_output+0xb9/0x100
Jun 23 16:35:07 hostname kernel: [<ffffffffac69e57c>] ip_finish_output+0x27c/0x8d0
Jun 23 16:35:07 hostname kernel: [<ffffffffac69eefb>] ip_output+0x7b/0xf0
Jun 23 16:35:07 hostname kernel: [<ffffffffac69e300>] ? __ip_append_data.isra.50+0xa60/0xa60
Jun 23 16:35:07 hostname kernel: [<ffffffffac69c927>] ip_local_out_sk+0x37/0x40
Jun 23 16:35:07 hostname kernel: [<ffffffffac69ca92>] ip_build_and_send_pkt+0x162/0x250
Jun 23 16:35:07 hostname kernel: [<ffffffffac6bfab4>] tcp_v4_send_synack+0x74/0xd0
Jun 23 16:35:07 hostname kernel: [<ffffffffac631e68>] ? sk_reset_timer+0x18/0x30
Jun 23 16:35:07 hostname kernel: [<ffffffffac6b59c1>] tcp_rtx_synack+0x41/0x70
Jun 23 16:35:07 hostname kernel: [<ffffffffac30af9e>] ? selinux_socket_sock_rcv_skb+0x7e/0x250
Jun 23 16:35:07 hostname kernel: [<ffffffffac6a452d>] inet_rtx_syn_ack+0x1d/0x30
Jun 23 16:35:07 hostname kernel: [<ffffffffac6c1189>] tcp_check_req+0x239/0x5b0
Jun 23 16:35:07 hostname kernel: [<ffffffffac6bee5f>] tcp_v4_do_rcv+0x22f/0x350
Jun 23 16:35:07 hostname kernel: [<ffffffffac6c044c>] tcp_v4_rcv+0x7dc/0x9e0
Jun 23 16:35:07 hostname kernel: [<ffffffffac69886d>] ip_local_deliver_finish+0xbd/0x200
Jun 23 16:35:07 hostname kernel: [<ffffffffac698b60>] ip_local_deliver+0x60/0xe0
Jun 23 16:35:07 hostname kernel: [<ffffffffac6987b0>] ? ip_rcv_finish+0x370/0x370
Jun 23 16:35:07 hostname kernel: [<ffffffffac6984d0>] ip_rcv_finish+0x90/0x370
Jun 23 16:35:07 hostname kernel: [<ffffffffac698ea0>] ip_rcv+0x2c0/0x420
Jun 23 16:35:07 hostname kernel: [<ffffffffac698440>] ? inet_del_offload+0x40/0x40
Jun 23 16:35:07 hostname kernel: [<ffffffffac64dbd9>] __netif_receive_skb_core+0x729/0xa10
Jun 23 16:35:07 hostname kernel: [<ffffffffac105e2f>] ? __getnstimeofday64+0x3f/0xd0
Jun 23 16:35:07 hostname kernel: [<ffffffffac64ded8>] __netif_receive_skb+0x18/0x60
Jun 23 16:35:07 hostname kernel: [<ffffffffac64df60>] netif_receive_skb_internal+0x40/0xc0
Jun 23 16:35:07 hostname kernel: [<ffffffffac64ebe8>] napi_gro_receive+0xd8/0x100
Jun 23 16:35:07 hostname kernel: [<ffffffffc06de134>] ixgbevf_clean_rx_irq+0x314/0x850 [ixgbevf]
Jun 23 16:35:07 hostname kernel: [<ffffffffc06e1589>] ixgbevf_poll+0x379/0x6f0 [ixgbevf]
Jun 23 16:35:07 hostname kernel: [<ffffffffac64e57f>] net_rx_action+0x26f/0x390
Jun 23 16:35:07 hostname kernel: [<ffffffffac0a42c5>] __do_softirq+0xf5/0x280
Jun 23 16:35:07 hostname kernel: [<ffffffffac78f42c>] call_softirq+0x1c/0x30
Jun 23 16:35:07 hostname kernel: [<ffffffffac02f715>] do_softirq+0x65/0xa0
Jun 23 16:35:07 hostname kernel: [<ffffffffac0a4645>] irq_exit+0x105/0x110
Jun 23 16:35:07 hostname kernel: [<ffffffffac059129>] smp_call_function_single_interrupt+0x39/0x40
Jun 23 16:35:07 hostname kernel: [<ffffffffac78e1aa>] call_function_single_interrupt+0x16a/0x170
Jun 23 16:35:07 hostname kernel: <EOI>
Jun 23 16:35:07 hostname kernel: [<ffffffffac0d3fe7>] ? finish_task_switch+0x57/0x1c0
Jun 23 16:35:07 hostname kernel: [<ffffffffac77e568>] __schedule+0x448/0x9c0
Jun 23 16:35:07 hostname kernel: [<ffffffffac035c19>] ? sched_clock+0x9/0x10
Jun 23 16:35:07 hostname kernel: [<ffffffffac77eb09>] schedule+0x29/0x70
Jun 23 16:35:07 hostname kernel: [<ffffffffac0cdb82>] smpboot_thread_fn+0xe2/0x1a0
Jun 23 16:35:07 hostname kernel: [<ffffffffac0cdaa0>] ? lg_double_unlock+0x40/0x40
Jun 23 16:35:07 hostname kernel: [<ffffffffac0c51b1>] kthread+0xd1/0xe0
Jun 23 16:35:07 hostname kernel: [<ffffffffac0c50e0>] ? insert_kthread_work+0x40/0x40
Jun 23 16:35:07 hostname kernel: [<ffffffffac78bd1d>] ret_from_fork_nospec_begin+0x7/0x21
Jun 23 16:35:07 hostname kernel: [<ffffffffac0c50e0>] ? insert_kthread_work+0x40/0x40

Cause

	To view full details, sign in with your My Oracle Support account.
	Don't have a My Oracle Support account? Click to get started!

In this Document

Symptoms

Cause

Solution

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.

Ping to the Server with Slow Response with Hundreds of Milliseconds (Doc ID 2690116.1)

Applies to:

Symptoms

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!