A server running Oracle Linux 6 and adclient service exoerienced a sudden load spike

(Doc ID 2389051.1)

Last updated on APRIL 26, 2018

Applies to:

Linux OS - Version Oracle Linux 6.0 and later
Information in this document applies to any platform.

Symptoms

The server experienced a sudden extremely high load spike, with the following call trace logged to /var/log./messages:

Mar 3 21:25:11 localhost kernel: BUG: soft lockup - CPU#1 stuck for 68s! [adclient:1734]
Mar 3 21:25:15 localhost kernel: Modules linked in: nfs lockd fscache auth_rpcgss nfs_acl sunrpc ppdev microcode vmware_balloon parport_pc parport sg i2c_piix4 i2
c_core shpchp ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom vmxnet3 mptspi mptscsih mptbase scsi_transport_spi pata_acpi ata_generic ata_piix dm_mirror dm_region_has
h dm_log dm_mod [last unloaded: scsi_wait_scan]
Mar 3 21:25:17 localhost kernel: CPU 1
Mar 3 21:25:17 localhost kernel: Modules linked in: nfs lockd fscache auth_rpcgss nfs_acl sunrpc ppdev microcode vmware_balloon parport_pc parport sg i2c_piix4 i2
c_core shpchp ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom vmxnet3 mptspi mptscsih mptbase scsi_transport_spi pata_acpi ata_generic ata_piix dm_mirror dm_region_has
h dm_log dm_mod [last unloaded: scsi_wait_scan]
Mar 3 21:25:17 localhost kernel:
Mar 3 21:25:17 localhost kernel: Pid: 1734, comm: adclient Not tainted 2.6.32-573.3.1.el6.x86_64 #1 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference P
latform
Mar 3 21:25:17 localhost kernel: RIP: 0010:[] [] neigh_update+0x0/0x540
Mar 3 21:25:17 localhost kernel: RSP: 0000:ffff88002f623c18 EFLAGS: 00010a03
Mar 3 21:25:17 localhost kernel: RAX: 00000003abeedcaa RBX: ffff88002f623ce0 RCX: 0000000000000001
Mar 3 21:25:17 localhost kernel: RDX: 0000000000000002 RSI: ffff8801069d8838 RDI: ffff880236802e80
Mar 3 21:25:17 localhost kernel: RBP: ffffffff8100bc13 R08: ffff880236802e80 R09: ffff8801069d8838
Mar 3 21:25:17 localhost kernel: R10: ffff88002f623d88 R11: ffff880235b64020 R12: ffff88002f623b90
Mar 3 21:25:17 localhost kernel: R13: ffff8802358a2800 R14: ffff88002f623b90 R15: ffffffff815425a5
Mar 3 21:25:17 localhost kernel: FS: 00007fae52dca700(0000) GS:ffff88002f620000(0000) knlGS:0000000000000000
Mar 3 21:25:17 localhost kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 3 21:25:17 localhost kernel: CR2: 00007f042d4aa008 CR3: 000000023a05f000 CR4: 00000000000007e0
Mar 3 21:25:17 localhost kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 3 21:25:17 localhost kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 3 21:25:17 localhost kernel: Process adclient (pid: 1734, threadinfo ffff88023a0c8000, task ffff880238906ab0)
Mar 3 21:25:17 localhost kernel: Stack:
Mar 3 21:25:17 localhost kernel: ffffffff814d2ea3 ffffffff81677a80 ffff88002f630688 ffff88002f623c90
Mar 3 21:25:17 localhost kernel: ffff88002f630680 ffff88002f623c50 ffff880236802e80 ffff8802358a2800
Mar 3 21:25:17 localhost kernel: d2c8b00ad6c8b00a ffff8802369190c0 0028c443580b10d6 0028c44358145984
Mar 3 21:25:17 localhost kernel: Call Trace:
Mar 3 21:25:17 localhost kernel:
Mar 3 21:25:17 localhost kernel: [] ? arp_process+0x343/0x790
Mar 3 21:25:17 localhost kernel: [] ? arp_rcv+0x111/0x140
Mar 3 21:25:17 localhost kernel: [] ? __netif_receive_skb+0x208/0x570
Mar 3 21:25:17 localhost kernel: [] ? netif_receive_skb+0x58/0x60
Mar 3 21:25:17 localhost kernel: [] ? vmxnet3_rq_rx_complete+0x3a2/0x8c0 [vmxnet3]
Mar 3 21:25:17 localhost kernel: [] ? swiotlb_map_page+0x0/0x100
Mar 3 21:25:17 localhost kernel: [] ? vmxnet3_poll_rx_only+0x43/0xc0 [vmxnet3]
Mar 3 21:25:17 localhost kernel: [] ? net_rx_action+0x103/0x2f0

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms