My Oracle Support Banner

Connection Errors: 'probe_con_ping_em probe -x does not answer ping' and 'probe_con_check_impairment x live and 0 halted connections for probe x, Reporting this as Impairment' (Doc ID 2082465.1)

Last updated on SEPTEMBER 05, 2017

Applies to:

Oracle Communications Session Monitor - Version 3.3.90 and later
Information in this document applies to any platform.

Symptoms

There can be two symptoms seen, both or just one of them.

1) APID (process to which the OCSM Probes connect to) errors in syslog data (of Mediation Engine) similar to below:

2015-10-18T16:09:24.496561+00:00 ocsm apid: CRITICAL  (probe_con.c:1310 probe_con_ping_em) probe -1 does not answer ping
2015-10-18T16:09:25.002170+00:00 ocsm apid: ERROR  (probe_con.c:1175 probe_con_check_impairment) 32 live and 0 halted connections for probe 1, reporting this as impairment.
2015-10-18T16:09:25.002497+00:00 ocsm apid: ERROR  (probe_con.c:1175 probe_con_check_impairment) 23 live and 0 halted connections for probe 2, reporting this as impairment.
2015-10-18T16:09:25.002766+00:00 ocsm apid: ERROR  (probe_con.c:1175 probe_con_check_impairment) 21 live and 0 halted connections for probe 3, reporting this as impairment.

 

2) The Web GUI is not available, i.e. getting a 500 error or the Web Page will not load. 

If you are unable to access the Web GUI, but you have access to the shell you may review the 'netstat -nap' output and 'syslog' data in order to confirm the relation of point 2 to the point 1 symptom (there might be other reason for the web unavailability - i.e. failure on web server).

The 'netstat -nap' output would show many connections in the SYN_RECV and CLOSE_WAIT status for the same IP. Please see the sample (showing only few lines snippet, in this sample the ME's IP is 10.10.1.2, the other one is from the Probe):

 tcp 0 0 10.10.1.2:4741 10.11.1.9:50751 SYN_RECV
 tcp 0 0 10.10.1.2:4741 10.11.1.9:49834 SYN_RECV
 tcp 0 0 10.10.1.2:4741 10.11.1.9:51312 SYN_RECV
 tcp 0 0 10.10.1.2:4741 10.11.1.9:51168 SYN_RECV
 tcp 0 0 10.10.1.2:4741 10.11.1.9:50983 SYN_RECV
 tcp 0 0 10.10.1.2:4741 10.11.1.9:49874 SYN_RECV
 tcp 0 0 10.10.1.2:4741 10.11.1.9:50711 SYN_RECV

  
The 'syslog' (in directory /var/log/) output on the ME would show many error messages similar to the ones in point 1.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.