12c Notifications: Email Notification is not Sent and OMS Restarts due to "Notification Delivery error: EMAIL DELIVERY is hung" (Doc ID 1515510.1)

Last updated on OCTOBER 16, 2014

Applies to:

Enterprise Manager Base Platform - Version 12.1.0.1.0 to 12.1.0.2.0 [Release 12.1]
Information in this document applies to any platform.

Symptoms

In the Cloud Console, Incident ruleset / rule has been configured for sending email notifications to administrators when certain conditions occur. Sometimes the email notifications are sent but sometimes they are not.
-  When the notification is not sent, accessing event details for which notification was expected from Monitoring -> Incident Manager page and clicking on the 'Updates' tab shows an entry such as:

The following notifications will be sent: 1 email(s) with 1 recipient(s)

but the next annotation for the actual Rule which is supposed to send the notification is never updated.

-  The Setup -> Manage Cloud Control -> Health Overview page shows that the 'Notification Backlog' is increasing gradually.

-  If the OMS is re-started, all the pending email notifications are received.

-  The <gc_inst>/em/EMGC_OMS1/sysman/log/emoms_pbs.trc shows:

2012-12-19 01:03:08,290 [HealthMonitor] WARN  healthMonitor.HealthMonitor doWork.454 - HealthMonitor : Found errant task : TaskRegn:ID2883,Callback:class oracle.sysman.core.pbs.notification.Delivery,Iterative:true,Duration:3600,DueTime:1355850188289:Callback Details:oracle.sysman.core.pbs.notification.Delivery@60bea71
2012-12-19 01:03:08,291 [HealthMonitor] ERROR notification.pbs logp.251 - EMAIL DELIVERY is hung, its execution exceeded 3600 seconds time limit for queue=EMAIL3, device_id=0, ruleset_name=Database Availability and Critical States, rule_name=Database Availability and Critical States, rule_owner=SYSMAN. Restarting OMS ...
2012-12-19 01:03:08,305 [HealthMonitor] ERROR healthMonitor.HealthMonitor executeCommand.959 - HealthMonitor : Executing diagnostic command for module omsThread. Dec 19, 2012 1:03:08 AM  

Changes

While OMS is attempting to send the email to the SMTP server,  At this time, if connection can be established to the SMTP server then the notifications will be sent out. it could be hung while establishing a connection or sending the content to the email gateway, due to network and/or email gateway issues. If the hang lasts longer than 1 hour, OMS is automatically bounced to recover

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms