EM12c: PL/SQL Notifications Backlog is Increasing, Resulting in Alert for "Pending Notifications Count" (Doc ID 2091480.1)

Last updated on JANUARY 26, 2016

Applies to:

Enterprise Manager Base Platform - Version 12.1.0.1.0 to 12.1.0.5.0 [Release 12.1]
Information in this document applies to any platform.

Symptoms

In the 12c Console, it was found that the Notification backlog graph is gradually increasing in the Setup -> Manage Cloud Control -> Health Overview page.
Custom thresholds had been set for the 'Pending Notifications Count' metric of the Management Services and Repository target and below notification was received for the same:

Target type=OMS and Repository 
Target name=Management Services and Repository 
Categories=Load 
Message=71 notifications are waiting to be processed, crossed warning (50) or critical (75) threshold. 
Severity=Warning 
Event reported time=Mar 17, 2015 1:32:34 PM EDT 
Operating System=Linux
Platform=x86_64
Event Type=Metric Alert 
Event name=NotifPerformance:pending_notif_count 
Metric Group=Notification Delivery Performance
Metric=Pending Notifications Count
Metric value=71
Key Value=PLSQL
Key Column 1=Notification Method


- The pending notifications were seen only for the PL/SQL notification method.

-  The <gc_inst>/em/EMGC_OMS1/sysman/log/emoms_pbs.trc reported below exception:

2015-06-03 11:59:07,494 [DeliveryThread-PLSQL1] WARN notification.pbs
logp.251 - Delivery.run: java.lang.NullPointerException
java.lang.NullPointerException
at
oracle.sysman.core.pbs.notification.PLSQLContent.getGCNotifContextARRAY(PLSQLContent.java:421)
at
oracle.sysman.core.pbs.notification.PLSQLContent.getGCNotifEventPayloadSTRUCT(PLSQLContent.java:211)
at
oracle.sysman.core.pbs.notification.PLSQLContent.getGCNotifEventMsgSTRUCT(PLSQLContent.java:117)


This was causing the PL/SQL notifications to be re-tried causing the notification backlog.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms