My Oracle Support Banner

EM 13c: OS Command Notification Method is Invoked Multiple times by the OMS (Doc ID 2391500.1)

Last updated on APRIL 19, 2023

Applies to:

Enterprise Manager Base Platform - Version 13.2.0.0.0 and later
Information in this document applies to any platform.

Symptoms

In 13c EM setup, OS command notification method has been configured. Internally the OS script invokes mailx program and sends emails to the required recipients.
However the OS script is invoked multiple times by the OMS, resulting in the mailx program sending multiple emails to the users.

The <gc_inst>/em/EMGC_OMS1/sysman/log/emoms_pbs.trc shows the below exceptions:

2017-09-18 12:47:07,572 [DeliveryThread-OSCMD3] WARN notification.pbs logp.251 - Delivery.run: java.lang.StringIndexOutOfBoundsException: String index out of range: 512
Deliver to 212605228, send_email_to_SN_OG, 79; issue type: 1; notification type: 1Event: Event Name: problemTbsp:pctUsed
Event Class: metric_alert
Severity: Critical (CR)
Processsing status: NEW_SEQ
Display Timezone: GMT
Reported Date: Mon Sep 18 12:46:59 UTC 2017
Auto Close: true
Open: YesIncident ID: 597723A19FE248F7E053EBC2E50A5C27
Processing Priority: 1023
RCA Correlation State: Complete
RCA Root-Cause: false
.............
Dec 31 00:00:00 UTC 2099, processing_priority = 1023, processing_hints = null, Status = ISSUE_NEW --
SourceInfo = {(0)=[ONNSPD01:TARGET:CA86EC11DF4945FC0062B97B92145037] TargetInfo = {(0)=[ORCL:oracle_database:CA86EC11DF4945FC0062B97B92145037] } currentAnnotations list size = 1
perfData map size = 4
lastProcessedSeverityCode = CRITICAL

java.lang.StringIndexOutOfBoundsException: String index out of range: 512
at java.lang.String.substring(String.java:1907)
at oracle.sysman.core.common.notification.OSCommand.readOutputIfAvailable(OSCommand.java:286)
at oracle.sysman.core.common.notification.OSCommand.system(OSCommand.java:230)
at oracle.sysman.core.pbs.notification.Delivery.deliverNotification(Delivery.java:752)
at oracle.sysman.core.pbs.notification.Delivery.run(Delivery.java:267)
at oracle.sysman.util.threadPoolManager.WorkerThread.run(Worker.java:311)
2017-09-18 12:47:08,928 [DeliveryThread-OSCMD3] WARN notification.pbs logp.251 - Delivery.run: java.lang.StringIndexOutOfBoundsException: String index out of range: 512
Deliver to 212605228, send_email_to_SN_OG, 79; issue type: 1; notification type: 1Event: Event Name: problemTbsp:pctUsed
Event Class: metric_alert
Severity: Critical (CR)
Processsing status: NEW_SEQ
Display Timezone: GMT
Reported Date: Mon Sep 18 12:46:59 UTC 2017
Auto Close: true
Open: YesIncident ID: 597723A19FE248F7E053EBC2E50A5C27
...............
at oracle.sysman.core.common.notification.OSCommand.system(OSCommand.java:230)
at oracle.sysman.core.pbs.notification.Delivery.deliverNotification(Delivery.java:752)
at oracle.sysman.core.pbs.notification.Delivery.run(Delivery.java:267)
at oracle.sysman.util.threadPoolManager.WorkerThread.run(Worker.java:311)
2017-09-18 12:47:10,311 [DeliveryThread-OSCMD3] WARN notification.pbs logp.251 - Delivery.run: java.lang.StringIndexOutOfBoundsException: String index out of range: 512
Deliver to 212605228, send_email_to_SN_OG, 79; issue type: 1; notification type: 1Event: Event Name: problemTbsp:pctUsed
Event Class: metric_alert
Severity: Critical (CR)
Processsing status: NEW_SEQ
Display Timezone: GMT
Reported Date: Mon Sep 18 12:46:59 UTC 2017
Auto Close: true
Open: YesIncident ID: 597723A19FE248F7E053EBC2E50A5C27
Processing Priority: 1023
RCA Correlation State: Complete
RCA Root-Cause: false
RCA Symptom: false
Source Info:
Object Type: Targets
Object Name: ORCL
Object ID: CA86EC11DF4945FC0062B97B92145037
Event Instance ID: 594449D7C35F21FFE053EBC2E50AB5C4
Signature ID: 5B46562084FC3CBDC6F6FCA9AA925985
Current Event ID in Event Sequeunce: 594449D7C35F21FFE053EBC2E50AB5C4
Has Corrective Action Job: false
Event Created During Blackout: 0
Annotations: 2


When checking the EM View MGMT$EVENT_ANNOTATION to see if the OS notification method was completing successfully, it was determined that the method was sometimes exiting with

"Command exited with code=1", or being truncated in the view, for example:

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!

In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.