ORA-600 [kghstack_underflow_internal_1] [evahtr] Reported On Exadata Storage Servers
(Doc ID 2326741.1)
Last updated on FEBRUARY 06, 2020
Applies to:
Oracle Exadata Storage Server Software - Version 11.2.1.2.0 and laterInformation in this document applies to any platform.
Symptoms
The cell offload server crash and below error seen in the cell alert log :
ORA-00600: internal error code, arguments: [kghstack_underflow_internal_1], [0x7FDFAC007F68], [evahtr], [], [], [], [], [], [], [], [], []
Followed by the SQL Plan quarantine of the SQL causing the error.
Alert history would show
name: 15_1
alertDescription: "A SQL PLAN quarantine has been added"
alertMessage: "A SQL PLAN quarantine has been added. As a result, Smart Scan is disabled for SQL statements with the quarantined SQL plan. Quarantine id : 73 Quarantine type : SQL PLAN Quarantine reason : Crash Quarantine Plan : SYSTEM Quarantine Mode : FULL_Quarantine DB Unique Name : XXXXX Incident id : 105 SQLID : ct28ug6y4hb9q SQL Plan details : {SQL_PLAN_HASH_VALUE=2086555795, PLAN_LINE_ID=1} In addition, the following disk regions have been quarantined, and Smart Scan will be disabled for these regions: Disk Region : {Grid Disk Name=DATA_CD_01_cel03, offset=47942991872, size=1M} Disk Region : {Grid Disk Name=DATA_CD_06_cel03, offset=66190311424, size=1M} "
alertSequenceID: 15
alertShortName: Software
alertType: Stateful
beginTime: 2017-09-14T10:24:42-04:00
examinedBy:
metricObjectName: QUARANTINE/73
notificationState: sent
sequenceBeginTime: 2017-09-14T10:24:42-04:00
severity: critical
alertAction: "A SQL statement caused the Cell Server (CELLSRV) service on the cell to crash. A SQL PLAN quarantine has been created to prevent the same SQL statement from causing the same cell to crash. When possible, disable offload for the SQL statement or apply the RDBMS patch that fixes the crash, then remove the quarantine with the following CellCLI command: CellCLI> drop quarantine 73 All quarantines are automatically removed when a cell is patched or upgraded. For information about how to disable offload for the SQL statement, refer to the section about 'SQL Processing Offload' in Oracle Exadata Storage Server User's Guide. Diagnostic package is attached. It is also accessible at https://<hostname>/diagpack/download?name=cel03_2017_09_14T10_24_42_15_1.tar.bz2 It will be retained on the storage server for 28 days, after which it may be automatically purged by MS during accelerated space reclamation. Diagnostic packages for critical alerts can be downloaded and/or re-created at https://<hostname>/diagpack"
name: 16
alertDescription: "ORA-00600: internal error code, arguments: [kghstack_underflow_internal_1], [0x7FDFAC007F68], [evahtr], [], [], [], [], [], [], [], [], []"
alertMessage: "ORA-00600: internal error code, arguments: [kghstack_underflow_internal_1], [0x7FDFAC007F68], [evahtr], [], [], [], [], [], [], [], [], []"
alertSequenceID: 16
alertShortName: ADR
alertType: Stateless
beginTime: 2017-09-14T10:24:27-04:00
endTime:
examinedBy:
notificationState: sent
sequenceBeginTime: 2017-09-14T10:24:27-04:00
severity: critical
alertAction: "Errors in file /opt/oracle/cell/log/diag/asm/cell/SYS_112331_170406/trace/cellofltrc_35897_53.trc (incident=97).
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Symptoms |
Cause |
Solution |