My Oracle Support Banner

ORA-600 [kghstack_underflow_internal_1] [evahtr] Reported On Exadata Storage Servers (Doc ID 2326741.1)

Last updated on FEBRUARY 06, 2020

Applies to:

Oracle Exadata Storage Server Software - Version 11.2.1.2.0 and later
Information in this document applies to any platform.

Symptoms

The cell offload server crash and below error seen in the cell alert log :

ORA-00600: internal error code, arguments: [kghstack_underflow_internal_1], [0x7FDFAC007F68], [evahtr], [], [], [], [], [], [], [], [], []

Followed by the SQL Plan quarantine of the SQL causing the error.

Alert history would show

name: 15_1
alertDescription: "A SQL PLAN quarantine has been added"
alertMessage: "A SQL PLAN quarantine has been added. As a result, Smart Scan is disabled for SQL statements with the quarantined SQL plan. Quarantine id : 73 Quarantine type : SQL PLAN Quarantine reason : Crash Quarantine Plan : SYSTEM Quarantine Mode : FULL_Quarantine DB Unique Name : XXXXX Incident id : 105 SQLID : ct28ug6y4hb9q SQL Plan details : {SQL_PLAN_HASH_VALUE=2086555795, PLAN_LINE_ID=1} In addition, the following disk regions have been quarantined, and Smart Scan will be disabled for these regions: Disk Region : {Grid Disk Name=DATA_CD_01_cel03, offset=47942991872, size=1M} Disk Region : {Grid Disk Name=DATA_CD_06_cel03, offset=66190311424, size=1M} "
alertSequenceID: 15
alertShortName: Software
alertType: Stateful
beginTime: 2017-09-14T10:24:42-04:00
examinedBy:
metricObjectName: QUARANTINE/73
notificationState: sent
sequenceBeginTime: 2017-09-14T10:24:42-04:00
severity: critical
alertAction: "A SQL statement caused the Cell Server (CELLSRV) service on the cell to crash. A SQL PLAN quarantine has been created to prevent the same SQL statement from causing the same cell to crash. When possible, disable offload for the SQL statement or apply the RDBMS patch that fixes the crash, then remove the quarantine with the following CellCLI command: CellCLI> drop quarantine 73 All quarantines are automatically removed when a cell is patched or upgraded. For information about how to disable offload for the SQL statement, refer to the section about 'SQL Processing Offload' in Oracle Exadata Storage Server User's Guide. Diagnostic package is attached. It is also accessible at https://<hostname>/diagpack/download?name=cel03_2017_09_14T10_24_42_15_1.tar.bz2 It will be retained on the storage server for 28 days, after which it may be automatically purged by MS during accelerated space reclamation. Diagnostic packages for critical alerts can be downloaded and/or re-created at https://<hostname>/diagpack"

name: 16
alertDescription: "ORA-00600: internal error code, arguments: [kghstack_underflow_internal_1], [0x7FDFAC007F68], [evahtr], [], [], [], [], [], [], [], [], []"
alertMessage: "ORA-00600: internal error code, arguments: [kghstack_underflow_internal_1], [0x7FDFAC007F68], [evahtr], [], [], [], [], [], [], [], [], []"
alertSequenceID: 16
alertShortName: ADR
alertType: Stateless
beginTime: 2017-09-14T10:24:27-04:00
endTime:
examinedBy:
notificationState: sent
sequenceBeginTime: 2017-09-14T10:24:27-04:00
severity: critical
alertAction: "Errors in file /opt/oracle/cell/log/diag/asm/cell/SYS_112331_170406/trace/cellofltrc_35897_53.trc (incident=97).

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.