Excessive MMON, KRB Traces Causing Trace File Location (/u01) Overflow in DBaaS
(Doc ID 2442656.1)
Last updated on AUGUST 30, 2023
Applies to:
Oracle Database Cloud Service - Version N/A to N/A [Release 1.0]Oracle Database - Enterprise Edition - Version 12.1.0.2 to 12.1.0.2 [Release 12.1]
Linux x86-64
Symptoms
Customer observed that the size MMON trace files gets increased beyond 100M which is causing trace file Location (/u01) Overflow.
From alert.log:
.....
2018-08-19T10:03:23.233858+00:00
Control autobackup written to DISK device
handle '/u03/app/oracle/fast_recovery_area/ORCL/autobackup/2018_08_19/o1_mf_s_984564200_fqlj39fm_.bkp'
2018-08-19T10:47:34.327655+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_ora_21761.trc"
Error message:
Writing to the above trace file is disabled for now on...
2018-08-19T10:47:34.327685+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_ora_21762.trc"
Error message:
Writing to the above trace file is disabled for now on...
2018-08-19T10:52:48.584239+00:00
Non critical error ORA-48113 caught while writing to trace metadata file (.trm)
Trace file name: "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_dia0_22201_base_1.trc"
Error message:
Writing to trace metadata is disabled for now on...
2018-08-19T11:00:21.690232+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_dia0_22201_base_1.trc"
Error message:
Writing to the above trace file is disabled for now on...
2018-08-19T11:00:50.779019+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_dia0_22201_lws_1.trc"
Error message:
........
2018-08-19T10:03:23.233858+00:00
Control autobackup written to DISK device
handle '/u03/app/oracle/fast_recovery_area/ORCL/autobackup/2018_08_19/o1_mf_s_984564200_fqlj39fm_.bkp'
2018-08-19T10:47:34.327655+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_ora_21761.trc"
Error message:
Writing to the above trace file is disabled for now on...
2018-08-19T10:47:34.327685+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_ora_21762.trc"
Error message:
Writing to the above trace file is disabled for now on...
2018-08-19T10:52:48.584239+00:00
Non critical error ORA-48113 caught while writing to trace metadata file (.trm)
Trace file name: "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_dia0_22201_base_1.trc"
Error message:
Writing to trace metadata is disabled for now on...
2018-08-19T11:00:21.690232+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_dia0_22201_base_1.trc"
Error message:
Writing to the above trace file is disabled for now on...
2018-08-19T11:00:50.779019+00:00
Non critical error ORA-48113 caught while writing to trace file "/u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_dia0_22201_lws_1.trc"
Error message:
........
From MMON trace:
............
Redo thread mounted by this instance: 1
Oracle process number: 32
Unix process pid: 25979, image: oracle@***** (MMON)
*** 2018-06-25T06:05:00.069198+00:00 (CDB$ROOT(1))
*** SESSION ID:(16.21960) 2018-06-25T06:05:00.069248+00:00
*** CLIENT ID:() 2018-06-25T06:05:00.069263+00:00
*** SERVICE NAME:(SYS$BACKGROUND) 2018-06-25T06:05:00.069277+00:00
*** MODULE NAME:() 2018-06-25T06:05:00.069292+00:00
*** ACTION NAME:() 2018-06-25T06:05:00.069305+00:00
*** CLIENT DRIVER:() 2018-06-25T06:05:00.069318+00:00
*** CONTAINER ID:(1) 2018-06-25T06:05:00.069332+00:00
*** TRACE FILE RECREATED AFTER BEING REMOVED ***
AUTO SGA: kmgs_parameter_update_timeout gen0 0 mmon alive 1
*** 2018-06-25T06:05:03.069212+00:00 (CDB$ROOT(1))
AUTO SGA: kmgs_parameter_update_timeout gen0 0 mmon alive 1
*** 2018-06-25T06:05:06.069301+00:00 (CDB$ROOT(1))
AUTO SGA: kmgs_parameter_update_timeout gen0 0 mmon alive 1
............
Redo thread mounted by this instance: 1
Oracle process number: 32
Unix process pid: 25979, image: oracle@***** (MMON)
*** 2018-06-25T06:05:00.069198+00:00 (CDB$ROOT(1))
*** SESSION ID:(16.21960) 2018-06-25T06:05:00.069248+00:00
*** CLIENT ID:() 2018-06-25T06:05:00.069263+00:00
*** SERVICE NAME:(SYS$BACKGROUND) 2018-06-25T06:05:00.069277+00:00
*** MODULE NAME:() 2018-06-25T06:05:00.069292+00:00
*** ACTION NAME:() 2018-06-25T06:05:00.069305+00:00
*** CLIENT DRIVER:() 2018-06-25T06:05:00.069318+00:00
*** CONTAINER ID:(1) 2018-06-25T06:05:00.069332+00:00
*** TRACE FILE RECREATED AFTER BEING REMOVED ***
AUTO SGA: kmgs_parameter_update_timeout gen0 0 mmon alive 1
*** 2018-06-25T06:05:03.069212+00:00 (CDB$ROOT(1))
AUTO SGA: kmgs_parameter_update_timeout gen0 0 mmon alive 1
*** 2018-06-25T06:05:06.069301+00:00 (CDB$ROOT(1))
AUTO SGA: kmgs_parameter_update_timeout gen0 0 mmon alive 1
............
From KRB trace:
............
Redo thread mounted by this instance: 1
Oracle process number: 215
Unix process pid: 8998, image: oracle@***** (TNS V1-V3)
*** 2018-08-19T19:00:03.444793+00:00 (CDB$ROOT(1))
*** SESSION ID:(1723.45910) 2018-08-19T19:00:03.444828+00:00
*** CLIENT ID:() 2018-08-19T19:00:03.444835+00:00
*** SERVICE NAME:(SYS$USERS) 2018-08-19T19:00:03.444841+00:00
*** MODULE NAME:(rman@***** (TNS V1-V3)) 2018-08-19T19:00:03.444848+00:00
*** ACTION NAME:() 2018-08-19T19:00:03.444855+00:00
*** CLIENT DRIVER:() 2018-08-19T19:00:03.444861+00:00
*** CONTAINER ID:(1) 2018-08-19T19:00:03.444868+00:00
2018-08-19 19:00:03.444*:KRB:krbi.c@8857:krbitrc(): Got krbitrc
2018-08-19 19:00:03.444*:KRB:krbi.c@8887:krbiwtrc(): (bkrsmain - Action is NULL)
*** ACTION NAME:(0000001 STARTED70) 2018-08-19T19:00:03.444998+00:00
2018-08-19 19:00:03.444*:KRB:krbi.c@8887:krbiwtrc(): (icdstart - Action set to 0000001 STARTED70)
*** ACTION NAME:(0000001 FINISHED70) 2018-08-19T19:00:03.445209+00:00
2018-08-19 19:00:03.445*:KRB:krbi.c@8887:krbiwtrc(): (icdfinish - Action set to 0000001 FINISHED70)
Redo thread mounted by this instance: 1
Oracle process number: 215
Unix process pid: 8998, image: oracle@***** (TNS V1-V3)
*** 2018-08-19T19:00:03.444793+00:00 (CDB$ROOT(1))
*** SESSION ID:(1723.45910) 2018-08-19T19:00:03.444828+00:00
*** CLIENT ID:() 2018-08-19T19:00:03.444835+00:00
*** SERVICE NAME:(SYS$USERS) 2018-08-19T19:00:03.444841+00:00
*** MODULE NAME:(rman@***** (TNS V1-V3)) 2018-08-19T19:00:03.444848+00:00
*** ACTION NAME:() 2018-08-19T19:00:03.444855+00:00
*** CLIENT DRIVER:() 2018-08-19T19:00:03.444861+00:00
*** CONTAINER ID:(1) 2018-08-19T19:00:03.444868+00:00
2018-08-19 19:00:03.444*:KRB:krbi.c@8857:krbitrc(): Got krbitrc
2018-08-19 19:00:03.444*:KRB:krbi.c@8887:krbiwtrc(): (bkrsmain - Action is NULL)
*** ACTION NAME:(0000001 STARTED70) 2018-08-19T19:00:03.444998+00:00
2018-08-19 19:00:03.444*:KRB:krbi.c@8887:krbiwtrc(): (icdstart - Action set to 0000001 STARTED70)
*** ACTION NAME:(0000001 FINISHED70) 2018-08-19T19:00:03.445209+00:00
2018-08-19 19:00:03.445*:KRB:krbi.c@8887:krbiwtrc(): (icdfinish - Action set to 0000001 FINISHED70)
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |