Service Goes Offline After Database Archiver Problem (Doc ID 1362955.1)

Last updated on DECEMBER 27, 2012

Applies to:

Oracle Server - Enterprise Edition - Version 10.2.0.1 to 11.1.0.7 [Release 10.2 to 11.1]
Information in this document applies to any platform.

Symptoms

Cluster service ora.sales.sales_srv.sales2.srv on node sales2 went OFFLINE unexpectedly.

1. In database alert log, the archiver stuck:

Sat Sep 24 23:18:35 EAT 2011
Errors in file /oracle/admin/sales/bdump/sales2_arc0_3829.trc:
ORA-19504: failed to create file "/arc1_sales2_210_746730536.dbf"
ORA-27040: file create error, unable to create file
..
Sat Sep 24 23:18:35 EAT 2011
ARC0: Error 19504 Creating archive log file to '/arc1_sales2_210_746730536.dbf'
ARCH: Archival stopped, error occurred. Will continue retrying



2. In $DB_HOME/log/<node>/racg/imon_<dbname>.log:

2011-09-24 23:18:36.378: [ RACG][21] [3558][21][ora.sales.sales2.inst]: clsrimstart: State change 5 set. Failing srv and sa


3. In $CRS_HOME/log/<node>/crsd/crsd.log, the service stopped after archiver issue:

2011-09-24 23:18:36.400: [ CRSRES][789643] In stateChanged, ora.sales.sales_srv.sales2.srv target is ONLINE
2011-09-24 23:18:36.403: [ CRSRES][789643] ora.sales.sales_srv.sales2.srv on sales2 went OFFLINE unexpectedly
2011-09-24 23:18:36.403: [ CRSRES][789643] StopResource: setting CLI values
2011-09-24 23:18:36.530: [ CRSRES][789643] Attempting to stop `ora.sales.sales_srv.sales2.srv` on member `sales2`
2011-09-24 23:18:36.897: [ CRSRES][789643] Stop of `ora.sales.sales_srv.sales2.srv` on member `sales2` succeeded.
2011-09-24 23:18:36.898: [ CRSRES][789643] ora.sales.sales_srv.sales2.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-09-24 23:18:36.975: [ CRSRES][789643] ora.sales.sales_srv.sales2.srv failed on sales2 relocating.
2011-09-24 23:18:37.027: [ CRSRES][789643] Cannot relocate ora.sales.sales_srv.sales2.srvStopping dependents
2011-09-24 23:18:37.039: [ CRSRES][789643] StopResource: setting CLI values



Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms