My Oracle Support Banner

Errors "[Store:280032]The Persistent Store Suffered A Fatal Error And It Must Be Re-opened" Recorded To Logfile (Doc ID 2028218.1)

Last updated on APRIL 30, 2018

Applies to:

Oracle WebLogic Server - Version 10.3 and later
Information in this document applies to any platform.

Symptoms

Filestore errors are recorded to server log at 5 minute intervals:

<Emergency> <Store> <server1> <bi_server1> <Thread-185> <> <> <> <1435671648396> <BEA-280060> <The persistent store "WLS_DIAGNOSTICS" encountered a fatal error, and it must be shut down: weblogic.store.PersistentStoreFatalException: java.io.IOException: SetEndOfFile, Espaço insuficiente no disco., errno=112
weblogic.store.PersistentStoreFatalException: java.io.IOException: SetEndOfFile, Espaço insuficiente no disco., errno=112
at weblogic.store.io.file.FileStoreIO.flush(FileStoreIO.java:534)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:739)
at java.lang.Thread.run(Thread.java:662)
Caused By: java.io.IOException: SetEndOfFile, Espaço insuficiente no disco., erno=112
at weblogic.store.io.file.direct.DirectIONative.createMapping(Native Method)
at weblogic.store.io.file.direct.FileMapping.openInternal(FileMapping.java:102)
at weblogic.store.io.file.direct.FileMapping.reopen(FileMapping.java:376)
at weblogic.store.io.file.StoreFile.expand(StoreFile.java:345)
at weblogic.store.io.file.Heap.reserveSpace(Heap.java:512)
at weblogic.store.io.file.Heap.multiWrite(Heap.java:663)
at weblogic.store.io.file.FileStoreIO.flush(FileStoreIO.java:530)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:739)
at java.lang.Thread.run(Thread.java:662)
>

<Info> <Diagnostics> <server1> <bi_server1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <> <> <> <1435671648411> <BEA-320077> <Initialized the Diagnostic Accessor Service.>

<Critical> <Health> <server1> <bi_server1> <[ACTIVE] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'> <> <> <> <1435671648415> <BEA-310006> <Critical Subsystem PersistentStore.WLS_DIAGNOSTICS has failed. Setting server state to FAILED.
Reason: weblogic.store.PersistentStoreFatalException: java.io.IOException: SetEndOfFile, Espaço insuficiente no disco., erno=112>

<Critical> <WebLogicServer> <server1> <bi_server1> <[ACTIVE] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'> <> <> <> <1435671648417> <BEA-000385> <Server health failed. Reason: health of critical service 'PersistentStore.WLS_DIAGNOSTICS' failed>

<Notice> <WebLogicServer> <server1> <bi_server1> <[ACTIVE] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'> <> <> <> <1435671648418> <BEA-000365> <Server state changed to FAILED>

<Error> <Diagnostics> <server1> <bi_server1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <> <> <2302a67e69559d6a:-308c9dd3:14e448f94eb:-8000-0000000000000040> <1435671818412> <BEA-320004> <The following unexpected exception was thrown: Error writing data to archive
java.io.IOException: [Store:280032]The persistent store suffered a fatal error and it must be re-opened
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.writeData(PersistentStoreDataArchive.java:1490)
at weblogic.diagnostics.instrumentation.EventQueue$ArchiveEventsAction.run(EventQueue.java:373)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.diagnostics.instrumentation.EventQueue.timerExpired(EventQueue.java:316)
at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:273)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
>


<Error> <Diagnostics> <server1> <bi_server1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <> <> <2302a67e69559d6a:-308c9dd3:14e448f94eb:-8000-0000000000000053> <1435672848448> <BEA-320142> <An error was encountered while performing size based data retirement on archive EventsDataArchive
weblogic.diagnostics.accessor.DiagnosticDataAccessException: weblogic.store.PersistentStoreException: weblogic.store.PersistentStoreFatalException: [Store:280032]The persistent store suffered a fatal error and it must be re-opened
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.deleteDataRecords(PersistentStoreDataArchive.java:1368)
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.retireOldestRecords(PersistentStoreDataArchive.java:1211)
at weblogic.diagnostics.archive.DataRetirementByQuotaTaskImpl.performDataRetirement(DataRetirementByQuotaTaskImpl.java:92)

at weblogic.diagnostics.archive.DataRetirementByQuotaTaskImpl.run(DataRetirementByQuotaTaskImpl.java:49)
at weblogic.diagnostics.archive.DataRetirementTaskImpl.run(DataRetirementTaskImpl.java:261)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
Caused By: weblogic.store.PersistentStoreException: weblogic.store.PersistentStoreFatalException: [Store:280032]The persistent store suffered a fatal error and it must be re-opened
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.readRecord(PersistentStoreDataArchive.java:698)
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.findIndexPage(PersistentStoreDataArchive.java:1102)
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.findRecordHandle(PersistentStoreDataArchive.java:1012)
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.deleteDataRecords(PersistentStoreDataArchive.java:1280)
at weblogic.diagnostics.archive.wlstore.PersistentStoreDataArchive.retireOldestRecords(PersistentStoreDataArchive.java:1211)
at weblogic.diagnostics.archive.DataRetirementByQuotaTaskImpl.performDataRetirement(DataRetirementByQuotaTaskImpl.java:92)
at weblogic.diagnostics.archive.DataRetirementByQuotaTaskImpl.run(DataRetirementByQuotaTaskImpl.java:49)
at weblogic.diagnostics.archive.DataRetirementTaskImpl.run(DataRetirementTaskImpl.java:261)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
Caused By: weblogic.store.PersistentStoreFatalException: [Store:280032]The persistent store suffered a fatal error and it must be re-opened
at weblogic.store.io.file.FileStoreIO.checkOpened(FileStoreIO.java:893)
at weblogic.store.io.file.FileStoreIO.read(FileStoreIO.java:233)
at weblogic.store.internal.ReadRequest.run(ReadRequest.java:34)
at weblogic.store.internal.StoreRequest.doTheIO(StoreRequest.java:64)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:729)
at java.lang.Thread.run(Thread.java:662)
>

 

 

 

 

 

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.