My Oracle Support Banner

weblogic.store.PersistentStoreFatalException caused by java.io.IOException: Error from open(), Bad address, errno=14 (Doc ID 2082907.1)

Last updated on OCTOBER 17, 2018

Applies to:

Oracle WebLogic Server - Version 10.3 and later
Information in this document applies to any platform.

Symptoms

When starting the managed server, file-store creation failed, causing the managed server to go to failed state. Below is the error message:

####<Nov 19, 2015 11:05:58 AM> <Emergency> <Store> <host> <wls_soa1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <> <> <> <1447884358910> <BEA-280060> <The store "_WLS_wls_soa1" encountered a fatal error, and it must be shut down: weblogic.store.PersistentStoreFatalException: [Store:280105]The persistent file store "_WLS_wls_soa1" cannot open file _WLS_WLS_SOA1000000.DAT.
weblogic.store.PersistentStoreFatalException: [Store:280105]The persistent file store "_WLS_wls_soa1" cannot open file _WLS_WLS_SOA1000000.DAT.
  at weblogic.store.io.file.BaseStoreIO.openInternal(BaseStoreIO.java:170)
  at weblogic.store.io.file.FileStoreIO.open(FileStoreIO.java:64)
  at weblogic.store.internal.PersistentStoreImpl.recoverStoreConnections(PersistentStoreImpl.java:476)
  at weblogic.store.internal.PersistentStoreImpl.open(PersistentStoreImpl.java:453)
  at weblogic.store.admin.AdminHandler.activate(AdminHandler.java:129)
  at weblogic.store.admin.FileAdminHandler.activate(FileAdminHandler.java:221)
  at weblogic.store.admin.DefaultStoreService.start(DefaultStoreService.java:103)
  at weblogic.server.AbstractServerService.postConstruct(AbstractServerService.java:78)
  at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at org.glassfish.hk2.utilities.reflection.ReflectionHelper.invoke(ReflectionHelper.java:1017)
  at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:388)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:430)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:87)
  at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1162)
  at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1147)
  at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:548)
  at weblogic.work.ExecuteThread.execute(ExecuteThread.java:311)
  at weblogic.work.ExecuteThread.run(ExecuteThread.java:263)
Caused By: java.io.IOException: Error from open(), Bad address, errno=14
  at weblogic.store.io.file.direct.DirectIONative.openConsiderLock(Native Method)
  at weblogic.store.io.file.direct.DirectIONativeImpl.openConsiderLock(DirectIONativeImpl.java:35)
  at weblogic.store.io.file.direct.DirectFileChannel.<init>(DirectFileChannel.java:64)
  at weblogic.store.io.file.direct.DirectIOManager.openBasic(DirectIOManager.java:275)
  at weblogic.store.io.file.FileStoreIO.staticOpen(FileStoreIO.java:76)
  at weblogic.store.io.file.FileStoreIO.fileChannelFactory(FileStoreIO.java:71)
  at weblogic.store.io.file.Heap.fileChannelFactory(Heap.java:612)
  at weblogic.store.io.file.StoreFile.fileChannelFactory(StoreFile.java:176)
  at weblogic.store.io.file.StoreFile.openInternal(StoreFile.java:119)
  at weblogic.store.io.file.StoreFile.openDirect(StoreFile.java:190)
  at weblogic.store.io.file.Heap.openStoreFile(Heap.java:598)
  at weblogic.store.io.file.Heap.open(Heap.java:505)
  at weblogic.store.io.file.BaseStoreIO.openInternal(BaseStoreIO.java:151)
  at weblogic.store.io.file.FileStoreIO.open(FileStoreIO.java:64)
  at weblogic.store.internal.PersistentStoreImpl.recoverStoreConnections(PersistentStoreImpl.java:476)
  at weblogic.store.internal.PersistentStoreImpl.open(PersistentStoreImpl.java:453)
  at weblogic.store.admin.AdminHandler.activate(AdminHandler.java:129)
  at weblogic.store.admin.FileAdminHandler.activate(FileAdminHandler.java:221)
  at weblogic.store.admin.DefaultStoreService.start(DefaultStoreService.java:103)
  at weblogic.server.AbstractServerService.postConstruct(AbstractServerService.java:78)
  at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at org.glassfish.hk2.utilities.reflection.ReflectionHelper.invoke(ReflectionHelper.java:1017)
  at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:388)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:430)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:606)
  at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:77)
  at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:231)
  at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:254)
  at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:413)
  at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:456)
  at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:225)
  at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:82)
  at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2488)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:98)
  at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:87)
  at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1162)
  at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1147)
  at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:548)
  at weblogic.work.ExecuteThread.execute(ExecuteThread.java:311)
  at weblogic.work.ExecuteThread.run(ExecuteThread.java:263)

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.