ORA-17500 : Database crashed at DNFS Failover with error "ODM Err:KGNFS WRITE FAIL"
(Doc ID 2310088.1)
Last updated on JULY 30, 2023
Applies to:
Oracle Database - Enterprise Edition - Version 11.1.0.7 to 11.2.0.1.0 [Release 11.1 to 11.2]Oracle Database Cloud Schema Service - Version N/A and later
Oracle Database Exadata Express Cloud Service - Version N/A and later
Oracle Database Exadata Cloud Machine - Version N/A and later
Oracle Cloud Infrastructure - Database Service - Version N/A and later
Information in this document applies to any platform.
Symptoms
The DB instance is crashed with following error when using Direct NFS.
Database alert log :
Fri Sep 18 17:53:17 2009
ALTER SYSTEM: Flushing buffer cache
Fri Sep 18 18:25:59 2009
Direct NFS: write FAILED 10008
Fri Sep 18 18:25:59 2009
Direct NFS: Read FAIL status 10008
Fri Sep 18 18:25:59 2009
Direct NFS: Read FAIL status 10008
Fri Sep 18 18:25:59 2009
Direct NFS: Read FAIL status 10008
Direct NFS: NFS3ERR 10008 error encountered. path testfiler mntport 4046nfsport 2049
Direct NFS: NFS3ERR 10008 error encountered. path testfiler mntport 4046 nfsport 2049
Direct NFS: NFS3ERR 10008 error encountered. path testfiler mntport 4046 nfsport 2049
Direct NFS: NFS3ERR 10008 error encountered. path testfiler mntport 4046 nfsport 2049
Direct NFS: Read FAIL status 10008
Direct NFS: NFS3ERR 10008 error encountered. path testfiler mntport 4046 nfsport 2049
Direct NFS: Read FAIL status 10008
Direct NFS: NFS3ERR 10008 error encountered. path testfiler mntport 4046 nfsport 2049
Direct NFS: Read FAIL status 10008
Direct NFS: NFS3ERR 10008 error encountered. path testfiler mntport 4046 nfsport 2049
Errors in file <Database Trace Directory>/test_smon_14829.trc:
ORA-00604: error occurred at recursive SQL level 1
ORA-01115: IO error reading block from file 1 (block # 38)
ORA-01110: data file 1: '/oracle/oradata/test/data/system_test_01.dbf'
ORA-17500: ODM err:KGNFS READ FAIL
Errors in file <Database Trace Directory>/test_lgwr_14807.trc:
ORA-00345: redo log write error block 16209 count 5
ORA-00312: online log 2 thread 1:'/oracle/oradata/test/logs/redo_test_g2.rdo'
ORA-17500: ODM err:KGNFS WRITE FAIL
Errors in file <Database Trace Directory>/test_lgwr_14807.trc:
ORA-00340: IO error processing online log 2 of thread 1
ORA-00345: redo log write error block 16209 count 5
ORA-00312: online log 2 thread 1:'/oracle/oradata/test/logs/redo_test_g2.rdo'
ORA-17500: ODM err:KGNFS WRITE FAIL
LGWR (ospid: 14807): terminating the instance due to error 340
Instance terminated by LGWR, pid = 14807
test_ckpt_24303.trc indicates:
kgnfs_nfs3fh:[ 00000020 64000000 aa62de49 20000000 0022815f a577e24fe411c297 64000000 aa62de00 ]]
[85356367] : msg ffffffff7a057b20 xid 1059371944 mtype 0 proc 7 frags 1
rbytes 0 iovc 2 iovl 16528 iovs 0 tch 0x2 ord 273778 off 0 ts 0x4bf3972 flags 0x0 parent 0
[85356380] : offset 49152 write count 16384 buff ffffffff7b630400
[85356394] : rq ffffffff7a620208 proc 7 offset 49152 count 16384 status 304 ts 0x0 <=========== status 304
kgnfs_nfs3fh:[ 00000020 64000000 aa62de49 20000000 0022815f a577e24fe411c297 64000000 aa62de00 ]]
[85356444] : ffffffff7a057c20 len 144 lt 36
ffffffff7a057c20: 8000408c 3f24bba8 00000000 00000002 000186a300000003 00000007 00000001
ffffffff7a057c40: 0000002c abcdefab 00000009 686f7573 6465643031000000 0000ab4c 0000a80f
ffffffff7a057c60: 00000003 0000a80f 0000f61e 0000b98c 0000000000000000 00000020 64000000
ffffffff7a057c80: aa62de49 20000000 0022815f a577e24f e411c29764000000 aa62de00 00000000
ffffffff7a057ca0: 0000c000 00004000 00000002 00004000
[85356547] : ffffffff7b629d88 len 40 lt 10
ffffffff7b629d88: 80000024 3f24bba8 00000001 00000000 0000000000000000 00000000 00002718
ffffffff7b629da8: 00000000 00000000
kgnfs_nfs3fh:[ 00000020 65000000 0145de49 20000000 0004b8d0 417de24f7511c296 65000000 0145de00 ]]
[85460451] : msg ffffffff7a061748 xid 1059371945 mtype 0 proc 7 frags 1 rbytes 0 iovc 2 iovl 16528 iovs 0 tch 0x2 ord 273779 off 0 ts 0x4bf3972 flags
0x0 parent 0
[85460464] : offset 49152 write count 16384 buff ffffffff7b630400
[85460476] : rq ffffffff7aa40118 proc 7 offset 49152 count 16384 status 304ts 0x0 <=========== status 304
kgnfs_nfs3fh:[ 00000020 65000000 0145de49 20000000 0004b8d0 417de24f7511c296 65000000 0145de00 ]]
[85460524] : ffffffff7a061848 len 144 lt 36
ffffffff7a061848: 8000408c 3f24bba9 00000000 00000002 000186a300000003 00000007 00000001
ffffffff7a061868: 0000002c abcdefab 00000009 686f7573 6465643031000000 0000ab4c 0000a80f
ffffffff7a061888: 00000003 0000a80f 0000f61e 0000b98c 0000000000000000 00000020 65000000
ffffffff7a0618a8: 0145de49 20000000 0004b8d0 417de24f 7511c29665000000 0145de00 00000000
ffffffff7a0618c8: 0000c000 00004000 00000002 00004000
[85460625] : ffffffff7b629d88 len 40 lt 10ffffffff7b629d88: 80000024 3f24bba9 00000001 00000000 0000000000000000 00000000 00002718
ffffffff7b629da8: 00000000 00000000
[85460684] : I/O error status 304 <===========
[85460705] : I/O error status 304
Changes
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Changes |
| Cause |
| Solution |
| References |