ASSERT IN ACFS METADATA VALIDATION ERROR (Doc ID 1683747.1)

Last updated on MAY 25, 2017

Applies to:

Oracle Database - Enterprise Edition - Version 11.2.0.1 to 12.1.0.1 [Release 11.2 to 12.1]
Linux x86-64

Symptoms

On linux kernel versions 2.6.32 and above, an ACFS "Can't clear bits twice" assertion failure may be recorded in /var/log/messages after a file opened on multiple nodes is deleted.

ACFS metadata validation error in volume mounted

Apr 5 05:25:21 li-lp-1272 SAPSAP_99[9226]: sapstartsrv stopped
Apr 5 05:25:24 li-lp-1272 saphostexec[105335]: SAPHostExec / SAPHostControl successfully upgraded
Apr 5 05:25:24 li-lp-1272 saphostexec[105466]: modified /proc/sys/net/ipv4/ip_local_reserved_ports for SAP applications (SAP note 401162)
Apr 5 05:25:24 li-lp-1272 saphostexec[105466]: modified /proc/sys/net/ipv4/ip_local_port_range from 9000-65500 to 9000-65300
Apr 5 05:25:24 li-lp-1272 saphostexec[105466]: number of free ports: 41296
Apr 5 05:25:24 li-lp-1272 saphostexec[105466]: number of reserved ports: 24240
Apr 5 05:25:24 li-lp-1272 saphostexec[105466]: number of reserved ports within ip_local_port_range: 22984
Apr 5 05:25:24 li-lp-1272 SAPSAP_99[105469]: SAP Service SAPHostControl successfully started.
Apr 5 05:29:32 li-lp-1272 kernel: ACFSK-0047: Encountered a metadata validation error in volume mounted at /sapmnt. A read retry failed for file identifier 0x1b5 starting disk offset 0xbbcda00.
Apr 5 05:29:32 li-lp-1272 kernel:
Apr 5 05:29:32 li-lp-1272 kernel:
Apr 5 05:29:32 li-lp-1272 kernel: [Oracle ACFS] METADATA VALIDATION ERROR in file system /sapmnt
Apr 5 05:29:32 li-lp-1272 kernel: [Oracle ACFS] *** OBJECT TYPE MISMATCH: Code expected 0xf500004
Apr 5 05:29:32 li-lp-1272 kernel: Got 0xf500007
Apr 5 05:29:32 li-lp-1272 kernel:
Apr 5 05:29:32 li-lp-1272 kernel: [Oracle ACFS] VCB 0xffff88202a336000 DiskOffset 196925952 Fenum 437
Apr 5 05:29:32 li-lp-1272 kernel: [Oracle ACFS] data @ 0xffff88080f5c0000 Type 0xf500004 Src Loc: 882
Apr 5 05:29:32 li-lp-1272 kernel:
Apr 5 05:29:32 li-lp-1272 kernel: [Oracle ACFS] OFS_ODS_HDR: OS: 130 StructVer: 1 Type 0xf500007
Apr 5 05:29:32 li-lp-1272 kernel: [Oracle ACFS] Fenum 437 FileSystemID: 0xe28f691e Checksum 0xe2091eb
Apr 5 05:29:32 li-lp-1272 kernel:
-
Apr 5 05:29:32 li-lp-1272 kernel: KsDumpStack: Stack call traceback
Apr 5 05:29:32 li-lp-1272 kernel: Pid: 25449, comm: acfs_bast0 Tainted: P W --------------- 2.6.32-279.31.1.el6.x86_64 #1
Apr 5 05:29:32 li-lp-1272 kernel: Call Trace:
Apr 5 05:29:32 li-lp-1272 kernel: [] ? KsDumpStack+0x3b/0x40 [oracleoks]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? OfsPrintErrorData+0x308/0x690 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_meta_retry_fixup+0x6f0/0xf60 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_meta_get+0x2da6/0x3360 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_meta_refblk_int+0xba/0x270 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? KsRwLockRead+0x16/0x30 [oracleoks]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_FETA_lookup_int+0x17d/0x980 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? KsRwLockWrite+0x16/0x40 [oracleoks]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? OfsVerifyUpdateFcb+0xac/0xf20 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? OfsAcquireResourceLite_OSD+0x5d/0x2e0 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_delete_inode+0x675/0x990 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_delete_inode_finish+0x51/0x60 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_process_bast+0xb9b/0xfc0 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_blkrtn+0x0/0x170 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_lookup_lock+0x522/0x580 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_revoke+0x388/0x1140 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? KsSleepEvent+0x92/0x130 [oracleoks]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_bast_handler+0x0/0x620 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_bast_handler+0x0/0x620 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_bast_handler+0x36d/0x620 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_bast_handler+0x0/0x620 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? ofs_dlm_bast_handler+0x0/0x620 [oracleacfs]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? KsKthreadRun+0x7f/0xb0 [oracleoks]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? child_rip+0xa/0x20
Apr 5 05:29:32 li-lp-1272 kernel: [] ? KsKthreadRun+0x0/0xb0 [oracleoks]
Apr 5 05:29:32 li-lp-1272 kernel: [] ? child_rip+0x0/0x20
Apr 5 05:29:40 li-lp-1272 kernel: OKSK-00007: Information has been saved in the file /var/log/Fokslog.1 . Include the contents of this file if reporting a problem to Oracle.
Apr 5 05:29:40 li-lp-1272 kernel: ACFSK-0047: Encountered a metadata validation error in volume mounted at /sapmnt. A read retry failed for file identifier 0x1b4 starting disk offset 0xbbcd800.
Apr 5 05:29:40 li-lp-1272 kernel:

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms