11gR2 Grid Infrastructure Does not Use ulimit Setting Appropriately (Doc ID 983715.1)

Last updated on JUNE 26, 2015

Applies to:

Oracle Database - Standard Edition - Version 11.2.0.1 to 11.2.0.2 [Release 11.2]
Oracle Database - Enterprise Edition - Version 11.2.0.1 to 11.2.0.2 [Release 11.2]
Generic UNIX
Generic Linux

Symptoms

11gR2 Grid Infrastructure with appropriate ulimit and kernel setting - example on Linux:

ulimit -a

max locked memory       (kbytes, -l) 50000000
open files                      (-n) 65536
..

 

/sbin/sysctl -a|grep file-max
fs.file-max = 6815744

 

/bin/cat /etc/security/limits.conf

oracle   soft   nofile    131072
oracle   hard   nofile    131072
oracle   soft   memlock    50000000
oracle   hard   memlock    50000000

 

grep pam_limits.so /etc/pam.d/login
session    required     pam_limits.so


While Grid Infrastructure tries to bring up resources automatically upon node restart, various warning or error shows in database alert.log or preventing database from coming up or preventing client from connecting through listener, or cause hugepages not being used on Linux

1. Database comes up automatically but alert.log shows following:

WARNING: Oracle instance running on a system with low open file
         descriptor limit. Tune your system to increase this limit
         to avoid severe performance degradation. Current limit = 992

 
2. Database does not start automatically, srvctl start fails:

$GRID_HOME/bin/srvctl start database -d testdb112
PRCR-1079 : Failed to start resource ora.testdb112.db
ORA-01034: ORACLE not available
ORA-27101: shared memory realm does not exist
Linux Error: 2: No such file or directory
Process ID: 0
Session ID: 0 Serial number: 0
ORA-27123: unable to attach to shared memory segment
CRS-2674: Start of 'ora.testdb112.db' on 'eclnt5' failed
ORA-01034: ORACLE not available
ORA-27101: shared memory realm does not exist
Linux Error: 2: No such file or directory
Process ID: 0
Session ID: 0 Serial number: 0
CRS-2528: Unable to place an instance of 'ora.testdb112.db' as all possible servers are occupied by the resource already


3. Can not connect to database through listener, following error reported:

sqlplus test/test@testdb112

SQL*Plus: Release 11.2.0.1.0 Production on Tue Dec 1 23:12:06 2010

Copyright (c) 1982, 2009, Oracle.  All rights reserved.

ERROR:

ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux Error: 11: Resource temporarily unavailable
Process ID: 0
Session ID: 0 Serial number: 0


4. Hugepages not being used on Linux:

cat /proc/meminfo
..
HugePages_Total:  24576
HugePages_Free:     24576

5. ORA-29701 with the following symptoms:


alert_<sid>.log
..
ERROR: unrecoverable error ORA-29701 raised in ASM I/O path; terminating process 13527
..

trace file
..
2011-09-13 00:37:56.822: [ CSSCLNT]clssscConnect: gipcWait failed with 16 (0x12)
2011-09-13 00:37:56.833: [ CSSCLNT]clsssInitNative: connect to (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_fxgliws_)) failed, rc 16
kgxgncin: CLSS init failed with status 3
kgxgncin: return status 3 (1311719766 SKGXN not av) from CLSS
NOTE: kfmsInit: ASM failed to initialize group services
Error ORA-29701 signaled at
.. kfmsInit()+175<-kfmsSlvReg()+1142<-kfmdSlvOpPriv()+2152<-kfmdWriteSubmitted()+649<-kfk_process_an_ioq()+210<-kfk_submit_io()+74<-kfk_io1()+1089<-kfkRequest()+14<-kfk_transitIO()+1696<-

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms