My Oracle Support Banner

Cloudera SCM Agent Fails with "Too many open files" (Doc ID 2889578.1)

Last updated on AUGUST 17, 2022

Applies to:

Big Data Appliance Integrated Software - Version 4.13.0 and later
Linux x86-64

Symptoms

NOTE: In the examples that follow, user details, table name, company name, email, hostnames, etc. represent a fictitious sample (and are used to provide an illustrative example only). Any similarity to actual persons, or entities, living or dead, is purely coincidental and not intended in any manner.

A cloudera scm agent fails with "Too many open files".  Note: This failure can happen on one or more cloudera scm agents.  It is an agent specific issue such that one or more agents can exhibit the problem while other agents in the cluster do not. 

The error in the corresponding agent log at /var/log/cloudera-scm-agent/cloudera-scm-agent.log shows an error like:

12733 HTTPServer Thread-2 _cplogging ERROR ENGINE Error in HTTPServer.tick
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/wsgiserver/wsgiserver2.py", line 1838, in start
self.tick()
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/wsgiserver/wsgiserver2.py", line 1888, in tick
s, addr = self.socket.accept()
File "/usr/lib64/python2.6/socket.py", line 197, in accept
sock, addr = self._sock.accept()
error: [Errno 24] Too many open files

 

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
 BDA 5.x/CDH 6
 BDA 4.x/CDH 5
 Validate Changes

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.