Spark Jobs Fail with "java.net.BindException: Address already in use:"

(Doc ID 2212544.1)

Last updated on DECEMBER 09, 2016

Applies to:

Big Data Appliance Integrated Software - Version 4.6.0 and later
Linux x86-64

Symptoms

Spark jobs fail with:

16/12/02 07:30:08 INFO storage.MemoryStore: MemoryStore started with capacity 530.3 MB
16/12/02 07:30:08 INFO spark.SparkEnv: Registering OutputCommitCoordinator
16/12/02 07:30:08 WARN util.Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
16/12/02 07:30:08 WARN util.Utils: Service 'SparkUI' could not bind on port 4041. Attempting port 4042.
...
16/12/02 07:30:09 WARN util.Utils: Service 'SparkUI' could not bind on port 4055. Attempting port 4056.
16/12/02 07:30:09 ERROR ui.SparkUI: Failed to bind SparkUI
java.net.BindException: Address already in use:

 

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms