My Oracle Support Banner

Running MLLIB Code in the Spark Shell Fails with UnsatisfiedLinkError Due to Libgfortran on BDA with OL5.8 (Doc ID 1987342.1)

Last updated on DECEMBER 03, 2019

Applies to:

Big Data Appliance Integrated Software - Version 4.1.0 and later
Linux x86-64

Symptoms

Running code from the Spark shell on the BDA 4.1 (CDH 5.3) cluster with OL 5.8 fails with the following error:

-- org.jblas ERROR Couldn't load copied link file: java.lang.UnsatisfiedLinkError: /u08/hadoop/yarn/nm/usercache/<USER>/<APPNAME>/application_1425015707226_0128/container_<ID>/tmp/jblas<ID>libjblas_arch_flavor.so: libgfortran.so.3: cannot open shared object file: No such file or directory.

On Linux 64bit, you need additional support libraries.
You need to install libgfortran3.

For example for debian or Ubuntu, type "sudo apt-get install libgfortran3"

For more information, see https://github.com/mikiobraun/jblas/wiki/Missing-Libraries
15/03/02 14:50:25 ERROR executor.Executor: Exception in task 22.0 in stage 6.0 (TID 374)
java.lang.UnsatisfiedLinkError: org.jblas.NativeBlas.dposv(CII[DII[DII)I
at org.jblas.NativeBlas.dposv(Native Method)
at org.jblas.SimpleBlas.posv(SimpleBlas.java:369)


This same exact code runs fine on the BDA 4.1 cluster with OL 6.5.


Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution
References


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.