Running MLLIB Code in the Spark Shell Fails with UnsatisfiedLinkError Due to Libgfortran on BDA with OL5.8
(Doc ID 1987342.1)
Last updated on NOVEMBER 08, 2022
Applies to:
Big Data Appliance Integrated Software - Version 4.1.0 and laterLinux x86-64
Symptoms
Running code from the Spark shell on the BDA 4.1 (CDH 5.3) cluster with OL 5.8 fails with the following error:
-- org.jblas ERROR Couldn't load copied link file: java.lang.UnsatisfiedLinkError: /u08/hadoop/yarn/nm/usercache/<USER>/<APPNAME>/application_1425015707226_0128/container_<ID>/tmp/jblas<ID>libjblas_arch_flavor.so: libgfortran.so.3: cannot open shared object file: No such file or directory.
On Linux 64bit, you need additional support libraries.
You need to install libgfortran3.
For example for debian or Ubuntu, type "sudo apt-get install libgfortran3"
For more information, see https://github.com/mikiobraun/jblas/wiki/Missing-Libraries
15/03/02 14:50:25 ERROR executor.Executor: Exception in task 22.0 in stage 6.0 (TID 374)
java.lang.UnsatisfiedLinkError: org.jblas.NativeBlas.dposv(CII[DII[DII)I
at org.jblas.NativeBlas.dposv(Native Method)
at org.jblas.SimpleBlas.posv(SimpleBlas.java:369)
On Linux 64bit, you need additional support libraries.
You need to install libgfortran3.
For example for debian or Ubuntu, type "sudo apt-get install libgfortran3"
For more information, see https://github.com/mikiobraun/jblas/wiki/Missing-Libraries
15/03/02 14:50:25 ERROR executor.Executor: Exception in task 22.0 in stage 6.0 (TID 374)
java.lang.UnsatisfiedLinkError: org.jblas.NativeBlas.dposv(CII[DII[DII)I
at org.jblas.NativeBlas.dposv(Native Method)
at org.jblas.SimpleBlas.posv(SimpleBlas.java:369)
This same exact code runs fine on the BDA 4.1 cluster with OL 6.5.
Cause
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
| Symptoms |
| Cause |
| Solution |
| References |