You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xin Lu (JIRA)" <ji...@apache.org> on 2017/10/30 04:05:00 UTC
[jira] [Comment Edited] (SPARK-20000) Spark Hive tests aborted due
to lz4-java on ppc64le
[ https://issues.apache.org/jira/browse/SPARK-20000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224358#comment-16224358 ]
Xin Lu edited comment on SPARK-20000 at 10/30/17 4:04 AM:
----------------------------------------------------------
I checked the dependencies and it looks like lz4-java already updated to 1.4.0: https://github.com/apache/spark/blob/master/pom.xml#L538
lz4 1.4.0 was released august 2nd and looks like it included the patch above. This is probably resolvable now.
This should be a dupe of this: https://github.com/apache/spark/commit/b78cf13bf05f0eadd7ae97df84b6e1505dc5ff9f
[SPARK-21276][CORE] Update lz4-java to the latest (v1.4.0)
was (Author: xynny):
I checked the dependencies and it looks like lz4-java already updated to 1.4.0: https://github.com/apache/spark/blob/master/pom.xml#L538
lz4 1.4.0 was released august 2nd and looks like it included the patch above. This is probably resolvable now.
> Spark Hive tests aborted due to lz4-java on ppc64le
> ---------------------------------------------------
>
> Key: SPARK-20000
> URL: https://issues.apache.org/jira/browse/SPARK-20000
> Project: Spark
> Issue Type: Improvement
> Components: Tests
> Affects Versions: 2.2.0
> Environment: Ubuntu 14.04 ppc64le
> $ java -version
> openjdk version "1.8.0_111"
> OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
> OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode)
> Reporter: Sonia Garudi
> Priority: Minor
> Labels: ppc64le
> Attachments: hs_err_pid.log
>
>
> The tests are getting aborted in Spark Hive project with the following error :
> {code:borderStyle=solid}
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x00003fff94dbf114, pid=6160, tid=0x00003fff6efef1a0
> #
> # JRE version: OpenJDK Runtime Environment (8.0_111-b14) (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
> # Java VM: OpenJDK 64-Bit Server VM (25.111-b14 mixed mode linux-ppc64 compressed oops)
> # Problematic frame:
> # V [libjvm.so+0x56f114]
> {code}
> In the thread log file, I found the following traces :
> Event: 3669.042 Thread 0x00003fff89976800 Exception <a 'java/lang/NoClassDefFoundError': Could not initialize class net.jpountz.lz4.LZ4JNI> (0x000000079fcda3b8) thrown at [/build/openjdk-8-fVIxxI/openjdk-8-8u111-b14/src/hotspot/src/share/vm/oops/instanceKlass.cpp, line 890]
> This error is due to the lz4-java (version 1.3.0), which doesn’t have support for ppc64le.PFA the thread log file.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org