You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Daniel Imfeld (JIRA)" <ji...@apache.org> on 2015/09/11 20:05:45 UTC
[jira] [Created] (SPARK-10566) SnappyCompressionCodec init
exception handling masks important error information
Daniel Imfeld created SPARK-10566:
-------------------------------------
Summary: SnappyCompressionCodec init exception handling masks important error information
Key: SPARK-10566
URL: https://issues.apache.org/jira/browse/SPARK-10566
Project: Spark
Issue Type: Bug
Components: Input/Output
Affects Versions: 1.5.0
Reporter: Daniel Imfeld
Priority: Minor
The change to always throw an IllegalArgumentException when failing to load in SnappyCompressionCodec (CompressionCodec.scala:151) throws away the description from the exception thrown, which makes it really difficult to actually figure out what the problem is:
: java.lang.IllegalArgumentException
at org.apache.spark.io.SnappyCompressionCodec.<init>(CompressionCodec.scala:151)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
Removing this try...catch I get the following error, which actually gives some information about how to fix the problem:
: java.lang.UnsatisfiedLinkError: no snappyjava in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1864)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:178)
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
A change to initialize the IllegalArgumentException with the value of e.getMessage() would be great, as the current error without any description just leads to a lot of frustrating guesswork.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org