You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/09/12 10:22:45 UTC

[jira] [Updated] (SPARK-10566) SnappyCompressionCodec init exception handling masks important error information

     [ https://issues.apache.org/jira/browse/SPARK-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-10566:
------------------------------
    Assignee: Daniel Imfeld

> SnappyCompressionCodec init exception handling masks important error information
> --------------------------------------------------------------------------------
>
>                 Key: SPARK-10566
>                 URL: https://issues.apache.org/jira/browse/SPARK-10566
>             Project: Spark
>          Issue Type: Bug
>          Components: Input/Output
>    Affects Versions: 1.5.0
>            Reporter: Daniel Imfeld
>            Assignee: Daniel Imfeld
>            Priority: Minor
>             Fix For: 1.6.0, 1.5.1
>
>
> The change to always throw an IllegalArgumentException when failing to load in SnappyCompressionCodec (CompressionCodec.scala:151) throws away the description from the exception thrown, which makes it really difficult to actually figure out what the problem is:
> : java.lang.IllegalArgumentException
> 	at org.apache.spark.io.SnappyCompressionCodec.<init>(CompressionCodec.scala:151)
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> Removing this try...catch I get the following error, which actually gives some information about how to fix the problem:
> : java.lang.UnsatisfiedLinkError: no snappyjava in java.library.path
> 	at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1864)
> 	at java.lang.Runtime.loadLibrary0(Runtime.java:870)
> 	at java.lang.System.loadLibrary(System.java:1122)
> 	at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:178)
> 	at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
> A change to initialize the IllegalArgumentException with the value of e.getMessage() would be great, as the current error without any description just leads to a lot of frustrating guesswork.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org