[jira] [Commented] (SPARK-3532) Spark On FreeBSD. Snappy used by torrent broadcast fails to load native libs.

["Radim Kolar (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133821#comment-14133821 ] 

Radim Kolar commented on SPARK-3532:
------------------------------------

you need to grab snappy native library from _snappy-java_ freebsd port, its not included in maven central JAR.

{quote}
(hsn@sanatana:pts/8):~% pkg info -l snappyjava
snappyjava-1.0.4.1_1:
        /usr/local/lib/libsnappyjava.so
        /usr/local/share/java/classes/snappy-java.jar
{quote}

> Spark On FreeBSD. Snappy used by torrent broadcast fails to load native libs.
> -----------------------------------------------------------------------------
>
>                 Key: SPARK-3532
>                 URL: https://issues.apache.org/jira/browse/SPARK-3532
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Prashant Sharma
>            Priority: Minor
>
> While trying out spark on freebsd, this seemed like first blocker. 
> Workaround: In conf/spark-defaults.conf, Set "spark.broadcast.compress 	false"
> Even better workaround is set:
> spark.io.compression.codec 	lzf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org