You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "William Grim (JIRA)" <ji...@apache.org> on 2016/04/29 06:30:13 UTC
[jira] [Commented] (SPARK-4820) Spark build encounters "File name
too long" on some encrypted filesystems
[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263516#comment-15263516 ]
William Grim commented on SPARK-4820:
-------------------------------------
Hi, this is still an issue to this day. I just started using Spark and am building Spark 1.6.1 on both my workstation at home and my workstation at work. On both systems, I use Ubuntu 15.10, both with some fairly beefy hardware (32 GB RAM at home and 16 GB at work). Is it possible just to go ahead and get this fix into the pom and SBT? Does that earlier warning actually hold valid? If it does, we should figure out what's wrong with that instead of (all of?) us modifying the build each time.
> Spark build encounters "File name too long" on some encrypted filesystems
> -------------------------------------------------------------------------
>
> Key: SPARK-4820
> URL: https://issues.apache.org/jira/browse/SPARK-4820
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
> Reporter: Patrick Wendell
> Assignee: Theodore Vasiloudis
> Priority: Minor
> Fix For: 1.4.0
>
>
> This was reported by Luchesar Cekov on github along with a proposed fix. The fix has some potential downstream issues (it will modify the classnames) so until we understand better how many users are affected we aren't going to merge it. However, I'd like to include the issue and workaround here. If you encounter this issue please comment on the JIRA so we can assess the frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error]
> [error] ConstantType(value = Constant(Throwable))
> [error]
> [error] uncaught exception during compilation: java.io.IOException
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add:
> {code}
> + <arg>-Xmax-classfile-name</arg>
> + <arg>128</arg>
> {code}
> In SBT add:
> {code}
> + scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org