You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2016/10/18 20:59:58 UTC
[jira] [Comment Edited] (SPARK-17985) Bump commons-lang3 version to
3.5.
[ https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586644#comment-15586644 ]
Reynold Xin edited comment on SPARK-17985 at 10/18/16 8:59 PM:
---------------------------------------------------------------
The patch was reverted due to build failures in Hadoop 2.2:
Actually I'm seeing the following exceptions locally as well as on Jenkins for Hadoop 2.2:
{noformat}
[error] /scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1489: value read is not a member of object org.apache.commons.io.IOUtils
[error] var numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
[error] /scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1492: value read is not a member of object org.apache.commons.io.IOUtils
[error] numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
{noformat}
I'm going to revert the patch for now.
was (Author: rxin):
The patch was reverted due to build failures in Hadoop 2.2:
Actually I'm seeing the following exceptions locally as well as on Jenkins for Hadoop 2.2:
```
[error] /scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1489: value read is not a member of object org.apache.commons.io.IOUtils
[error] var numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
[error] /scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1492: value read is not a member of object org.apache.commons.io.IOUtils
[error] numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
```
I'm going to revert the patch for now.
> Bump commons-lang3 version to 3.5.
> ----------------------------------
>
> Key: SPARK-17985
> URL: https://issues.apache.org/jira/browse/SPARK-17985
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Takuya Ueshin
> Assignee: Takuya Ueshin
> Fix For: 2.1.0
>
>
> {{SerializationUtils.clone()}} of commons-lang3 (<3.5) has a bug that break thread safety, which gets stack sometimes caused by race condition of initializing hash map.
> See https://issues.apache.org/jira/browse/LANG-1251.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org