You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/04/29 20:07:06 UTC
[jira] [Assigned] (SPARK-7238) Upgrade protobuf-java
(com.google.protobuf) version from 2.4.1 to 2.5.0
[ https://issues.apache.org/jira/browse/SPARK-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-7238:
-----------------------------------
Assignee: (was: Apache Spark)
> Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0
> -----------------------------------------------------------------------
>
> Key: SPARK-7238
> URL: https://issues.apache.org/jira/browse/SPARK-7238
> Project: Spark
> Issue Type: Dependency upgrade
> Components: Build
> Affects Versions: 1.3.1
> Environment: Ubuntu 14.04. Apache Mesos in cluster mode with HDFS from cloudera 2.5.0-cdh5.3.3.
> Reporter: Favio Vázquez
> Priority: Blocker
> Labels: 2.5.0-cdh5.3.3, CDH5, HDFS, Mesos
> Fix For: 1.3.0, 1.3.1
>
>
> This upgrade is needed when building spark for CDH5 2.5.0-cdh5.3.3 due to incompatibilities in the protobuf version used by com.google.protobuf and the one used in hadoop. The default version of protobuf is set to 2.4.1 in the global properties, and this is stated in the pom.xml file:
> <!-- In theory we need not directly depend on protobuf since Spark does not directly use it. However, when building with Hadoop/YARN 2.2 Maven doesn't correctly bump the protobuf version up from the one Mesos gives. For now we include this variable to explicitly bump the version when building with YARN. It would be nice to figure out why Maven can't resolve this correctly (like SBT does). -->
> So this upgrade will only be affecting the com.google.protobuf version of java-protobuf. Tested for the Cloudera distribution 2.5.0-cdh5.3.3 using Mesos 0.22.0 in cluster mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org