You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Sean Busbey (JIRA)" <ji...@apache.org> on 2016/07/19 15:04:20 UTC
[jira] [Commented] (HBASE-16246) Ensure avro version in hbase-spark
matches that shipped in our default hadoop profile
[ https://issues.apache.org/jira/browse/HBASE-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384304#comment-15384304 ]
Sean Busbey commented on HBASE-16246:
-------------------------------------
Worth noting that both the version we have now and the version proposed are different from the one shipped in the version of Spark that we declare in the current hbase-spark module.
{code}
Busbey-MBA:hbase busbey$ mvn dependency:list | grep "org.apache.avro"
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.6:compile
[INFO] org.apache.avro:avro-ipc:jar:tests:1.7.7:provided
[INFO] org.apache.avro:avro-mapred:jar:hadoop2:1.7.7:provided
[INFO] org.apache.avro:avro-ipc:jar:1.7.7:provided
[INFO] org.apache.avro:avro:jar:1.7.6:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
[INFO] org.apache.avro:avro:jar:1.7.4:compile
{code}
1.7.4s are hadoop, 1.7.6 is us in hbase-spark, 1.7.7 is spark through transitive.
> Ensure avro version in hbase-spark matches that shipped in our default hadoop profile
> -------------------------------------------------------------------------------------
>
> Key: HBASE-16246
> URL: https://issues.apache.org/jira/browse/HBASE-16246
> Project: HBase
> Issue Type: Bug
> Components: spark
> Affects Versions: 2.0.0
> Reporter: Sean Busbey
> Priority: Blocker
> Fix For: 2.0.0
>
>
> currently, the hbase-spark module pulls in avro 1.7.6. We should keep this matching the version in our default hadoop to keep things consistent (as of Hadoop 2.7.1 that's avro 1.7.4).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)