You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Davis Eric Broda (Jira)" <ji...@apache.org> on 2019/09/09 15:27:00 UTC
[jira] [Commented] (HUDI-238) Make separate release for hudi
spark/scala based packages for scala 2.12
[ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925776#comment-16925776 ]
Davis Eric Broda commented on HUDI-238:
---------------------------------------
Reposting from the github ticket, now that I've found the jira:
The actual dependency I ran into for upgrading to 2.12 is kafka. Kafka 0.8 does not have a scala 2.12 version, so this require updating to Kafka 0.10 or higher. However the spark streaming kafka classes have changed enough that it is non-trivial to update. In particular the {{org.apache.spark.streaming.kafka.KafkaCluster}} class used in {{KafkaOffsetGen.java}} no longer exists, and does not have a clear replacement in kafka 0.10, which renders it difficult to upgrade.
> Make separate release for hudi spark/scala based packages for scala 2.12
> -------------------------------------------------------------------------
>
> Key: HUDI-238
> URL: https://issues.apache.org/jira/browse/HUDI-238
> Project: Apache Hudi (incubating)
> Issue Type: Sub-task
> Components: asf-migration
> Reporter: BALAJI VARADARAJAN
> Priority: Major
>
> [https://github.com/apache/incubator-hudi/issues/881#issuecomment-528700749]
--
This message was sent by Atlassian Jira
(v8.3.2#803003)