You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Davis Eric Broda (Jira)" <ji...@apache.org> on 2019/09/09 15:27:00 UTC

[jira] [Commented] (HUDI-238) Make separate release for hudi spark/scala based packages for scala 2.12

    [ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925776#comment-16925776 ] 

Davis Eric Broda commented on HUDI-238:
---------------------------------------

Reposting from the github ticket, now that I've found the jira:

 

The actual dependency I ran into for upgrading to 2.12 is kafka. Kafka 0.8 does not have a scala 2.12 version, so this require updating to Kafka 0.10 or higher. However the spark streaming kafka classes have changed enough that it is non-trivial to update. In particular the {{org.apache.spark.streaming.kafka.KafkaCluster}} class used in {{KafkaOffsetGen.java}} no longer exists, and does not have a clear replacement in kafka 0.10, which renders it difficult to upgrade.

> Make separate release for hudi spark/scala based packages for scala 2.12 
> -------------------------------------------------------------------------
>
>                 Key: HUDI-238
>                 URL: https://issues.apache.org/jira/browse/HUDI-238
>             Project: Apache Hudi (incubating)
>          Issue Type: Sub-task
>          Components: asf-migration
>            Reporter: BALAJI VARADARAJAN
>            Priority: Major
>
> [https://github.com/apache/incubator-hudi/issues/881#issuecomment-528700749]



--
This message was sent by Atlassian Jira
(v8.3.2#803003)