You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2019/09/09 15:16:33 UTC

[GitHub] [incubator-hudi] DavisBroda commented on issue #881: Cross compilation for scala 2.12.x ?

DavisBroda commented on issue #881: Cross compilation for scala 2.12.x ?
URL: https://github.com/apache/incubator-hudi/issues/881#issuecomment-529526657
 
 
   The actual dependency issue is in kafka. Kafka 0.8 does not have a scala 2.12 version, so this require updating to Kafka 0.10 or higher. However the spark streaming kafka classes have changed enough that it is non-trivial to update. In particular the `org.apache.spark.streaming.kafka.KafkaCluster` class used in KafkaOffsetGen no longer exists, and does not have a clear replacement in kafka 0.10, which renders it difficult to upgrade. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services