You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2022/03/25 09:16:00 UTC

[jira] [Comment Edited] (HUDI-3681) Provision additional bundles aliased to Spark minor version

    [ https://issues.apache.org/jira/browse/HUDI-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512266#comment-17512266 ] 

Raymond Xu edited comment on HUDI-3681 at 3/25/22, 9:15 AM:
------------------------------------------------------------

let me enumerate what we already have in 0.10.0 (ignoring 0.10.1 which is an outlier having 3 digits) (ref: https://search.maven.org/)
{code:java}
org.apache.hudi:hudi-spark-bundle_2.11:0.10.0
org.apache.hudi:hudi-spark-bundle_2.12:0.10.0
org.apache.hudi:hudi-spark3-bundle_2.12:0.10.0{code}
we need these for 0.11.0
{code:java}
org.apache.hudi:hudi-spark-bundle_2.11:0.11.0 (alias to spark2.4, for BWC)
org.apache.hudi:hudi-spark2.4-bundle_2.12:0.11.0
org.apache.hudi:hudi-spark-bundle_2.12:0.11.0 (alias to spark2.4, for BWC)
org.apache.hudi:hudi-spark2.4-bundle_2.12:0.11.0
org.apache.hudi:hudi-spark3-bundle_2.12:0.11.0 (alias to spark3.2, for BWC)
org.apache.hudi:hudi-spark3.1-bundle_2.12:0.11.0
org.apache.hudi:hudi-spark3.2-bundle_2.12:0.11.0{code}


was (Author: xushiyan):
let me enumerate what we already have
{code:java}
org.apache.hudi:hudi-spark-bundle_2.11:0.10.0{code}
 

> Provision additional bundles aliased to Spark minor version
> -----------------------------------------------------------
>
>                 Key: HUDI-3681
>                 URL: https://issues.apache.org/jira/browse/HUDI-3681
>             Project: Apache Hudi
>          Issue Type: Task
>            Reporter: Alexey Kudinkin
>            Assignee: Ethan Guo
>            Priority: Blocker
>             Fix For: 0.11.0
>
>
> To follow on the updated model of compatibility with Spark, we need to provision additional bundles as part of the 0.11 release referencing Spark minor version in the bundle name ("spark3.1", "spark3.2", "spark2.4") 
> As such following bundles will be released in 0.11
>  * "spark2.4" (Scala 2.11/2.12)
>  * "spark3.1"
>  * "spark3.2"
>  * "spark3" (this is the same as "spark3.2")
>  * "spark2" (Scala 2.11/2.12, this is the same as "spark2.4")



--
This message was sent by Atlassian Jira
(v8.20.1#820001)