[jira] [Commented] (SPARK-30990) Binary incompatibility changes

["Huaxin Gao (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-30990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047953#comment-17047953 ] 

Huaxin Gao commented on SPARK-30990:
------------------------------------

cc [~smilegator]

I audited all the MiMa exclusions  added for 3.0 (except ML related ones which are documented in https://issues.apache.org/jira/browse/SPARK-30928):

A few of them are not necessary any more. I removed those in these two PRs:

[https://github.com/apache/spark/pull/27729]

[https://github.com/apache/spark/pull/27731]

Here are the results of my auditing:

False Positive:
https://issues.apache.org/jira/browse/SPARK-29306
remove case class in private object

https://issues.apache.org/jira/browse/SPARK-28486
remove method from a private class

https://issues.apache.org/jira/browse/SPARK-27090
remove private member variable

https://issues.apache.org/jira/browse/SPARK-26254
rename a private class

https://issues.apache.org/jira/browse/SPARK-24109
remove a private variable in a private object

https://issues.apache.org/jira/browse/SPARK-25680
change a private constructor

https://issues.apache.org/jira/browse/SPARK-23781
remove private method

https://issues.apache.org/jira/browse/SPARK-26362
change private methods

https://issues.apache.org/jira/browse/SPARK-26457
private constructor change

https://issues.apache.org/jira/browse/SPARK-28957
change method in a private class

https://issues.apache.org/jira/browse/SPARK-29348
change private constructor

https://issues.apache.org/jira/browse/SPARK-29543
change private constructor

https://issues.apache.org/jira/browse/SPARK-30667
change private case class

Methods added in 3.0.0 (ReversedMissingMethodProblem)
https://issues.apache.org/jira/browse/SPARK-27366
https://issues.apache.org/jira/browse/SPARK-29417
https://issues.apache.org/jira/browse/SPARK-24243


Remove deprecated:
https://issues.apache.org/jira/browse/SPARK-25908
https://issues.apache.org/jira/browse/SPARK-16775
https://issues.apache.org/jira/browse/SPARK-25862
https://issues.apache.org/jira/browse/SPARK-28199


Breaking API change:
https://issues.apache.org/jira/browse/SPARK-29399
remove a public interface (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26132
remove support for Scala 2.11 in Spark 3.0.0

https://issues.apache.org/jira/browse/SPARK-26329
add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26311
add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-27630
add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26632
SparkTransportConf.fromSparkConf signature change

https://issues.apache.org/jira/browse/SPARK-25737
remove JavaSparkContextVarargsWorkaround
It has release notes

https://issues.apache.org/jira/browse/SPARK-19287
JavaPairRDD flatMapValues requires function returning Iterable, not Iterator
it has release notes

https://issues.apache.org/jira/browse/SPARK-26193
add a new member variable to a class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-27521
move data source v2 API to catalyst module

https://issues.apache.org/jira/browse/SPARK-26216
The implementation of UserDefinedFunction changed to a trait in Spark 3.0.0.
Migration guide was updated

https://issues.apache.org/jira/browse/SPARK-28556
method signature changed (it's a DeveloperApi)
it has release notes

https://issues.apache.org/jira/browse/SPARK-25341
class signature changed

https://issues.apache.org/jira/browse/SPARK-25528
data source V2 API refactoring

 

 

> Binary incompatibility changes
> ------------------------------
>
>                 Key: SPARK-30990
>                 URL: https://issues.apache.org/jira/browse/SPARK-30990
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core, SQL
>    Affects Versions: 3.0.0
>            Reporter: Huaxin Gao
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org