You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Huaxin Gao (Jira)" <ji...@apache.org> on 2020/03/02 04:39:00 UTC
[jira] [Comment Edited] (SPARK-30990) Binary incompatibility
changes
[ https://issues.apache.org/jira/browse/SPARK-30990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047953#comment-17047953 ]
Huaxin Gao edited comment on SPARK-30990 at 3/2/20 4:38 AM:
------------------------------------------------------------
cc [~smilegator]
I audited all the MiMa exclusions added for 3.0 (except ML related ones which are documented in https://issues.apache.org/jira/browse/SPARK-30928):
A few of them are not necessary any more. I removed those in these two PRs:
[https://github.com/apache/spark/pull/27729]
[https://github.com/apache/spark/pull/27731]
Here are the results of my auditing:
False Positive:
https://issues.apache.org/jira/browse/SPARK-29306
remove case class in private object
https://issues.apache.org/jira/browse/SPARK-28486
remove method from a private class
https://issues.apache.org/jira/browse/SPARK-27090
remove private member variable
https://issues.apache.org/jira/browse/SPARK-26254
rename a private class
https://issues.apache.org/jira/browse/SPARK-24109
remove a private variable in a private object
https://issues.apache.org/jira/browse/SPARK-25680
change a private constructor
https://issues.apache.org/jira/browse/SPARK-23781
remove private method
https://issues.apache.org/jira/browse/SPARK-26362
change private methods
https://issues.apache.org/jira/browse/SPARK-26457
private constructor change
https://issues.apache.org/jira/browse/SPARK-28957
change method in a private class
https://issues.apache.org/jira/browse/SPARK-29348
change private constructor
https://issues.apache.org/jira/browse/SPARK-29543
change private constructor
https://issues.apache.org/jira/browse/SPARK-30667
change private case class
Methods added in 3.0.0 (ReversedMissingMethodProblem)
https://issues.apache.org/jira/browse/SPARK-27366
https://issues.apache.org/jira/browse/SPARK-29417
https://issues.apache.org/jira/browse/SPARK-24243
Remove deprecated:
https://issues.apache.org/jira/browse/SPARK-25908
https://issues.apache.org/jira/browse/SPARK-16775
https://issues.apache.org/jira/browse/SPARK-25862
https://issues.apache.org/jira/browse/SPARK-28199
https://issues.apache.org/jira/browse/SPARK-28980
Breaking API change:
https://issues.apache.org/jira/browse/SPARK-29399
remove a public interface (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-26132
remove support for Scala 2.11 in Spark 3.0.0
https://issues.apache.org/jira/browse/SPARK-26329
add a new member variable to a case class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-26311
add a new member variable to a case class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-27630
add a new member variable to a case class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-26632
SparkTransportConf.fromSparkConf signature change
https://issues.apache.org/jira/browse/SPARK-25737
remove JavaSparkContextVarargsWorkaround
It has release notes
https://issues.apache.org/jira/browse/SPARK-19287
JavaPairRDD flatMapValues requires function returning Iterable, not Iterator
it has release notes
https://issues.apache.org/jira/browse/SPARK-26193
add a new member variable to a class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-27521
move data source v2 API to catalyst module
https://issues.apache.org/jira/browse/SPARK-26216
The implementation of UserDefinedFunction changed to a trait in Spark 3.0.0.
Migration guide was updated
https://issues.apache.org/jira/browse/SPARK-28556
method signature changed (it's a DeveloperApi)
it has release notes
https://issues.apache.org/jira/browse/SPARK-25341
class signature changed
https://issues.apache.org/jira/browse/SPARK-25528
data source V2 API refactoring
was (Author: huaxingao):
cc [~smilegator]
I audited all the MiMa exclusions added for 3.0 (except ML related ones which are documented in https://issues.apache.org/jira/browse/SPARK-30928):
A few of them are not necessary any more. I removed those in these two PRs:
[https://github.com/apache/spark/pull/27729]
[https://github.com/apache/spark/pull/27731]
Here are the results of my auditing:
False Positive:
https://issues.apache.org/jira/browse/SPARK-29306
remove case class in private object
https://issues.apache.org/jira/browse/SPARK-28486
remove method from a private class
https://issues.apache.org/jira/browse/SPARK-27090
remove private member variable
https://issues.apache.org/jira/browse/SPARK-26254
rename a private class
https://issues.apache.org/jira/browse/SPARK-24109
remove a private variable in a private object
https://issues.apache.org/jira/browse/SPARK-25680
change a private constructor
https://issues.apache.org/jira/browse/SPARK-23781
remove private method
https://issues.apache.org/jira/browse/SPARK-26362
change private methods
https://issues.apache.org/jira/browse/SPARK-26457
private constructor change
https://issues.apache.org/jira/browse/SPARK-28957
change method in a private class
https://issues.apache.org/jira/browse/SPARK-29348
change private constructor
https://issues.apache.org/jira/browse/SPARK-29543
change private constructor
https://issues.apache.org/jira/browse/SPARK-30667
change private case class
Methods added in 3.0.0 (ReversedMissingMethodProblem)
https://issues.apache.org/jira/browse/SPARK-27366
https://issues.apache.org/jira/browse/SPARK-29417
https://issues.apache.org/jira/browse/SPARK-24243
Remove deprecated:
https://issues.apache.org/jira/browse/SPARK-25908
https://issues.apache.org/jira/browse/SPARK-16775
https://issues.apache.org/jira/browse/SPARK-25862
https://issues.apache.org/jira/browse/SPARK-28199
Breaking API change:
https://issues.apache.org/jira/browse/SPARK-29399
remove a public interface (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-26132
remove support for Scala 2.11 in Spark 3.0.0
https://issues.apache.org/jira/browse/SPARK-26329
add a new member variable to a case class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-26311
add a new member variable to a case class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-27630
add a new member variable to a case class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-26632
SparkTransportConf.fromSparkConf signature change
https://issues.apache.org/jira/browse/SPARK-25737
remove JavaSparkContextVarargsWorkaround
It has release notes
https://issues.apache.org/jira/browse/SPARK-19287
JavaPairRDD flatMapValues requires function returning Iterable, not Iterator
it has release notes
https://issues.apache.org/jira/browse/SPARK-26193
add a new member variable to a class (it's a DeveloperApi)
https://issues.apache.org/jira/browse/SPARK-27521
move data source v2 API to catalyst module
https://issues.apache.org/jira/browse/SPARK-26216
The implementation of UserDefinedFunction changed to a trait in Spark 3.0.0.
Migration guide was updated
https://issues.apache.org/jira/browse/SPARK-28556
method signature changed (it's a DeveloperApi)
it has release notes
https://issues.apache.org/jira/browse/SPARK-25341
class signature changed
https://issues.apache.org/jira/browse/SPARK-25528
data source V2 API refactoring
> Binary incompatibility changes
> ------------------------------
>
> Key: SPARK-30990
> URL: https://issues.apache.org/jira/browse/SPARK-30990
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core, SQL
> Affects Versions: 3.0.0
> Reporter: Huaxin Gao
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org