You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2022/01/27 03:20:00 UTC

[jira] [Commented] (SPARK-38040) Enable binary compatibility check for APIs in Catalyst, KVStore and Avro modules

    [ https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482854#comment-17482854 ] 

Apache Spark commented on SPARK-38040:
--------------------------------------

User 'HyukjinKwon' has created a pull request for this issue:
https://github.com/apache/spark/pull/35339

> Enable binary compatibility check for APIs in Catalyst, KVStore and Avro modules
> --------------------------------------------------------------------------------
>
>                 Key: SPARK-38040
>                 URL: https://issues.apache.org/jira/browse/SPARK-38040
>             Project: Spark
>          Issue Type: Test
>          Components: Build
>    Affects Versions: 3.3.0
>            Reporter: Hyukjin Kwon
>            Priority: Major
>
> {code}
> ./dev/mima
> {code}
> We don't currently run binary compatibility check in below modules:
> {code}
> [info] spark-parent: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-network-common: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-tags: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-unsafe: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-network-shuffle: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-kvstore: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-tools: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-token-provider-kafka-0-10: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-streaming-kafka-0-10-assembly: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-catalyst: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-repl: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-avro: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-sql-kafka-0-10: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-hive: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-assembly: mimaPreviousArtifacts not set, not analyzing binary compatibility
> [info] spark-examples: mimaPreviousArtifacts not set, not analyzing binary compatibility
> {code}
> However, there are some APIs under these modules. For example, https://github.com/apache/spark/blob/master/python/pyspark/sql/avro/functions.py for Avro,  https://github.com/apache/spark/tree/master/common/kvstore/src/main/java/org/apache/spark/util/kvstore for KVStore (to be API), and https://github.com/apache/spark/tree/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector for Catalyst



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org