You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by bl...@apache.org on 2020/12/14 19:02:26 UTC
[spark] branch master updated (839d689 -> 82aca7e)
This is an automated email from the ASF dual-hosted git repository.
blue pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 839d689 [SPARK-33733][SQL] PullOutNondeterministic should check and collect deterministic field
add 82aca7e [SPARK-33779][SQL] DataSource V2: API to request distribution and ordering on write
No new revisions were added by this update.
Summary of changes:
.../distributions/ClusteredDistribution.java | 35 ++++++++
.../sql/connector/distributions/Distribution.java | 28 +++++++
.../sql/connector/distributions/Distributions.java | 56 +++++++++++++
.../distributions/OrderedDistribution.java | 35 ++++++++
.../distributions/UnspecifiedDistribution.java | 28 +++++++
.../sql/connector/expressions/Expressions.java | 11 +++
.../sql/connector/expressions/NullOrdering.java | 42 ++++++++++
.../sql/connector/expressions/SortDirection.java | 42 ++++++++++
.../spark/sql/connector/expressions/SortOrder.java | 43 ++++++++++
.../write/RequiresDistributionAndOrdering.java | 57 +++++++++++++
.../write/{WriteBuilder.java => Write.java} | 33 +++++---
.../spark/sql/connector/write/WriteBuilder.java | 39 ++++++---
.../connector/distributions/distributions.scala | 59 +++++++++++++
.../sql/connector/expressions/expressions.scala | 96 ++++++++++++++++++++++
14 files changed, 581 insertions(+), 23 deletions(-)
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/distributions/ClusteredDistribution.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/distributions/Distribution.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/distributions/Distributions.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/distributions/OrderedDistribution.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/distributions/UnspecifiedDistribution.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/NullOrdering.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/SortDirection.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/SortOrder.java
create mode 100644 sql/catalyst/src/main/java/org/apache/spark/sql/connector/write/RequiresDistributionAndOrdering.java
copy sql/catalyst/src/main/java/org/apache/spark/sql/connector/write/{WriteBuilder.java => Write.java} (66%)
create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/connector/distributions/distributions.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org