[iceberg] branch master updated: Spark: Moves Distribution and Ordering Utils to Spark3 Module (#2820)

[ru...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

russellspitzer pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git


The following commit(s) were added to refs/heads/master by this push:
     new a84fa30  Spark: Moves Distribution and Ordering Utils to Spark3 Module (#2820)
a84fa30 is described below

commit a84fa30337849450a2b97e2f57153eace572516a
Author: Russell Spitzer <rs...@apple.com>
AuthorDate: Thu Sep 9 09:01:01 2021 -0500

    Spark: Moves Distribution and Ordering Utils to Spark3 Module (#2820)
    
    To enable core Spark3 code to use distribution and ordering information when
    performing writes or other operations. One example is to allow Sort Strategy
    to transform SortOrder information so it can be used when rewriting data files.
---
 build.gradle                                                            | 2 ++
 .../apache/spark/sql/catalyst/expressions/TransformExpressions.scala    | 0
 .../apache/spark/sql/catalyst/utils/DistributionAndOrderingUtils.scala  | 0
 .../src/main/scala/org/apache/spark/sql/catalyst/utils/PlanUtils.scala  | 0
 4 files changed, 2 insertions(+)

diff --git a/build.gradle b/build.gradle
index dd99804..86cc532 100644
--- a/build.gradle
+++ b/build.gradle
@@ -986,6 +986,8 @@ if (jdkVersion == '8') {
 }
 
 project(':iceberg-spark3') {
+  apply plugin: 'scala'
+
   sourceSets {
     // Compile test source against Spark 3.1 and main classes compiled against Spark 3.0
     spark31 {
diff --git a/spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/expressions/TransformExpressions.scala b/spark3/src/main/scala/org/apache/spark/sql/catalyst/expressions/TransformExpressions.scala
similarity index 100%
rename from spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/expressions/TransformExpressions.scala
rename to spark3/src/main/scala/org/apache/spark/sql/catalyst/expressions/TransformExpressions.scala
diff --git a/spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/utils/DistributionAndOrderingUtils.scala b/spark3/src/main/scala/org/apache/spark/sql/catalyst/utils/DistributionAndOrderingUtils.scala
similarity index 100%
rename from spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/utils/DistributionAndOrderingUtils.scala
rename to spark3/src/main/scala/org/apache/spark/sql/catalyst/utils/DistributionAndOrderingUtils.scala
diff --git a/spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/utils/PlanUtils.scala b/spark3/src/main/scala/org/apache/spark/sql/catalyst/utils/PlanUtils.scala
similarity index 100%
rename from spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/utils/PlanUtils.scala
rename to spark3/src/main/scala/org/apache/spark/sql/catalyst/utils/PlanUtils.scala