You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/01/16 07:25:58 UTC
[GitHub] [spark] wangyum opened a new pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
wangyum opened a new pull request #31205:
URL: https://github.com/apache/spark/pull/31205
### What changes were proposed in this pull request?
This pr keep necessary stats after partition pruning.
### Why are the changes needed?
Improve query performance. Please see the log:
```
join.right.stats: org.apache.spark.sql.catalyst.optimizer.PushDownPredicates. : Statistics(sizeInBytes=348.8 KiB, rowCount=1.79E+4)
join.right.stats: org.apache.spark.sql.execution.datasources.PruneFileSourcePartitions. : Statistics(sizeInBytes=1414.2 EiB)
```
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Unit test.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761558162
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134138/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761523516
**[Test build #134138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134138/testReport)** for PR 31205 at commit [`d08ad4e`](https://github.com/apache/spark/commit/d08ad4eaa0a456fc88ac9b20e43c504a125e2082).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] cloud-fan closed pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
cloud-fan closed pull request #31205:
URL: https://github.com/apache/spark/pull/31205
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762301800
**[Test build #134198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134198/testReport)** for PR 31205 at commit [`f83288d`](https://github.com/apache/spark/commit/f83288dfee930c2e3807caf507bc755c7753f0c4).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] cloud-fan commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
cloud-fan commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762066754
shall we do the same in PruneHiveTablePartitions?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762301800
**[Test build #134198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134198/testReport)** for PR 31205 at commit [`f83288d`](https://github.com/apache/spark/commit/f83288dfee930c2e3807caf507bc755c7753f0c4).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] cloud-fan commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
cloud-fan commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762623679
thanks, merging to master!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761552616
**[Test build #134138 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134138/testReport)** for PR 31205 at commit [`d08ad4e`](https://github.com/apache/spark/commit/d08ad4eaa0a456fc88ac9b20e43c504a125e2082).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762328915
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38783/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761535758
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38721/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762443768
**[Test build #134198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134198/testReport)** for PR 31205 at commit [`f83288d`](https://github.com/apache/spark/commit/f83288dfee930c2e3807caf507bc755c7753f0c4).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] peter-toth commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
peter-toth commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761542099
This looks much better than my PR: https://github.com/apache/spark/pull/29132
@wangyum I wonder if you checked other than q14 query improvements?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] Gabriel39 commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
Gabriel39 commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-947302027
Hi @wangyum @cloud-fan I noticed this PR recently and found partition stats is supported by stats estimation in this PR. As you know, for partitioned table, stats in Hive is partition-based and in Spark is whole-table based. So in our internal Spark fork, if datasource is hive table and table has been analyzed already, we implement partition stats by reading hive partition stats directly from hive metastore. I want to know your opnions about this, if you are interested in this way, I will submit a PR soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762367845
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38783/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761528744
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38721/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] cloud-fan commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
cloud-fan commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762027983
This patch alone doesn't change the query plan, so I think it's fine to skip benchmark as it shouldn't change anything.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761533858
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38721/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762367845
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38783/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] wangyum commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
wangyum commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762279537
> shall we do the same in PruneHiveTablePartitions?
Yes, PruneHiveTablePartitions also has this issue.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] wangyum commented on a change in pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
wangyum commented on a change in pull request #31205:
URL: https://github.com/apache/spark/pull/31205#discussion_r559598980
##########
File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PrunePartitionSuiteBase.scala
##########
@@ -17,14 +17,13 @@
package org.apache.spark.sql.hive.execution
-import org.apache.spark.sql.QueryTest
+import org.apache.spark.sql.StatisticsCollectionTestBase
import org.apache.spark.sql.catalyst.expressions.{AttributeReference, BinaryOperator, Expression, IsNotNull, Literal}
import org.apache.spark.sql.execution.{FileSourceScanExec, SparkPlan}
import org.apache.spark.sql.hive.test.TestHiveSingleton
import org.apache.spark.sql.internal.SQLConf.ADAPTIVE_EXECUTION_ENABLED
-import org.apache.spark.sql.test.SQLTestUtils
-abstract class PrunePartitionSuiteBase extends QueryTest with SQLTestUtils with TestHiveSingleton {
+abstract class PrunePartitionSuiteBase extends StatisticsCollectionTestBase with TestHiveSingleton {
Review comment:
this change to use `checkOptimizedPlanStats` from `StatisticsCollectionTestBase `.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761535758
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38721/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761558162
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134138/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762343829
Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38783/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-761523516
**[Test build #134138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134138/testReport)** for PR 31205 at commit [`d08ad4e`](https://github.com/apache/spark/commit/d08ad4eaa0a456fc88ac9b20e43c504a125e2082).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762444460
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134198/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #31205:
URL: https://github.com/apache/spark/pull/31205#issuecomment-762444460
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134198/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org