You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/06/23 04:39:42 UTC
[GitHub] [spark] cloud-fan commented on a change in pull request #28900: [SPARK-32056][SQL] Coalesce partitions for repartition by expressions when AQE is enabled
cloud-fan commented on a change in pull request #28900:
URL: https://github.com/apache/spark/pull/28900#discussion_r443956937
##########
File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala
##########
@@ -2991,17 +2991,9 @@ class Dataset[T] private[sql](
Repartition(numPartitions, shuffle = true, logicalPlan)
}
- /**
- * Returns a new Dataset partitioned by the given partitioning expressions into
- * `numPartitions`. The resulting Dataset is hash partitioned.
- *
- * This is the same operation as "DISTRIBUTE BY" in SQL (Hive QL).
- *
- * @group typedrel
- * @since 2.0.0
- */
- @scala.annotation.varargs
- def repartition(numPartitions: Int, partitionExprs: Column*): Dataset[T] = {
+ private def repartitionByExpression(
+ numPartitions: Option[Int],
+ partitionExprs: Column*): Dataset[T] = {
Review comment:
for internal method, we don't need to use var-length parameter list.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org