You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by cloud-fan <gi...@git.apache.org> on 2018/03/08 04:15:14 UTC

[GitHub] spark pull request #20525: [SPARK-23271[SQL] Parquet output contains only _S...

Github user cloud-fan commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20525#discussion_r173060209
  
    --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala ---
    @@ -202,7 +211,7 @@ object FileFormatWriter extends Logging {
                 committer,
                 iterator = iter)
             },
    -        0 until rdd.partitions.length,
    +        0 until rddWithNonEmptyPartitions.partitions.length,
    --- End diff --
    
    nit: `rddWithNonEmptyPartitions.partitions.indices`


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org