You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by maropu <gi...@git.apache.org> on 2018/06/13 23:08:19 UTC

[GitHub] spark pull request #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmar...

Github user maropu commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21288#discussion_r195262751
  
    --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/FilterPushdownBenchmark.scala ---
    @@ -131,211 +132,214 @@ object FilterPushdownBenchmark {
         }
     
         /*
    +    OpenJDK 64-Bit Server VM 1.8.0_171-b10 on Linux 4.14.26-46.32.amzn1.x86_64
         Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
         Select 0 string row (value IS NULL):     Best/Avg Time(ms)    Rate(M/s)   Per Row(ns)   Relative
         ------------------------------------------------------------------------------------------------
    -    Parquet Vectorized                            8452 / 8504          1.9         537.3       1.0X
    -    Parquet Vectorized (Pushdown)                  274 /  281         57.3          17.4      30.8X
    -    Native ORC Vectorized                         8167 / 8185          1.9         519.3       1.0X
    -    Native ORC Vectorized (Pushdown)               365 /  379         43.1          23.2      23.1X
    +    Parquet Vectorized                            2961 / 3123          5.3         188.3       1.0X
    +    Parquet Vectorized (Pushdown)                 3057 / 3121          5.1         194.4       1.0X
    --- End diff --
    
    I have time today, so I'll check v2.3.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org