You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2019/04/18 15:08:42 UTC
[spark] branch master updated: [SPARK-27502][SQL][TEST] Update
nested schema benchmark result for Orc V2
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 9c41bfd [SPARK-27502][SQL][TEST] Update nested schema benchmark result for Orc V2
9c41bfd is described below
commit 9c41bfd83cddf7bf6314378ca7c3acf2c44e7a9b
Author: Liang-Chi Hsieh <vi...@gmail.com>
AuthorDate: Thu Apr 18 08:08:22 2019 -0700
[SPARK-27502][SQL][TEST] Update nested schema benchmark result for Orc V2
## What changes were proposed in this pull request?
We added nested schema pruning support to Orc V2 recently. The benchmark result should be updated. The benchmark numbers are obtained by running benchmark on r3.xlarge machine.
## How was this patch tested?
Test only change.
Closes #24399 from viirya/update-orcv2-benchmark.
Authored-by: Liang-Chi Hsieh <vi...@gmail.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.../OrcV2NestedSchemaPruningBenchmark-results.txt | 36 +++++++++++-----------
1 file changed, 18 insertions(+), 18 deletions(-)
diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
index f259e14..1bb8a68 100644
--- a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
+++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
@@ -2,46 +2,46 @@
Nested Schema Pruning Benchmark For ORC v2
================================================================================================
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 135 169 19 7.4 134.7 1.0X
-Nested column 2131 2216 95 0.5 2131.4 0.1X
+Top-level column 117 144 21 8.5 117.0 1.0X
+Nested column 1114 1138 23 0.9 1114.2 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 147 158 10 6.8 146.9 1.0X
-Nested column 2149 2204 50 0.5 2148.9 0.1X
+Top-level column 134 154 17 7.5 134.0 1.0X
+Nested column 1156 1220 51 0.9 1156.2 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 386 399 16 2.6 385.8 1.0X
-Nested column 2612 2666 57 0.4 2612.2 0.1X
+Top-level column 350 359 6 2.9 350.5 1.0X
+Nested column 1426 1443 13 0.7 1426.5 0.2X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 392 454 119 2.5 392.2 1.0X
-Nested column 4106 4168 79 0.2 4106.1 0.1X
+Top-level column 357 363 5 2.8 356.9 1.0X
+Nested column 4186 4245 71 0.2 4186.3 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 146 157 13 6.9 145.9 1.0X
-Nested column 2294 2338 44 0.4 2293.6 0.1X
+Top-level column 115 134 13 8.7 114.6 1.0X
+Nested column 1148 1199 59 0.9 1148.3 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux 4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 290 294 4 3.5 289.7 1.0X
-Nested column 2914 2997 87 0.3 2913.6 0.1X
+Top-level column 274 279 3 3.6 274.1 1.0X
+Nested column 3133 3254 145 0.3 3132.7 0.1X
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org