You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2024/06/13 10:21:00 UTC
[jira] [Updated] (SPARK-48615) Perf improvement for parsing hex string
[ https://issues.apache.org/jira/browse/SPARK-48615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated SPARK-48615:
-----------------------------------
Labels: pull-request-available (was: )
> Perf improvement for parsing hex string
> ---------------------------------------
>
> Key: SPARK-48615
> URL: https://issues.apache.org/jira/browse/SPARK-48615
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.0.0
> Reporter: Kent Yao
> Priority: Major
> Labels: pull-request-available
>
> {code:java}
> ================================================================================================
> Hex Comparison
> ================================================================================================OpenJDK 64-Bit Server VM 17.0.10+0 on Mac OS X 14.5
> Apple M2 Max
> Cardinality 1000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 5050 5100 86 0.2 5050.1 1.0X
> Spark 3822 3840 30 0.3 3821.6 1.3X
> Java 2462 2522 87 0.4 2462.1 2.1XOpenJDK 64-Bit Server VM 17.0.10+0 on Mac OS X 14.5
> Apple M2 Max
> Cardinality 2000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 10020 10828 1154 0.2 5010.1 1.0X
> Spark 6875 6966 144 0.3 3437.7 1.5X
> Java 4999 5092 89 0.4 2499.3 2.0XOpenJDK 64-Bit Server VM 17.0.10+0 on Mac OS X 14.5
> Apple M2 Max
> Cardinality 4000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 20090 20433 433 0.2 5022.5 1.0X
> Spark 13389 13620 229 0.3 3347.2 1.5X
> Java 10023 10069 42 0.4 2505.6 2.0XOpenJDK 64-Bit Server VM 17.0.10+0 on Mac OS X 14.5
> Apple M2 Max
> Cardinality 8000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 40277 43453 2755 0.2 5034.7 1.0X
> Spark 27145 27380 311 0.3 3393.1 1.5X
> Java 19980 21198 1473 0.4 2497.5 2.0X {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org