You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Muhammad Samir Khan (Jira)" <ji...@apache.org> on 2020/08/05 23:24:00 UTC

[jira] [Created] (SPARK-32550) Make SpecificInternalRow constructors faster by using while loops instead of maps

Muhammad Samir Khan created SPARK-32550:
-------------------------------------------

             Summary: Make SpecificInternalRow constructors faster by using while loops instead of maps
                 Key: SPARK-32550
                 URL: https://issues.apache.org/jira/browse/SPARK-32550
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Muhammad Samir Khan


Two constructors in SpecificInternalRow can be made faster by using while loops instead of maps. This was originally noticed while working on SPARK-32532 and SPARK-32533 and will have impacts on performance of reading ORC and Avro files. Profiled the change using added benchmarks in SPARK-32531 for nested and array'd structs.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org