You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "eaton (JIRA)" <ji...@apache.org> on 2017/06/08 09:12:18 UTC

[jira] [Created] (SPARK-21017) Move the length getter before the while to improve performance

eaton created SPARK-21017:
-----------------------------

             Summary: Move the length getter before the while to improve performance
                 Key: SPARK-21017
                 URL: https://issues.apache.org/jira/browse/SPARK-21017
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.1.1
            Reporter: eaton
            Priority: Minor


In my test, the cost of the while in the write function of HiveOutputWriter class have improved from 48ms to 40ms for a table of 500 rows and 100 columns when putting the length getter before the while 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org