You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2015/08/06 20:56:06 UTC

[jira] [Created] (SPARK-9699) Test whether we should turn compression on or off by default for external sorting

Reynold Xin created SPARK-9699:
----------------------------------

             Summary: Test whether we should turn compression on or off by default for external sorting
                 Key: SPARK-9699
                 URL: https://issues.apache.org/jira/browse/SPARK-9699
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
            Reporter: Reynold Xin


As of Spark 1.4, compression is on by default for spilling, trading off CPU cycles for less I/O throughput usage. It is unclear whether it is better to have compression on or off when we spill data. We should test that and adjust the default setting accordingly.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org