You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2014/07/15 22:13:55 UTC
git commit: Added LZ4 to compression codec in configuration page.
Repository: spark
Updated Branches:
refs/heads/master 72ea56da8 -> e7ec815d9
Added LZ4 to compression codec in configuration page.
Author: Reynold Xin <rx...@apache.org>
Closes #1417 from rxin/lz4 and squashes the following commits:
472f6a1 [Reynold Xin] Set the proper default.
9cf0b2f [Reynold Xin] Added LZ4 to compression codec in configuration page.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e7ec815d
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e7ec815d
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e7ec815d
Branch: refs/heads/master
Commit: e7ec815d9a2b0f89a56dc7dd3106c31a09492028
Parents: 72ea56d
Author: Reynold Xin <rx...@apache.org>
Authored: Tue Jul 15 13:13:33 2014 -0700
Committer: Reynold Xin <rx...@apache.org>
Committed: Tue Jul 15 13:13:33 2014 -0700
----------------------------------------------------------------------
docs/configuration.md | 9 ++++-----
1 file changed, 4 insertions(+), 5 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/e7ec815d/docs/configuration.md
----------------------------------------------------------------------
diff --git a/docs/configuration.md b/docs/configuration.md
index 19fd980..9d3fe74 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -336,13 +336,12 @@ Apart from these, the following properties are also available, and may be useful
</tr>
<tr>
<td><code>spark.io.compression.codec</code></td>
- <td>org.apache.spark.io.<br />LZFCompressionCodec</td>
+ <td>org.apache.spark.io.<br />SnappyCompressionCodec</td>
<td>
The codec used to compress internal data such as RDD partitions and shuffle outputs.
- By default, Spark provides two codecs: <code>org.apache.spark.io.LZFCompressionCodec</code>
- and <code>org.apache.spark.io.SnappyCompressionCodec</code>. Of these two choices,
- Snappy offers faster compression and decompression, while LZF offers a better compression
- ratio.
+ By default, Spark provides three codecs: <code>org.apache.spark.io.LZ4CompressionCodec</code>,
+ <code>org.apache.spark.io.LZFCompressionCodec</code>,
+ and <code>org.apache.spark.io.SnappyCompressionCodec</code>.
</td>
</tr>
<tr>