You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2019/06/17 05:55:46 UTC
[spark] branch branch-2.4 updated: [SPARK-24898][DOC] Adding
spark.checkpoint.compress to the docs
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 9ddb6b5 [SPARK-24898][DOC] Adding spark.checkpoint.compress to the docs
9ddb6b5 is described below
commit 9ddb6b5c15c6422d038813b924947739c2a3ab5b
Author: Mellacheruvu Sandeep <me...@gmail.com>
AuthorDate: Sun Jun 16 22:54:08 2019 -0700
[SPARK-24898][DOC] Adding spark.checkpoint.compress to the docs
## What changes were proposed in this pull request?
Adding spark.checkpoint.compress configuration parameter to the documentation
## How was this patch tested?
Checked locally for jeykyll html docs. Also validated the html for any issues.
Closes #24883 from sandeepvja/SPARK-24898.
Authored-by: Mellacheruvu Sandeep <me...@gmail.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
(cherry picked from commit b7b445255370e29d6b420b02389b022a1c65942e)
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
docs/configuration.md | 8 ++++++++
1 file changed, 8 insertions(+)
diff --git a/docs/configuration.md b/docs/configuration.md
index da5d0a8..73bae77 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -973,6 +973,14 @@ Apart from these, the following properties are also available, and may be useful
</td>
</tr>
<tr>
+ <td><code>spark.checkpoint.compress</code></td>
+ <td>false</td>
+ <td>
+ Whether to compress RDD checkpoints. Generally a good idea.
+ Compression will use <code>spark.io.compression.codec</code>.
+ </td>
+</tr>
+<tr>
<td><code>spark.io.compression.codec</code></td>
<td>lz4</td>
<td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org