You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ge...@apache.org on 2021/08/19 13:31:02 UTC
[spark] branch master updated: Revert "[SPARK-35083][FOLLOW-UP][CORE] Add migration guide for the re…
This is an automated email from the ASF dual-hosted git repository.
gengliang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new b36b1c7 Revert "[SPARK-35083][FOLLOW-UP][CORE] Add migration guide for the re…
b36b1c7 is described below
commit b36b1c7e8a69f0aa02d7471fc7dadd32ed57ade1
Author: Gengliang Wang <ge...@apache.org>
AuthorDate: Thu Aug 19 21:30:00 2021 +0800
Revert "[SPARK-35083][FOLLOW-UP][CORE] Add migration guide for the re…
…mote scheduler pool files support"
This reverts commit e3902d1975ee6a6a6f672eb6b4f318bcdd237e3f. The feature is improvement instead of behavior change.
Closes #33789 from gengliangwang/revertDoc.
Authored-by: Gengliang Wang <ge...@apache.org>
Signed-off-by: Gengliang Wang <ge...@apache.org>
---
docs/core-migration-guide.md | 2 --
1 file changed, 2 deletions(-)
diff --git a/docs/core-migration-guide.md b/docs/core-migration-guide.md
index 02ed430..1dee502 100644
--- a/docs/core-migration-guide.md
+++ b/docs/core-migration-guide.md
@@ -24,8 +24,6 @@ license: |
## Upgrading from Core 3.1 to 3.2
-- Since Spark 3.2, the fair scheduler also supports reading a configuration file from a remote node. `spark.scheduler.allocation.file` can either be a local file path or HDFS file path.
-
- Since Spark 3.2, `spark.hadoopRDD.ignoreEmptySplits` is set to `true` by default which means Spark will not create empty partitions for empty input splits. To restore the behavior before Spark 3.2, you can set `spark.hadoopRDD.ignoreEmptySplits` to `false`.
- Since Spark 3.2, `spark.eventLog.compression.codec` is set to `zstd` by default which means Spark will not fallback to use `spark.io.compression.codec` anymore.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org