You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/01/17 21:44:13 UTC
[spark] branch branch-2.4 updated: [SPARK-30312][DOCS][FOLLOWUP]
Add a migration guide
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 4df509f [SPARK-30312][DOCS][FOLLOWUP] Add a migration guide
4df509f is described below
commit 4df509ff18ea6421569c51af3d191aae9f493bd8
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Fri Jan 17 13:40:50 2020 -0800
[SPARK-30312][DOCS][FOLLOWUP] Add a migration guide
This is a followup of https://github.com/apache/spark/pull/26956 to add a migration document for 2.4.5.
New legacy configuration will restore the previous behavior safely.
This PR updates the doc.
<img width="763" alt="screenshot" src="https://user-images.githubusercontent.com/9700541/72639939-9da5a400-391b-11ea-87b1-14bca15db5a6.png">
Build the document and see the change manually.
Closes #27269 from dongjoon-hyun/SPARK-30312.
Authored-by: Dongjoon Hyun <dh...@apple.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
(cherry picked from commit fdbded3f71b54baee187392089705f1b619019cc)
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
docs/sql-migration-guide-upgrade.md | 2 ++
1 file changed, 2 insertions(+)
diff --git a/docs/sql-migration-guide-upgrade.md b/docs/sql-migration-guide-upgrade.md
index a6fc42a..2ac4733 100644
--- a/docs/sql-migration-guide-upgrade.md
+++ b/docs/sql-migration-guide-upgrade.md
@@ -14,6 +14,8 @@ displayTitle: Spark SQL Upgrading Guide
`spark.sql.legacy.rdd.applyConf` to `false`: in this case, SQL configurations are ignored for operations
performed on a RDD derived from a Dataset.
+ - Since Spark 2.4.5, `TRUNCATE TABLE` command tries to set back original permission and ACLs during re-creating the table/partition paths. To restore the behaviour of earlier versions, set `spark.sql.truncateTable.ignorePermissionAcl.enabled` to `true`.
+
## Upgrading from Spark SQL 2.4 to 2.4.1
- The value of `spark.executor.heartbeatInterval`, when specified without units like "30" rather than "30s", was
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org