You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by li...@apache.org on 2017/01/08 02:55:17 UTC
spark git commit: [SPARK-18941][SQL][DOC] Add a new behavior document
on `CREATE/DROP TABLE` with `LOCATION`
Repository: spark
Updated Branches:
refs/heads/master 54138f6e8 -> 923e59484
[SPARK-18941][SQL][DOC] Add a new behavior document on `CREATE/DROP TABLE` with `LOCATION`
## What changes were proposed in this pull request?
This PR adds a new behavior change description on `CREATE TABLE ... LOCATION` at `sql-programming-guide.md` clearly under `Upgrading From Spark SQL 1.6 to 2.0`. This change is introduced at Apache Spark 2.0.0 as [SPARK-15276](https://issues.apache.org/jira/browse/SPARK-15276).
## How was this patch tested?
```
SKIP_API=1 jekyll build
```
**Newly Added Description**
<img width="913" alt="new" src="https://cloud.githubusercontent.com/assets/9700541/21743606/7efe2b12-d4ba-11e6-8a0d-551222718ea2.png">
Author: Dongjoon Hyun <do...@apache.org>
Closes #16400 from dongjoon-hyun/SPARK-18941.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/923e5948
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/923e5948
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/923e5948
Branch: refs/heads/master
Commit: 923e594844a7ad406195b91877f0fb374d5a454b
Parents: 54138f6
Author: Dongjoon Hyun <do...@apache.org>
Authored: Sat Jan 7 18:55:01 2017 -0800
Committer: gatorsmile <ga...@gmail.com>
Committed: Sat Jan 7 18:55:01 2017 -0800
----------------------------------------------------------------------
docs/sql-programming-guide.md | 8 ++++++++
1 file changed, 8 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/923e5948/docs/sql-programming-guide.md
----------------------------------------------------------------------
diff --git a/docs/sql-programming-guide.md b/docs/sql-programming-guide.md
index 0f6e344..f4c89e5 100644
--- a/docs/sql-programming-guide.md
+++ b/docs/sql-programming-guide.md
@@ -1413,6 +1413,14 @@ options.
- Dataset and DataFrame API `explode` has been deprecated, alternatively, use `functions.explode()` with `select` or `flatMap`
- Dataset and DataFrame API `registerTempTable` has been deprecated and replaced by `createOrReplaceTempView`
+ - Changes to `CREATE TABLE ... LOCATION` behavior for Hive tables.
+ - From Spark 2.0, `CREATE TABLE ... LOCATION` is equivalent to `CREATE EXTERNAL TABLE ... LOCATION`
+ in order to prevent accidental dropping the existing data in the user-provided locations.
+ That means, a Hive table created in Spark SQL with the user-specified location is always a Hive external table.
+ Dropping external tables will not remove the data. Users are not allowed to specify the location for Hive managed tables.
+ Note that this is different from the Hive behavior.
+ - As a result, `DROP TABLE` statements on those tables will not remove the data.
+
## Upgrading From Spark SQL 1.5 to 1.6
- From Spark 1.6, by default the Thrift server runs in multi-session mode. Which means each JDBC/ODBC
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org