You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Nikhil Lakshman (JIRA)" <ji...@apache.org> on 2019/03/25 02:23:00 UTC
[jira] [Commented] (SPARK-25464) Dropping database can remove the
hive warehouse directory contents
[ https://issues.apache.org/jira/browse/SPARK-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800365#comment-16800365 ]
Nikhil Lakshman commented on SPARK-25464:
-----------------------------------------
Hi
Was there a fix done for this ? This happened to us.
The create database by default creates a folder with a .db extension.However if we specify the location as /user/hive/warehouse. It will not create that folder. and when we dropped that newly created DB, the whole warehouse content is gone.
The behavior should be consistent when we execute the command CREATE DATABASE and CREATE DATABASE with location or it should be explicitly mentioned somewhere that CREATE DATABASE with location will not create the folder with the .db extension.
> Dropping database can remove the hive warehouse directory contents
> ------------------------------------------------------------------
>
> Key: SPARK-25464
> URL: https://issues.apache.org/jira/browse/SPARK-25464
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.3.1
> Reporter: Sushanta Sen
> Priority: Major
>
> Create Database.
> CREATE (DATABASE|SCHEMA) [IF NOT EXISTS] db_name [COMMENT comment_text] [*LOCATION*path] [WITH DBPROPERTIES (key1=val1, key2=val2, ...)] \{{LOCATION }}If the specified path does not already exist in the underlying file system, this command tries to create a directory with the path. *When the database is dropped later, this directory is not deleted, {color:#d04437}but currently it is deleting the directory as well.{color}
> {color:#333333}please refer the below link{color}
> {color:#d04437}[databricks documentation|{color}
> [https://docs.databricks.com/spark/latest/spark-sql/language-manual/create-database.html]
> {color:#d04437}]{color}
> if i create the database as below
> create database db1 location '/user/hive/warehouse'; //this is hive warehouse directory
> *{color:#333333}on dropping this db it will also delete the warehouse directory which contains the other db information.{color}*
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org