[jira] [Created] (SPARK-24669) Managed table was not cleared of path after drop database cascade

["Dong Jiang (JIRA)" <ji...@apache.org>]

Dong Jiang created SPARK-24669:
----------------------------------

             Summary: Managed table was not cleared of path after drop database cascade
                 Key: SPARK-24669
                 URL: https://issues.apache.org/jira/browse/SPARK-24669
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.0
            Reporter: Dong Jiang


I can do the following in sequence
# Create a managed table using path options
# Drop the table via dropping the parent database cascade
# Re-create the database and table with a different path
# The new table shows data from the old path, not the new path

{code}
echo "first" > /tmp/first.csv
echo "second" > /tmp/second.csv
spark-shell
spark.version
res0: String = 2.3.0
spark.sql("create database foo")
spark.sql("create table foo.first (id string) using csv options (path='/tmp/first.csv')")
spark.table("foo.first").show()
+-----+
|   id|
+-----+
|first|
+-----+
spark.sql("drop database foo cascade")
spark.sql("create database foo")
spark.sql("create table foo.first (id string) using csv options (path='/tmp/second.csv')")
"note, the path is different now, pointing to second.csv, but still showing data from first file"
spark.table("foo.second").show()
spark.table("foo.first").show()
+-----+
|   id|
+-----+
|first|
+-----+
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org