You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Takeshi Yamamuro (Jira)" <ji...@apache.org> on 2020/08/20 08:13:00 UTC

[jira] [Created] (SPARK-32665) Deletes orphan directories under a warehouse dir in SQLQueryTestSuite

Takeshi Yamamuro created SPARK-32665:
----------------------------------------

             Summary: Deletes orphan directories under a warehouse dir in SQLQueryTestSuite
                 Key: SPARK-32665
                 URL: https://issues.apache.org/jira/browse/SPARK-32665
             Project: Spark
          Issue Type: Improvement
          Components: SQL, Tests
    Affects Versions: 3.1.0
            Reporter: Takeshi Yamamuro


In case that a last SQLQueryTestSuite test run is killed, it will fail in a next run because of a following reason:
{code}
[info] org.apache.spark.sql.SQLQueryTestSuite *** ABORTED *** (17 seconds, 483 milliseconds)
[info]   org.apache.spark.sql.AnalysisException: Can not create the managed table('`testdata`'). The associated location('file:/Users/maropu/Repositories/spark/spark-master/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/testdata') already exists.;
[info]   at org.apache.spark.sql.catalyst.catalog.SessionCatalog.validateTableLocation(SessionCatalog.scala:355)
[info]   at org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:170)
[info]   at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:108)
{code}
This ticket targets at adding code to deletes orphan directories under a warehouse dir in SQLQueryTestSuite before creating test tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org