[jira] [Commented] (DRILL-2293) CTAS does not clean up when it fails

["Chris Westin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391272#comment-14391272 ] 

Chris Westin commented on DRILL-2293:
-------------------------------------

DRILL-1627 covers this specifically for files (parquet and JSON), but this ticket could be interpreted in a broader way to also include non-file based storage. For example, if the CTAS target is a database, we should drop whatever table was being created if the query fails.

> CTAS does not clean up when it fails
> ------------------------------------
>
>                 Key: DRILL-2293
>                 URL: https://issues.apache.org/jira/browse/DRILL-2293
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>            Reporter: Rahul Challapalli
>            Assignee: Steven Phillips
>             Fix For: 1.1.0
>
>
> git.commit.id.abbrev=6676f2d
> Data Set :
> {code}
> {
>   "id" : 1,
>   "map":{"rm": [
>     {"mapid":"m1","mapvalue":{"col1":1,"col2":[0,1,2,3,4,5]},"rptd": [{ "a": "foo"},{"b":"boo"}]},
>     {"mapid":"m2","mapvalue":{"col1":0,"col2":[]},"rptd": [{ "a": "bar"},{"c":1},{"d":4.5}]}
>   ]}
> }
> {code}
> The below query fails :
> {code}
> create table rep_map as select d.map from `temp.json` d;
> Query failed: Query stopped., index: -4, length: 4 (expected: range(0, 16384)) [ d76e3f74-7e2c-406f-a7fd-5efc68227e75 on qa-node190.qa.lab:31010 ]
> {code}
> However drill created a folder 'rep_map' and the folder contained a broken parquet file. 
> {code}
> create table rep_map as select d.map from `temp.json` d;
> +------------+------------+
> |     ok     |  summary   |
> +------------+------------+
> | false      | Table 'rep_map' already exists. |
> {code}
> Drill should clean up properly in case of a failure.
> I raised a different issue for the actual failure.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)