You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Gautam Gopalakrishnan (JIRA)" <ji...@apache.org> on 2019/06/26 03:58:00 UTC

[jira] [Created] (IMPALA-8708) Impala should ignore deleted files

Gautam Gopalakrishnan created IMPALA-8708:
---------------------------------------------

             Summary: Impala should ignore deleted files
                 Key: IMPALA-8708
                 URL: https://issues.apache.org/jira/browse/IMPALA-8708
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 3.2.0
            Reporter: Gautam Gopalakrishnan


When querying an S3 backed table that is being modified (e.g. distcp content from another cluster) and Impala is able to determine that a file in that table has been deleted (e.g. using the S3guard feature in CDH), queries still fail with a {{FileNotFound}} exception.

Performing a metadata refresh after the copy completes does resolve the problem. However this doesn't help during the copy phase. Requesting an enhancement where Impala can ignore files if knows that they've been deleted.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org