[jira] [Created] (IMPALA-11010) After waiting in admission control, query fails with FileNotFoundException

["Joe McDonnell (Jira)" <ji...@apache.org>]

Joe McDonnell created IMPALA-11010:
--------------------------------------

             Summary: After waiting in admission control, query fails with FileNotFoundException
                 Key: IMPALA-11010
                 URL: https://issues.apache.org/jira/browse/IMPALA-11010
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
    Affects Versions: Impala 4.0.0
            Reporter: Joe McDonnell


A cluster ran into this scenario:
 # A query against table X was submitted
 # It waited in admission control for over 10 minutes
 # By the time it was admitted, table X had been modified, removing some files
 # The query fails with FileNotFoundException

It looks like the core issue could be that the metadata is from before admission and it becomes stale over time. This could start to be a problem for tables that have a faster update rate.

There are lots of ways to alleviate this (add nodes, query retries, etc), but it probably makes sense to think about whether there is some way to be smarter about the metadata as well.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org