[jira] [Commented] (IMPALA-8562) Data cache should skip scan range with mtime == -1

["Todd Lipcon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842400#comment-16842400 ] 

Todd Lipcon commented on IMPALA-8562:
-------------------------------------

Perhaps we should add a CHECK_GE(mtime, 0) to try to prevent these issues in the future? If we just skip caching, then this bug will end up being ineffective cache misses.

Another improvement possible here is to make use of HDFS "fileIds" which are unique inode numbers

> Data cache should skip scan range with mtime == -1
> --------------------------------------------------
>
>                 Key: IMPALA-8562
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8562
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 3.3.0
>            Reporter: Michael Ho
>            Assignee: Michael Ho
>            Priority: Blocker
>
> As show in IMPALA-8561, using mtime == -1 as part of cache key may lead to reading stale data. Data cache should probably just skip caching those entries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org