[jira] [Commented] (HIVE-18846) Query results cache: Allow queries to refer to the pending results of a query that has not finished yet

["Jason Dere (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-18846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387193#comment-16387193 ] 

Jason Dere commented on HIVE-18846:
-----------------------------------

Work in progress patch, this passes the existing qfile tests but requires testing with concurrent queries to see if this will cause queries to wait on the executing query to finish.
This patch causes the query to wait for the pending results by blocking during query compilation, not sure if that is the best approach or not. If HIVE-17626 gets committed then we would have another possible approach where the query could block during query execution (and cause a retryable failure if it turns out that the pending results did not result in a valid cacheable result).

> Query results cache: Allow queries to refer to the pending results of a query that has not finished yet
> -------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-18846
>                 URL: https://issues.apache.org/jira/browse/HIVE-18846
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Query Planning
>            Reporter: Jason Dere
>            Assignee: Jason Dere
>            Priority: Major
>         Attachments: HIVE-18846.1.patch
>
>
> Currently, a query's results can only be looked up in the cache if the query has completely finished execution. Allow new queries to use the results cache to find queries that are still executing so they can re-use the results when the query has finished.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)