You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Nishant Bangarwa (JIRA)" <ji...@apache.org> on 2018/07/31 12:01:00 UTC

[jira] [Created] (HIVE-20279) HiveContextAwareRecordReader slows down Druid Scan queries.

Nishant Bangarwa created HIVE-20279:
---------------------------------------

             Summary: HiveContextAwareRecordReader slows down Druid Scan queries. 
                 Key: HIVE-20279
                 URL: https://issues.apache.org/jira/browse/HIVE-20279
             Project: Hive
          Issue Type: Improvement
            Reporter: Nishant Bangarwa
            Assignee: Nishant Bangarwa
         Attachments: scan2.svg

HiveContextAwareRecordReader add lots of overhead for Druid Scan Queries. 
See attached flame graph. 
Looks like the operations for checking for existence of footer/header buffer takes most of time For druid and other storage handlers that do not have footer buffer we should skip the logic for checking the existence for storage handlers atleast. 




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)