You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Sreeparna Bhabani (Jira)" <ji...@apache.org> on 2020/04/27 09:12:00 UTC

[jira] [Created] (DRILL-7720) Issue observed in performance of UNION ALL between Parquet and DB query

Sreeparna Bhabani created DRILL-7720:
----------------------------------------

             Summary: Issue observed in performance of UNION ALL between Parquet and DB query
                 Key: DRILL-7720
                 URL: https://issues.apache.org/jira/browse/DRILL-7720
             Project: Apache Drill
          Issue Type: Bug
          Components: Functions - Drill
    Affects Versions: 1.17.0
            Reporter: Sreeparna Bhabani


{color:#26282a}Consider the below scenarios. The first 2 scenarios are giving expected results in terms of performance. But we are not getting expected performance for 3rd scenario which is UNION ALL with 2 different types of datasets (Parquet + DB).{color}

{color:#26282a} {color}

*{color:#26282a}Scenario 1- Parquet UNION ALL Parquet{color}*

{color:#26282a}Individual execution time of 1st query - 5 secs{color}

{color:#26282a}Individual execution time of 2nd query - 5 secs{color}

{color:#26282a}UNION ALL of both queries execution time - 10 secs{color}

{color:#26282a} {color}

*{color:#26282a}Scenario 2 - DB query UNION ALL DB{color}*{color:#26282a} *query*{color}

{color:#26282a}Individual execution time of 1st query - 5 secs{color}

{color:#26282a}Individual execution time of 2nd query - 5 secs{color}

{color:#26282a}UNION ALL of both queries execution time - 10 secs{color}

{color:#26282a} {color}

*{color:#26282a}Scenario 3 - Parquet UNION ALL DB query{color}*

{color:#26282a}Individual execution time of 1st query - 5 secs{color}

{color:#26282a}Individual execution time of 2nd query - 1 sec{color}

{color:#26282a}UNION ALL execution time - 20 secs{color}

{color:#26282a}Ideally the execution time should not be more than 6 secs.{color}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)