You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Sreeparna Bhabani (Jira)" <ji...@apache.org> on 2020/04/27 09:12:00 UTC
[jira] [Created] (DRILL-7720) Issue observed in performance of
UNION ALL between Parquet and DB query
Sreeparna Bhabani created DRILL-7720:
----------------------------------------
Summary: Issue observed in performance of UNION ALL between Parquet and DB query
Key: DRILL-7720
URL: https://issues.apache.org/jira/browse/DRILL-7720
Project: Apache Drill
Issue Type: Bug
Components: Functions - Drill
Affects Versions: 1.17.0
Reporter: Sreeparna Bhabani
{color:#26282a}Consider the below scenarios. The first 2 scenarios are giving expected results in terms of performance. But we are not getting expected performance for 3rd scenario which is UNION ALL with 2 different types of datasets (Parquet + DB).{color}
{color:#26282a} {color}
*{color:#26282a}Scenario 1- Parquet UNION ALL Parquet{color}*
{color:#26282a}Individual execution time of 1st query - 5 secs{color}
{color:#26282a}Individual execution time of 2nd query - 5 secs{color}
{color:#26282a}UNION ALL of both queries execution time - 10 secs{color}
{color:#26282a} {color}
*{color:#26282a}Scenario 2 - DB query UNION ALL DB{color}*{color:#26282a} *query*{color}
{color:#26282a}Individual execution time of 1st query - 5 secs{color}
{color:#26282a}Individual execution time of 2nd query - 5 secs{color}
{color:#26282a}UNION ALL of both queries execution time - 10 secs{color}
{color:#26282a} {color}
*{color:#26282a}Scenario 3 - Parquet UNION ALL DB query{color}*
{color:#26282a}Individual execution time of 1st query - 5 secs{color}
{color:#26282a}Individual execution time of 2nd query - 1 sec{color}
{color:#26282a}UNION ALL execution time - 20 secs{color}
{color:#26282a}Ideally the execution time should not be more than 6 secs.{color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)