You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/11/24 21:08:22 UTC

[GitHub] [arrow-datafusion] isidentical commented on pull request #4361: Support to use Schedular in tpch benchmark

isidentical commented on PR #4361:
URL: https://github.com/apache/arrow-datafusion/pull/4361#issuecomment-1326835681

   This is a cool option! Just out of my own curiosity I've compared `--enable-scheduler`  vs not to see if there are any clear wins and there are a few queries where the scheduler outperforms by %10. Obviously, there are still some others with major degradations but with this option, it should be much easier to identify those cases and see the underlying cause.
   
   ```
   ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
   ┃ Query        ┃     Baseline ┃   Comparison ┃        Change ┃
   ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
   │ Q1           │     643.67ms │     592.49ms │ +1.09x faster │
   │ Q2           │     291.85ms │     262.98ms │ +1.11x faster │
   │ Q3           │     373.14ms │    1028.82ms │  2.76x slower │
   │ Q4           │     103.54ms │     105.93ms │     no change │
   │ Q5           │     363.02ms │     714.48ms │  1.97x slower │
   │ Q6           │     370.04ms │     374.17ms │     no change │
   │ Q7           │     745.62ms │    1316.95ms │  1.77x slower │
   │ Q8           │     471.89ms │     867.03ms │  1.84x slower │
   │ Q9           │     651.69ms │     998.41ms │  1.53x slower │
   │ Q10          │     432.42ms │    1165.39ms │  2.70x slower │
   │ Q11          │     204.11ms │     173.80ms │ +1.17x faster │
   │ Q12          │     186.74ms │     194.05ms │     no change │
   │ Q13          │     404.37ms │     379.72ms │ +1.06x faster │
   │ Q14          │     337.40ms │     413.87ms │  1.23x slower │
   │ Q15          │     325.42ms │     624.71ms │  1.92x slower │
   │ Q16          │     153.15ms │     155.41ms │     no change │
   │ Q17          │    1931.96ms │    2051.97ms │  1.06x slower │
   │ Q18          │    1349.79ms │    1280.70ms │ +1.05x faster │
   │ Q19          │     621.30ms │     683.34ms │  1.10x slower │
   │ Q20          │     609.66ms │     642.90ms │  1.05x slower │
   │ Q21          │     628.37ms │     710.87ms │  1.13x slower │
   │ Q22          │      65.89ms │      65.55ms │     no change │
   └──────────────┴──────────────┴──────────────┴───────────────┘
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org