[jira] [Commented] (CALCITE-2168) Implement a General Purpose Benchmark for Calcite

["Alessandro Solimando (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CALCITE-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353588#comment-16353588 ] 

Alessandro Solimando commented on CALCITE-2168:
-----------------------------------------------

Thanks Edmon, I am strongly in favor of creating a representative benchmark, it can also be used internally to evaluate alternative strategies and/or improvements to the query planner, to measure the "gap" between Volcano and HEP, etc. 

Concerning existing benchmarks that are relevant for Calcite, I know exactly those you already mentioned, but I will try to have a look if there is anything else promising around.



> Implement a General Purpose Benchmark for Calcite 
> --------------------------------------------------
>
>                 Key: CALCITE-2168
>                 URL: https://issues.apache.org/jira/browse/CALCITE-2168
>             Project: Calcite
>          Issue Type: Wish
>          Components: core
>            Reporter: Edmon Begoli
>            Assignee: Edmon Begoli
>            Priority: Minor
>              Labels: performance
>   Original Estimate: 2,688h
>  Remaining Estimate: 2,688h
>
> Develop a benchmark that can be used for general purpose benchamrking of Calcite against other frameworks, and databases, and for study,research, and profiling of the framwork.
> Use popular benchmarks such as TCP-DS (or -H) or Star Schema Benchmark (SSB) and measure the performance of optimized vs. unoptimized Calcite queries, and the overhead of going through Calcite adapters vs. natively accessing the target DB
> Look into the existing approaches and do perhaps something similar:
> * https://www.slideshare.net/julianhyde/w-435phyde-3
> * https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_hive-performance-tuning/content/ch_cost-based-optimizer.html
> * (How much of this is still relevant (Hive 0.14)? Can we use queries/benchmarks?)
> https://hortonworks.com/blog/hive-0-14-cost-based-optimizer-cbo-technical-overview/
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)