[GitHub] [arrow-datafusion] Igosuki commented on pull request #1738: Add parquet SQL benchmarks

[GitBox <gi...@apache.org>]

Igosuki commented on pull request #1738:
URL: https://github.com/apache/arrow-datafusion/pull/1738#issuecomment-1040640415


   > I also ran this locally ok_hand very nice:
   > 
   > ```shell
   > cargo bench --bench parquet_query_sql
   > ...
   > Generating parquet file - /var/folders/s3/h5hgj43j0bv83shtmz_t_w400000gn/T/parquet_query_sqlr7Ymzm.parquet
   > Generated parquet file in 6.7890725 seconds
   > Using parquet file /var/folders/s3/h5hgj43j0bv83shtmz_t_w400000gn/T/parquet_query_sqlr7Ymzm.parquet
   > 
   > 
   > ...
   > ng select dict_10_required, dict_100_required, MIN(f64_optional), MAX(f64_optional), AVG(f64_optional) ...: Warming up for 3.0000 s
   > Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 12.9s, or reduce sample count to 30.
   > Benchmarking select dict_10_required, dict_100_required, MIN(f64_optional), MAX(f64_optional), AVG(f64_optional) ...: Collecting 100 samples in estima                                                                                                                                                      select dict_10_required, dict_100_required, MIN(f64_optional), MAX(f64_optional), AVG(f64_optional) ...                        
   >                         time:   [128.35 ms 128.65 ms 128.98 ms]
   > Found 5 outliers among 100 measurements (5.00%)
   >   3 (3.00%) high mild
   >   2 (2.00%) high severe
   > ```
   > 
   > @Igosuki this might be a cool thing to run on the arrow2 branch to see how the performance compares
   
   I will rebase once it is merged 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org