[GitHub] [arrow-datafusion] alamb commented on issue #6809: Accessing Execution Metrics

["alamb (via GitHub)" <gi...@apache.org>]

alamb commented on issue #6809:
URL: https://github.com/apache/arrow-datafusion/issues/6809#issuecomment-1615137532

   Have you looked at the output of `EXPLAIN ANALYZE` for your query? That will show you what metrics are available 
   
   I don't think we have upload/download bytes but I do think there are a bunch of parquet level metrics like
   
   ```sql
   |                   |   ParquetExec: file_groups={1 group: [[data.parquet]]}, projection=[<cols>], limit=1, metrics=[output_rows=1, elapsed_compute=1ns, bytes_scanned=4763, predicate_evaluation_errors=0, page_index_rows_filtered=0, pushdown_rows_filtered=0, file_open_errors=0, row_groups_pruned=0, file_scan_errors=0, num_predicate_creation_errors=0, time_elapsed_processing=7.350966ms, time_elapsed_opening=1.363919ms, pushdown_eval_time=2ns, time_elapsed_scanning_until_data=6.981077ms, page_index_eval_time=2ns, time_elapsed_scanning_total=6.981147ms] |
   ```
   
   We can probably add more


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org