You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/11/08 14:21:07 UTC
[GitHub] [arrow-datafusion] alamb opened a new issue, #4144: Improve `EXPLAIN ANALYZE` output for parquet exec
alamb opened a new issue, #4144:
URL: https://github.com/apache/arrow-datafusion/issues/4144
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
I have been using EXPLIN ANALYZE to do some adhoc analysis on our query output
At the moment, explain analyze shows all statistics for all parquet files scanned -- this is often overwhelming for manual analysis
**Describe the solution you'd like**
What I would like is a summarized version of all the statistics (like we do for partitions) for all the parquet files. I would like per-file breakdowns only reported with `EXPLAIN ANALYZE VERBOSE` so I can understand at a high level what happened
Something like:
```
| | ParquetExec: limit=None, metrics=[output_rows=47870000, elapsed_compute=4ns, spill_count=0, spilled_bytes=0, mem_used=0, bytes_scanned=35328432, row_groups_pruned=0, predicate_evaluation_errors=0, pushdown_rows_filtered=4, num_predicate_creation_errors=0, pushdown_eval_time=1.23756ms, time_elapsed_opening=27.569443574s, time_elapsed_processing=2.772865879s, time_elapsed_scanning=646.659086ms,
```
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.
**Additional context**
For example
Here is an example output:
```
| | ParquetExec: limit=None, partitions=[52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet, 52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet, 52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet, 52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet, 52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet, 52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet, 52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet, 52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet, 52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet, 52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet, 52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet, 52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet, 52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet, 5
2175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet, 52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet, 52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet, 52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet, 52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet, 52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet, 52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet, 52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet, 52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet, 52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet, 52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet, 52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet, 52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet, 52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet, 5217
5/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet, 52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet, 52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet, 52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet], predicate=time_max@0 > 1664641920000000000, projection=[time, x], metrics=[output_rows=47870000, elapsed_compute=4ns, spill_count=0, spilled_bytes=0, mem_used=0, bytes_scanned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=35328432, row_groups_pruned{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=22064691, predicate_evaluation_errors{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=35054700, row_groups_pruned{filename=521
75/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=6427709, predicate_evaluation_errors{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=5105961, bytes_scanned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=2080000, pushdown_rows_filtered{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-a
d5b1e076b7e.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0, num_predicate_creation_errors=0, row_groups_pruned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.par
quet}=0, bytes_scanned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=35398092, predicate_evaluation_errors{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=17659207, row_groups_pruned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168
/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=24862359, row_groups_pruned{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0, bytes_scanned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=419938, bytes_scanned{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.pa
rquet}=276307, bytes_scanned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=2707990, predicate_evaluation_errors{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=35302018, row_groups_pruned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0, predicate_evaluation_errors{
filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=34756477, row_groups_pruned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=4354720, bytes_scanned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=35304985, predicate_evaluation_errors{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/7c1b1f84-fe54-41
62-97c2-a168a25d8a23.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=35192963, pushdown_rows_filtered{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0, pushdown_row
s_filtered{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=26685271, row_groups_pruned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9
a26-dacfdce843e0.parquet}=0, row_groups_pruned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=4350265, bytes_scanned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=3453404, bytes_scanned{f
ilename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=24713929, pushdown_rows_filtered{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0, row_groups_pruned{filename=52175/298744/168/9
964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=14827386, row_groups_pruned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=17173777, bytes_scanned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=4274407, row_groups_pruned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=4261736, bytes_scanned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=4312620, predicate_evaluation_errors{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0, predi
cate_evaluation_errors{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=4262967, bytes_scanned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=14892804, pushdown_rows_filtered{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=32735628, row_groups_pruned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/18
9d0852-a773-4938-bdff-6424d2c76451.parquet}=4282740, pushdown_rows_filtered{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=34123728, pushdown_eval_time{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=1.23756ms, pushdown_eval_time{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=434.51µs, pushdown_eval_time{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=141.954µs, pushdown_eval_time{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d018
96cd.parquet}=339.863µs, pushdown_eval_time{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=2.74232ms, pushdown_eval_time{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=3.336337ms, pushdown_eval_time{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=23.314µs, pushdown_eval_time{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=65.823µs, pushdown_eval_time{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=2.132315ms, pushdown_eval_time{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=3.237548ms, pushdown_eval_time{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=289.686µs, pushdown_eval_time{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=371.591µs, pushdown_eval_time{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261
a47.parquet}=2.942928ms, pushdown_eval_time{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=2.826285ms, pushdown_eval_time{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=334.903µs, pushdown_eval_time{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=357.115µs, time_elapsed_opening=27.569443574s, pushdown_eval_time{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=1.278413ms, pushdown_eval_time{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=357.38µs, pushdown_eval_time{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=2.112358ms, pushdown_eval_time{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=563.716µs, time_elapsed_processing=2.772865879s, pushdown_eval_time{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=1.573234ms, pushdown_ev
al_time{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=3.431636ms, time_elapsed_scanning=646.659086ms, pushdown_eval_time{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=3.008817ms, pushdown_eval_time{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=356.773µs, pushdown_eval_time{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=3.838249ms, pushdown_eval_time{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=2.992907ms, pushdown_eval_time{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=3.943949ms, pushdown_eval_time{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=2.777043ms, pushdown_eval_time{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=198.13µs, pushdown_eval_time{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae8681
7f05.parquet}=1.497264ms, pushdown_eval_time{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=408.168µs] |
```
It is slightly more understandable if one adds newlines to it;
```
| | ParquetExec: limit=None,
partitions=[52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet,
52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet,
52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet,
52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet,
52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet,
52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet,
52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet,
52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet,
52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet,
52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet,
52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet,
52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet,
52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet,
52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet,
52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet,
52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet,
52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet,
52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet,
52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet,
52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet,
52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet,
52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet,
52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet,
52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet,
52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet,
52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet,
52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet,
52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet,
52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet,
52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet,
52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet],
predicate=time_max@0 > 1664641920000000000,
projection=[time,
x],
metrics=[output_rows=47870000,
elapsed_compute=4ns,
spill_count=0,
spilled_bytes=0,
mem_used=0,
bytes_scanned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=35328432,
row_groups_pruned{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=22064691,
predicate_evaluation_errors{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=35054700,
row_groups_pruned{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=6427709,
predicate_evaluation_errors{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=5105961,
bytes_scanned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=2080000,
pushdown_rows_filtered{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0,
num_predicate_creation_errors=0,
row_groups_pruned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0,
bytes_scanned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=35398092,
predicate_evaluation_errors{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=17659207,
row_groups_pruned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=24862359,
row_groups_pruned{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0,
bytes_scanned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=419938,
bytes_scanned{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=276307,
bytes_scanned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=2707990,
predicate_evaluation_errors{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=35302018,
row_groups_pruned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0,
bytes_scanned{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=34756477,
row_groups_pruned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=4354720,
bytes_scanned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=35304985,
predicate_evaluation_errors{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0,
bytes_scanned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=35192963,
pushdown_rows_filtered{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0,
bytes_scanned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=26685271,
row_groups_pruned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0,
bytes_scanned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=4350265,
bytes_scanned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=3453404,
bytes_scanned{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=24713929,
pushdown_rows_filtered{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=14827386,
row_groups_pruned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=17173777,
bytes_scanned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=4274407,
row_groups_pruned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0,
bytes_scanned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=4261736,
bytes_scanned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=4312620,
predicate_evaluation_errors{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=4262967,
bytes_scanned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=14892804,
pushdown_rows_filtered{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=32735628,
row_groups_pruned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=4282740,
pushdown_rows_filtered{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0,
pushdown_rows_filtered{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0,
predicate_evaluation_errors{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0,
row_groups_pruned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0,
bytes_scanned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=34123728,
pushdown_eval_time{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=1.23756ms,
pushdown_eval_time{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=434.51µs,
pushdown_eval_time{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=141.954µs,
pushdown_eval_time{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=339.863µs,
pushdown_eval_time{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=2.74232ms,
pushdown_eval_time{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=3.336337ms,
pushdown_eval_time{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=23.314µs,
pushdown_eval_time{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=65.823µs,
pushdown_eval_time{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=2.132315ms,
pushdown_eval_time{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=3.237548ms,
pushdown_eval_time{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=289.686µs,
pushdown_eval_time{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=371.591µs,
pushdown_eval_time{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=2.942928ms,
pushdown_eval_time{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=2.826285ms,
pushdown_eval_time{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=334.903µs,
pushdown_eval_time{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=357.115µs,
time_elapsed_opening=27.569443574s,
pushdown_eval_time{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=1.278413ms,
pushdown_eval_time{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=357.38µs,
pushdown_eval_time{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=2.112358ms,
pushdown_eval_time{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=563.716µs,
time_elapsed_processing=2.772865879s,
pushdown_eval_time{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=1.573234ms,
pushdown_eval_time{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=3.431636ms,
time_elapsed_scanning=646.659086ms,
pushdown_eval_time{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=3.008817ms,
pushdown_eval_time{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=356.773µs,
pushdown_eval_time{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=3.838249ms,
pushdown_eval_time{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=2.992907ms,
pushdown_eval_time{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=3.943949ms,
pushdown_eval_time{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=2.777043ms,
pushdown_eval_time{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=198.13µs,
pushdown_eval_time{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=1.497264ms,
pushdown_eval_time{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=408.168µs] |
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove closed issue #4144: Improve `EXPLAIN ANALYZE` output for parquet exec
Posted by GitBox <gi...@apache.org>.
andygrove closed issue #4144: Improve `EXPLAIN ANALYZE` output for parquet exec
URL: https://github.com/apache/arrow-datafusion/issues/4144
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #4144: Improve `EXPLAIN ANALYZE` output for parquet exec
Posted by GitBox <gi...@apache.org>.
alamb commented on issue #4144:
URL: https://github.com/apache/arrow-datafusion/issues/4144#issuecomment-1307304578
cc @Ted-Jiang I plan to work on this at some point soon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org