You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/12/08 20:45:56 UTC
[GitHub] [arrow-datafusion] Dandandan opened a new issue #1422: Send time metric in
Dandandan opened a new issue #1422:
URL: https://github.com/apache/arrow-datafusion/issues/1422
**Describe the bug**
In hash repartition, time is wrongly attributed to the `repart_time` instead of `send_time` metric
**To Reproduce**
```
create table t as select 1 x;
explain analyze select * from t group by x;
+-------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| plan_type | plan |
+-------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Plan with Metrics | CoalescePartitionsExec, metrics=[output_rows=1, elapsed_compute=58.056µs] |
| | ProjectionExec: expr=[x@0 as x], metrics=[output_rows=1, elapsed_compute=12.299µs] |
| | HashAggregateExec: mode=FinalPartitioned, gby=[x@0 as x], aggr=[], metrics=[output_rows=1, elapsed_compute=59.666µs] |
| | CoalesceBatchesExec: target_batch_size=4096, metrics=[output_rows=1, elapsed_compute=1.061762ms] |
| | RepartitionExec: partitioning=Hash([Column { name: "x", index: 0 }], 16), metrics=[repart_time{inputPartition=0}=911.062µs, fetch_time{inputPartition=0}=4.661323ms, send_time{inputPartition=0}=NOT RECORDED] |
| | HashAggregateExec: mode=Partial, gby=[x@0 as x], aggr=[], metrics=[output_rows=1, elapsed_compute=130.599µs] |
| | RepartitionExec: partitioning=RoundRobinBatch(16), metrics=[repart_time{inputPartition=3}=NOT RECORDED, fetch_time{inputPartition=3}=5.37µs, send_time{inputPartition=3}=1.067µs] |
| | MemoryExec: partitions=1, partition_sizes=[1], metrics=[] |
| | |
+-------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set. Query took 0.002 seconds.
```
Note the `send_time{inputPartition=0}=NOT RECORDED` part.
**Expected behavior**
It should record it at least once.
**Additional context**
Add any other context about the problem here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] Dandandan commented on issue #1422: Send time metric in
Posted by GitBox <gi...@apache.org>.
Dandandan commented on issue #1422:
URL: https://github.com/apache/arrow-datafusion/issues/1422#issuecomment-989207886
Closed by #1421
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] Dandandan closed issue #1422: Send time metric in
Posted by GitBox <gi...@apache.org>.
Dandandan closed issue #1422:
URL: https://github.com/apache/arrow-datafusion/issues/1422
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org