You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/08/23 18:22:44 UTC

[GitHub] [arrow] jorgecarleitao commented on pull request #8034: ARROW-9464: [Rust] [DataFusion] Physical plan optimization rule to insert MergeExec when needed

jorgecarleitao commented on pull request #8034:
URL: https://github.com/apache/arrow/pull/8034#issuecomment-678807425


   It looks fantastic! Super excited to see this!
   
   Gave it a quick look, and my understanding so far:
   
   * Physical nodes have requirements (`required_child_distribution`)
   * Physical nodes can fulfill requirements (`output_partitioning`)
   * The physical optimizer knows which physical nodes fulfill certain requirements (Merge fulfills `Distribution::SinglePartition` so far), and introduces them to fulfill a nodes' requirements, by using `children` to get the node's children and `with_new_children` to re-write the node with new children (that fulfill requirements).
   
   Is this a good overview of this PR (before going into the specifics)?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org