You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@wayang.apache.org by "wangxiaoying (via GitHub)" <gi...@apache.org> on 2024/03/18 23:07:49 UTC

[I] How to print/explain plans? [incubator-wayang]

wangxiaoying opened a new issue, #417:
URL: https://github.com/apache/incubator-wayang/issues/417

   Is there a way to explain (print out) the logical and physical plan for wayang?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Question] How to print/explain plans? [incubator-wayang]

Posted by "zkaoudi (via GitHub)" <gi...@apache.org>.
zkaoudi closed issue #417: [Question] How to print/explain plans?
URL: https://github.com/apache/incubator-wayang/issues/417


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Question] How to print/explain plans? [incubator-wayang]

Posted by "zkaoudi (via GitHub)" <gi...@apache.org>.
zkaoudi commented on issue #417:
URL: https://github.com/apache/incubator-wayang/issues/417#issuecomment-2016742547

   Hi @wangxiaoying,
   
   I assume you saw the last merged commit adding the explain functionality. Let us know if you have any further questions. More than happy to help out.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Question] How to print/explain plans? [incubator-wayang]

Posted by "kbeedkar (via GitHub)" <gi...@apache.org>.
kbeedkar commented on issue #417:
URL: https://github.com/apache/incubator-wayang/issues/417#issuecomment-2006006406

   A quick and dirty solution as a workaround:  https://github.com/apache/incubator-wayang/blob/b134ec4a8b8038486025b47091920d1a85d3f298/wayang-api/wayang-api-sql/src/test/java/org/apache/wayang/api/sql/SqlToWayangRelTest.java#L109


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Question] How to print/explain plans? [incubator-wayang]

Posted by "zkaoudi (via GitHub)" <gi...@apache.org>.
zkaoudi commented on issue #417:
URL: https://github.com/apache/incubator-wayang/issues/417#issuecomment-2006200187

   Besides that @juripetersen is currently implementing an explain() functionality in the plan builder that will print the logical, inflated, and physical plans. It should be ready soon :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Question] How to print/explain plans? [incubator-wayang]

Posted by "wangxiaoying (via GitHub)" <gi...@apache.org>.
wangxiaoying commented on issue #417:
URL: https://github.com/apache/incubator-wayang/issues/417#issuecomment-2021714734

   > Hi @wangxiaoying,
   > 
   > I assume you saw the last merged commit adding the explain functionality. Let us know if you have any further questions. More than happy to help out.
   
   Thank you, I will definitely try!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Question] How to print/explain plans? [incubator-wayang]

Posted by "wangxiaoying (via GitHub)" <gi...@apache.org>.
wangxiaoying commented on issue #417:
URL: https://github.com/apache/incubator-wayang/issues/417#issuecomment-2007917521

   Thanks @kbeedkar @zkaoudi  for the quick reply : )
   
   > Besides that, @juripetersen is currently implementing an explain() functionality in the plan builder that will print the logical, inflated, and physical plans. It should be ready soon :)
   
   Looking forward to this feature! I tried the one using `PlanTraversal` as suggested above, but it seems like the result is hard to read. For example, the Q1 and Q3 plan it printed from the `wayang-benchmark` TPCH test is as follows:
   
   ```
   Q1:
   Map[Calculate result fields]LocalCallbackSink[collect()]Map[Post-process line item aggregates]ReduceBy[Aggregate line items]PostgresTableSource[Load LINEITEM table]Filter[Filter line items]Map[Project line items]
   
   Q3:
   Map[Project customer-order join product]Filter[Filter line items]LocalCallbackSink[collect()]PostgresTableSource[Load LINEITEM table]Map[Extract customer ID]PostgresTableSource[Load ORDERS table]Join[Join CO with line items]PostgresTableSource[Load CUSTOMER table]Map[Unpack orders]Map[Project orders]Map[Extract line item data]Map[Project CO-line-item join product]Map[Project customers]Filter[Filter customers]Join[Join customers with orders]Map[Project line items]Filter[Filter orders]ReduceBy[Aggregate revenue]
   ```
   
   It is a bit confusing how to interpret these outputs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org