You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/06/03 16:05:30 UTC

[GitHub] [arrow-datafusion] alamb opened a new issue #497: explain verbose doesn't include the output of all optimizer passes

alamb opened a new issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497


   **Describe the bug**
   `explain verbose` does not appear to show the output of each optimizer pass, nor does it seem to show pushed down predicates in the physical plan 
   
   **To Reproduce**
   ```shell
   echo "true" > /tmp/foo.csv
   cargo run -p datafusion-cli --no-default-features
   ```
   Then run this SQL:
   ```sql
   CREATE EXTERNAL TABLE foo(bar boolean)
   STORED AS CSV
   LOCATION '/tmp/foo.csv';
   0 rows in set. Query took 0 seconds.
   ```
   ```sql
   > explain verbose select * from foo where bar = true;
   +-----------------------------------------+--------------------------------------------------------------------------+
   | plan_type                               | plan                                                                     |
   +-----------------------------------------+--------------------------------------------------------------------------+
   | logical_plan                            | Projection: #bar                                                         |
   |                                         |   Filter: #bar Eq Boolean(true)                                          |
   |                                         |     TableScan: foo projection=None                                       |
   | logical_plan after projection_push_down | Projection: #bar                                                         |
   |                                         |   Filter: #bar Eq Boolean(true)                                          |
   |                                         |     TableScan: foo projection=Some([0])                                  |
   | logical_plan after projection_push_down | Projection: #bar                                                         |
   |                                         |   Filter: #bar Eq Boolean(true)                                          |
   |                                         |     TableScan: foo projection=Some([0])                                  |
   | physical_plan                           | ProjectionExec: expr=[bar]                                               |
   |                                         |   FilterExec: bar = true                                                 |
   |                                         |     CsvExec: source=Path(/tmp/foo.csv: [/tmp/foo.csv]), has_header=false |
   +-----------------------------------------+--------------------------------------------------------------------------+
   ```
   **Expected behavior**
   I expect to see plans after filter pushdown and constant folding. Instead I see two entries for `logical_plan after projection_push_down` which does not seem right
   
   **Additional context**
   Add any other context about the problem here.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb closed issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb closed issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb commented on issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497#issuecomment-882700517


   dupe of #733 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb commented on issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497#issuecomment-853986557


   FYI @NGA-TRAN 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb commented on issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497#issuecomment-882700517


   dupe of #733 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb commented on issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497#issuecomment-853986557


   FYI @NGA-TRAN 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb commented on issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497#issuecomment-882700517


   dupe of #733 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb closed issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb closed issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow-datafusion] alamb closed issue #497: explain verbose doesn't include the output of all optimizer passes

Posted by GitBox <gi...@apache.org>.
alamb closed issue #497:
URL: https://github.com/apache/arrow-datafusion/issues/497


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org