You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jackwener (via GitHub)" <gi...@apache.org> on 2023/09/14 08:26:16 UTC

[GitHub] [arrow-datafusion] jackwener commented on pull request #7544: [MINOR]: Unknown input statistics in FilterExec

jackwener commented on PR #7544:
URL: https://github.com/apache/arrow-datafusion/pull/7544#issuecomment-1718993846

   > I'm sorry but I didn't understand exactly what you mean while saying derive/propagate.
   
   I didn't explain it in enough detail, and I apologize for that.
   
   `Statistic Derive/Propagate` is a process to compute a whole plan statistic. In general, we have the init statistic of table, and we will compute parent PlanNode from bottom to up recursively and we will compute fill statistic in all PlanNode.
   
   This PR is handle a condition: `In FilterExec::statisticsmethod, if the input statistics are None, the analysis is not performed.` So this PR fill TypeInfo (such as ScalarValue::Null) into `Statisitc`.
   
   My point is that we can also correct the "Statistic Derive" so that the input statistics are not None, but already have TypeInfo, rather than injecting TypeInfo directly into FilterExec.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org