[GitHub] [arrow] westonpace commented on issue #33985: [C++] Support specifying filters and projections with Substrait expressions

["westonpace (via GitHub)" <gi...@apache.org>]

westonpace commented on issue #33985:
URL: https://github.com/apache/arrow/issues/33985#issuecomment-1412409926

   The Arrow equivalent of Substrait's expression is `arrow::compute::Expression`.  So I think an extended expression proto file would roughly translate to `std::vector<std::pair<std::string, arrow::compute::Expression>>` (not actually suggesting we use this API, just describing).
   
   If we added an API for that then those compute expressions could be used when building Acero filters & projects.
   
   Note: this sort of implies the user is not using Substrait to express their actual queries.  This is fine, we have non-Substrait APIs for filter & project in pyarrow (e.g. Array.filter) and R (dplyr) so there is certainly room for it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org