You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "westonpace (via GitHub)" <gi...@apache.org> on 2023/02/25 00:40:27 UTC

[GitHub] [arrow] westonpace opened a new issue, #34344: [C++] Pass function registry to dataset operations

westonpace opened a new issue, #34344:
URL: https://github.com/apache/arrow/issues/34344

   ### Describe the enhancement requested
   
   The datasets API does various compute operations on expressions.  All of these operations today use the default function registry.  This could prevent us from being able to use UDFs in these operations.
   
   For example, if someone had a filter `my_udf(x) > 7` and, via partitioning, we know that `x=="a"` then we could potentially evaluate `my_udf("a")` to determine if we need to skip the fragment.  Today we will try this with the default function registry and, if `my_udf` is not defined, we will fail.
   
   At the moment I'm deferring this because I expect this situation would be quite rare (would require not only UDFs but UDFs that are not registered with the default function registry) and the changes are rather spread out through the code base.
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [C++] Pass function registry to dataset operations [arrow]

Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic closed issue #34344: [C++] Pass function registry to dataset operations
URL: https://github.com/apache/arrow/issues/34344


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [C++] Pass function registry to dataset operations [arrow]

Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #34344:
URL: https://github.com/apache/arrow/issues/34344#issuecomment-3921696840

   This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org