[GitHub] [arrow-datafusion] thinkharderdev commented on issue #1862: Refactor ExecutionContext and related conf to support multi-tenancy configurations.

[GitBox <gi...@apache.org>]

thinkharderdev commented on issue #1862:
URL: https://github.com/apache/arrow-datafusion/issues/1862#issuecomment-1044333494


   I think we need a way to allow the registration of custom optimizers, udfs, etc at startup. Part of the rationale for https://github.com/apache/arrow-datafusion/pull/1677 was to create a global `ExecutionContext` at startup that could serve as a hook to register extension object stores, planners, optimizers and udf/udaf (i.e. that we can use all the extensible features of DataFusion with Ballista). 
   
   Maybe we can still create the scheduler with an `ExecutionContext`\`SessionContext` and call it `session_template` or something like that. Then new sessions are cloned from that template (with any session-specific settings applied)?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org