You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "timsaucer (via GitHub)" <gi...@apache.org> on 2024/12/13 14:29:27 UTC

[I] chore: Upgrade to DataFusion 44 [datafusion-python]

timsaucer opened a new issue, #972:
URL: https://github.com/apache/datafusion-python/issues/972

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   
   DataFusion 44 is preparing for the next release. Let's start the upgrade process and document all changes we've needed to make to feed back to them as part of an upgrade guide.
   
   **Describe the solution you'd like**
   
   Keep a running branch with the upgrade differences and document in this issue what we've encountered as we go along. Ideally we will complete this evaluation *before* the datafusion release process ends so we can identify issues earlier.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] chore: Upgrade to DataFusion 44 [datafusion-python]

Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer closed issue #972: chore: Upgrade to DataFusion 44
URL: https://github.com/apache/datafusion-python/issues/972


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] chore: Upgrade to DataFusion 44 [datafusion-python]

Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #972:
URL: https://github.com/apache/datafusion-python/issues/972#issuecomment-2541649699

   1. The trait definition of `ExecutionPlanProperties` return type for `output_ordering` now is `Option<&LexOrdering>` instead of `Option<&[PhysicalSortExpr]>`. The recommendation is to use `.into()` to convert into the required output.
   2. `find_df_window_func` has now been removed from the `logical_expr` crate. If users require this functionality they can perform equivalent searches by either creating a default session context, or calling `all_default_aggregate_functions` and `all_default_window_functions`, or by searching their existing session context using `ctx.udaf`, `ctx.window_functions`, `ctx.aggregate_functions`, and so on.
   3. `LogicalPlan::Prepare` and `LogicalPlan::Execute` have been removed. We do not actively use these in `datafusion-python` and I didn't search further for figuring out migration strategy.
   4. `to_substrait_plan` and `from_substrait_plan` no longer take a session context. Rather they expect a `SubstraitPlanningState` which is implemented by SessionState. One recommended migration is to call `ctx.ctx.state()` and use a borrow of the returned SessionState.
   5. `RuntimeConfig` is now deprecated in favor of `RuntimeEnvBuilder`. The migration is fairly straightforward, except to create the RuntimeEnv you now call `build()`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org