You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "timsaucer (via GitHub)" <gi...@apache.org> on 2025/03/08 13:45:31 UTC
[I] Expose global context [datafusion-python]
timsaucer opened a new issue, #1045:
URL: https://github.com/apache/datafusion-python/issues/1045
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
#982 added convenience functions to use a global context for operations like `read_parquet` and others. It would be good to expose the global context to make it easier for users to register functions with it.
**Describe the solution you'd like**
- Rename `_global_ctx` to `global_ctx`.
- Expose to python
- Add unit tests
- Add user documentation
**Describe alternatives you've considered**
We can leave as is.
**Additional context**
It is worth considering if there are other common user functions that would benefit from the same treatment as the file readers. If so, we could open new issues for them
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Expose global context [datafusion-python]
Posted by "Spaarsh (via GitHub)" <gi...@apache.org>.
Spaarsh commented on issue #1045:
URL: https://github.com/apache/datafusion-python/issues/1045#issuecomment-2708491652
Key Points:
1. ```|``` operator not supported for python < 3.10, anyone pulling the main will not be able to use ```SessionContext``` at all
2. ```global_ctx``` already exposed to python
I have left a detailed comment under #982 [here](https://github.com/apache/datafusion-python/pull/982#issuecomment-2708491224)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Make global context easier to access for users [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer closed issue #1045: Make global context easier to access for users
URL: https://github.com/apache/datafusion-python/issues/1045
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Make global context easier to access for users [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #1045:
URL: https://github.com/apache/datafusion-python/issues/1045#issuecomment-2725082592
Closed by #1060
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Expose global context [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #1045:
URL: https://github.com/apache/datafusion-python/issues/1045#issuecomment-2710856896
I understand what you mean by "global context is already exposed" but I mean that it should be treated in the wrapper functions as well so that users get a nice python interface and don't need to jump into the `_internal` package.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Make global context easier to access for users [datafusion-python]
Posted by "jsai28 (via GitHub)" <gi...@apache.org>.
jsai28 commented on issue #1045:
URL: https://github.com/apache/datafusion-python/issues/1045#issuecomment-2711006706
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Expose global context [datafusion-python]
Posted by "Spaarsh (via GitHub)" <gi...@apache.org>.
Spaarsh commented on issue #1045:
URL: https://github.com/apache/datafusion-python/issues/1045#issuecomment-2708982762
Should make a PR that doesn't use the ```|``` operator? We simply need to use the ```Union``` function instead. I already have that code running locally.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Expose global context [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #1045:
URL: https://github.com/apache/datafusion-python/issues/1045#issuecomment-2708991997
No, we have plenty of other points in the code where we us the | operator. Also, that issue is related, but not the topic of this issue. We also have a PR up that resolves the error and adds ruff checking to prevent it from happening in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Make global context easier to access for users [datafusion-python]
Posted by "jsai28 (via GitHub)" <gi...@apache.org>.
jsai28 commented on issue #1045:
URL: https://github.com/apache/datafusion-python/issues/1045#issuecomment-2711001874
.take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org