You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "SarahAsad23 (via GitHub)" <gi...@apache.org> on 2026/03/18 23:25:44 UTC
[I] Support Alternative Package Managers (Conda/UV) in Python Virtual Environments [texera]
SarahAsad23 opened a new issue, #4317:
URL: https://github.com/apache/texera/issues/4317
### Task Summary
Currently, package installation within Python Virtual Environments is handled exclusively through pip. However, some users rely on alternative package managers such as Conda or UV for better dependency resolution, performance, or compatibility with specific libraries.
To improve flexibility and usability, the system should allow users to select their preferred package manager (pip, Conda, or UV) when configuring a Python Virtual Environment. Based on the selected option, the environment setup and dependency installation process should use the corresponding package manager while maintaining compatibility with the system’s execution requirements.
### Priority
P2 – Medium
### Task Type
- [x] Code Implementation
- [ ] Documentation
- [x] Refactor / Cleanup
- [ ] Testing / QA
- [ ] DevOps / Deployment
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Alternative Package Managers (Conda/UV) in Python Virtual Environments [texera]
Posted by "Yicong-Huang (via GitHub)" <gi...@apache.org>.
Yicong-Huang commented on issue #4317:
URL: https://github.com/apache/texera/issues/4317#issuecomment-4292862741
conda is env + package management. pyenv + pip should be able to support the same experience. But after some research they each have different coverage:
* pip installs from PyPI and focuses on Python packages.
* conda installs from conda channels and can provide Python, C/C++ libs, runtimes, CUDA-related pieces, and other non-Python dependencies together.
But on python libraries, many more packages are pip/PyPI-only than conda-only. PyPI is the larger ecosystem, and even Anaconda’s own docs say you may need pip when a package or version is not available in conda channels.
With those understanding, and since we are targeting data science, I think we might need a solution with conda + pip. Note that this is different from letting users to choose alternative, but we offer conda + pip bundle as the only solution.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Alternative Package Managers (Conda/UV) in Python Virtual Environments [texera]
Posted by "SarahAsad23 (via GitHub)" <gi...@apache.org>.
SarahAsad23 commented on issue #4317:
URL: https://github.com/apache/texera/issues/4317#issuecomment-4287603599
I agree with you, It does introduce complexity. One of our collaborators in the scientific community uses Conda for package installation to meet certain GPU specific requirements, which is why this feature was requested. We have not yet discussed the idea in depth.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Alternative Package Managers (Conda/UV) in Python Virtual Environments [texera]
Posted by "chenlica (via GitHub)" <gi...@apache.org>.
chenlica commented on issue #4317:
URL: https://github.com/apache/texera/issues/4317#issuecomment-4294022601
@SarahAsad23 Please confirm you are clear about the plan and agree with it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Alternative Package Managers (Conda/UV) in Python Virtual Environments [texera]
Posted by "Yicong-Huang (via GitHub)" <gi...@apache.org>.
Yicong-Huang commented on issue #4317:
URL: https://github.com/apache/texera/issues/4317#issuecomment-4286673022
I am hesitate to allow users to choose their own env and package managing tools. It simply adds complexity to our end.
I strongly suggest we keep with pip for simplicity for now. I've heard UV is pretty good, but still under testing (haven't released their 1.0 version). Conda is a bit heavy.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Alternative Package Managers (Conda/UV) in Python Virtual Environments [texera]
Posted by "SarahAsad23 (via GitHub)" <gi...@apache.org>.
SarahAsad23 commented on issue #4317:
URL: https://github.com/apache/texera/issues/4317#issuecomment-4297354367
I agree with this idea.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org