You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2026/09/07 10:04:02 UTC
[I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
raulcd opened a new issue, #51204:
URL: https://github.com/apache/arrow/issues/51204
### Describe the enhancement requested
The [numba-cuda](https://github.com/NVIDIA/numba-cuda) project added a maintenance notice:
> Numba-CUDA is in maintenance mode. Moving forward, we intend to support only security issues and critical bug fixes through the lifetime of CUDA 13. New feature development is targeted towards [Numba-CUDA-MLIR](https://github.com/NVIDIA/numba-cuda-mlir), and we recommend upgrading to Numba-CUDA-MLIR as soon as practical. For migration guidance, see [Migration from Numba / Numba-CUDA](https://github.com/NVIDIA/numba-cuda-mlir#migration-from-numba--numba-cuda).
We should probably deprecate our usage of numba-cuda and migrate to numba-cuda-mlir. Not an expert on this area but using a deprecated maintenance only dependency doesn't sound great.
### Component(s)
GPU, Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5591382982
https://github.com/apache/arrow/issues/49437 is not fixed (there's an attached PR that deserves reviewing and perhaps helping along).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5569141902
The error it used to raise (and that I still get locally) is `Cuda error 1 in function 'cuMemcpyDtoH': [CUDA_ERROR_INVALID_VALUE] invalid argument`. But the code is really trying to access an invalid pointer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5569032977
Fair enough, should we remove the current third-party integration code? The CI jobs have been failing for months at this point.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "leofang (via GitHub)" <gi...@apache.org>.
leofang commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5592226891
Seems like it'd be fixed by https://github.com/apache/arrow/pull/50923. CUDA 11 support has been dropped since numba-cuda v0.19.0 (released in Aug, 2025).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5569087697
Perhaps NVidia can task someone to fix CI? The failing builds that needs to be fixed AFAIK is https://github.com/apache/arrow/actions/runs/34091957769/job/101647306765
Ping @kkraus14 @leofang Again :-)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "leofang (via GitHub)" <gi...@apache.org>.
leofang commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5591318208
Got it. Now that the CI is fixed, is there anything else you need help with?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5569003175
It's not really a dependency, though, its a third-party lib that we provide integration with :-)
So we can *also* provide an integration with the new thing if some contributor is interested.
@kkraus14 @leofang @tpn
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "leofang (via GitHub)" <gi...@apache.org>.
leofang commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5590863506
Q: Isn't this fix already merged? https://github.com/apache/arrow/pull/51206
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5591062092
@leofang Right, sorry, that was a subthread but this issue is still valid.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5569119354
@raulcd Note that the crashing code on the CUDA Python CI is not Numba-related.
(and it's inherently crashy, though it used to raise an error before for some reason: I think we could simply remove it)
https://github.com/apache/arrow/blob/e235bdd6fef4aad712513c2bf47894b55d3f2178/python/pyarrow/tests/test_cuda.py#L300-L306
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5569176746
> It originally started failing with:
We're talking about different failing tests here :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][GPU] numba-cuda dependency is maintenance mode only [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #51204:
URL: https://github.com/apache/arrow/issues/51204#issuecomment-5569148259
It originally started failing with:
- https://github.com/apache/arrow/issues/49437
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org