[GitHub] [arrow-datafusion-python] kylebarron commented on issue #326: datafusion 22 does not install on Google Colab

["kylebarron (via GitHub)" <gi...@apache.org>]

kylebarron commented on issue #326:
URL: https://github.com/apache/arrow-datafusion-python/issues/326#issuecomment-1515461678

   > Upon examining PyPi I noticed that we are not building a dist for Python 3.9, which is what colab currently uses
   
   Datafusion is building `abi3` wheels, which means that pip will accept those wheels for any version >= 3.7, so that's not the issue.
   
   When we look at the wheels on pypi, we see that the linux wheel is named
   ```
   
   datafusion-22.0.0-cp37-abi3-manylinux_2_34_x86_64.whl 
   ```
   The key part of this is the `manylinux_2_34`. If we `pip install numpy` on Colab, we see that it installs:
   ```
   numpy-1.24.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
   ```
   
   So the key part is that the linux wheel datafusion builds for Linux is too new. There's helpful background information on https://github.com/pypa/manylinux. I'm not an expert on `maturin-action` but presumably one of these config options you need to change:
   https://github.com/apache/arrow-datafusion-python/blob/94936380e58a266f5dd5de6b70a06d3aa36fbe22/.github/workflows/build.yml#L122-L124


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org