[GitHub] [arrow] h-vetinari commented on issue #26685: [Python] Pickling a sliced array serializes all the buffers

["h-vetinari (via GitHub)" <gi...@apache.org>]

h-vetinari commented on issue #26685:
URL: https://github.com/apache/arrow/issues/26685#issuecomment-1597041145

   @raulcd @kou @pitrou @jorisvandenbossche
   Do you have any insights into the situation here? This bug caused [ray](https://github.com/ray-project/ray) to [pin](https://github.com/ray-project/ray/blob/ray-2.5.0/python/setup.py#L230-L234) arrow <7 on windows, which is putting us into a difficult spot in conda-forge, as we only support the last 4 major versions (which is already highly unusual in conda-forge, but owed to how quickly arrow progresses, to give projects a chance to catch up).
   
   That means arrow 7 does not get migrated against new library releases anymore (e.g. abseil,grpc,protobuf,re2, etc.), and so we'd be making ray essentially impossible to install with a current set of dependencies. By extension, this would become very painful for ray-users on windows, as their environments become hard/impossible to resolve. For these reasons, I'm opposed to adding that cap in conda-forge, but of course we don't want to ship broken packages either.
   
   CC @mattip @krfricke @clarkzinzow


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org