You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jorisvandenbossche (via GitHub)" <gi...@apache.org> on 2024/05/15 10:15:17 UTC
Re: [I] [Python] Implement a repr for Array and RecordBatch/Table for non-CPU data [arrow]
jorisvandenbossche commented on issue #41664:
URL: https://github.com/apache/arrow/issues/41664#issuecomment-2112118165
Two additional thoughts:
- For the Table (or ChunkedArray) repr, it will actually show the first and last 5 elements of _every_ chunk. That feels unnecessary to me, and the first 5 of the first chunk and last 5 of the last chunk seems sufficient?
- For heavily nested data, copying 5 rows from device to host _could_ actually be expensive because that can potentially be a lot of data. For the repr (`to_string()` / `PrettyPrint`) this is tackled by having an additional `container_window` to determine how many elements to print within a nested array. But I can imagine that honoring that also for deciding which data to copy will get complicated (an initial implemention just copying a slice of the actual array sounds good enough to me).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org