You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/11/23 14:24:00 UTC

[jira] [Created] (ARROW-14798) [Python] Limit the size of the repr for large Tables

Joris Van den Bossche created ARROW-14798:
---------------------------------------------

             Summary: [Python] Limit the size of the repr for large Tables
                 Key: ARROW-14798
                 URL: https://issues.apache.org/jira/browse/ARROW-14798
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
            Reporter: Joris Van den Bossche
             Fix For: 7.0.0


The new repr is nice that it shows a preview of the data, but this can also become very long flooding your console output for larger tables.

We already default to 10 preview cols, but each column can still consist of many chunks. So it might be good to also limit it to 2 chunks? 

The ChunkedArray.to_string method already has a {{window}} keyword, but that seems to control both the number of elements to show per chunk as the number of chunks (while it would be nice to limit eg to 2 chunks but show up to 10 elements for each chunk).

cc [~amol-]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)