You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "timsaucer (via GitHub)" <gi...@apache.org> on 2026/02/02 18:57:39 UTC
[I] Display max memory size is not respected if repr_rows < min_rows [datafusion-python]
timsaucer opened a new issue, #1362:
URL: https://github.com/apache/datafusion-python/issues/1362
**Describe the bug**
Our default values of repr_rows is 10 and min_rows is 20.
**To Reproduce**
Print any large dataframe (>2 Mb). The entire frame is collected, even if it is not shown.
**Expected behavior**
Stop the stream when the memory limit is reached.
**Additional context**
It *seems* like min_rows should always be <= repr_rows. Maybe we should call it max_rows instead of repr_rows? The documentation also states "If you want a specific number of rows, set min_rows == max_rows."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Display max memory size is not respected if repr_rows < min_rows [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer closed issue #1362: Display max memory size is not respected if repr_rows < min_rows
URL: https://github.com/apache/datafusion-python/issues/1362
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Display max memory size is not respected if repr_rows < min_rows [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #1362:
URL: https://github.com/apache/datafusion-python/issues/1362#issuecomment-3837060759
FYI @kosiew
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org