You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "DDtKey (via GitHub)" <gi...@apache.org> on 2023/02/01 18:01:23 UTC

[GitHub] [arrow-datafusion] DDtKey commented on issue #5108: Out of memory when sorting

DDtKey commented on issue #5108:
URL: https://github.com/apache/arrow-datafusion/issues/5108#issuecomment-1412491794

   Was able to reproduce it against the latest version (`17.0.0`) and wasn't able against `16.0.0` - it returned correct error about allocation.
   
   So looks like regression to me. Gonna use bisect to find commit that has introduced it and report it here with details.
   
   My case in two words: with latest version memory limits (FairSpillPool - 4GiB) were ignored and memory consuming up to OOM (join of 4 files with ~1gb of data in each one)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org