You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "theotherandygrove (via GitHub)" <gi...@apache.org> on 2023/11/06 19:01:16 UTC

[I] run_first_last_multi_partitions fails in some environments [arrow-datafusion]

theotherandygrove opened a new issue, #8069:
URL: https://github.com/apache/arrow-datafusion/issues/8069

   ### Describe the bug
   
   `run_first_last_multi_partitions` fails when I run `cargo test` on my M1 Macbook Air with 16 GB RAM. It passes on my Ubuntu workstation with 128 GB RAM.
   
   ```
   ---- aggregates::tests::run_first_last_multi_partitions stdout ----
   Error: ResourcesExhausted("Failed to allocate additional 632 bytes for GroupedHashAggregateStream[0] with 1829 bytes already allocated - maximum available is 605")
   ```
   
   ### To Reproduce
   
   _No response_
   
   ### Expected behavior
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] run_first_last_multi_partitions fails in some environments [arrow-datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #8069:
URL: https://github.com/apache/arrow-datafusion/issues/8069#issuecomment-1796377698

   I ran this on my macbook (x86) that has 64GB of ram
   
   Maybe the failure is related to ARM vs Intel 🤔 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] run_first_last_multi_partitions fails in some environments [arrow-datafusion]

Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #8069: run_first_last_multi_partitions fails in some environments
URL: https://github.com/apache/arrow-datafusion/issues/8069


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] run_first_last_multi_partitions fails in some environments [arrow-datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #8069:
URL: https://github.com/apache/arrow-datafusion/issues/8069#issuecomment-1796043996

   Perhaps this is somehow related to the updates in https://github.com/apache/arrow-datafusion/commit/f1f8d79ab80039ca531e0b20cd4ac4381a073713 to support spilling group by hash: https://github.com/apache/arrow-datafusion/pull/7400
   
   https://github.com/apache/arrow-datafusion/blame/308c35404939ed39e4e398054d6fc78c89817109/datafusion/physical-plan/src/aggregates/mod.rs#L1891-L1899
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org