You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by Andrew Lamb <al...@influxdata.com> on 2022/01/12 14:20:54 UTC

[Rust][DataFusion][DISCUSS] DataFusion Resource(Memory + Disk) API

Greetings fellow Rustaceans,

I wanted to bring some extra attention to a PR[1] contributed by Yijie Shen
that adds an initial resource management API to datafusion.

While the implementation will likely undergo the normal iteration,
iterating on the APIs will likely be more disruptive. Thus I would
appreciate it if anyone who had time could check out the `RuntimeEnv`,
`MemoryConsumer`, `MemoryManager`, and `DiskManager` APIs and highlight any
comments or concerns.

If you need additional time to review, please leave a comment on the PR.

Thank you,
Andrew

[1] https://github.com/apache/arrow-datafusion/pull/1526