You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "2010YOUY01 (via GitHub)" <gi...@apache.org> on 2025/07/26 03:47:38 UTC
[I] Make the temporary directory (for spills) configurable through configuration API [datafusion]
2010YOUY01 opened a new issue, #16921:
URL: https://github.com/apache/datafusion/issues/16921
### Is your feature request related to a problem or challenge?
For external executions, the query might write temporary data to disk, and clean them up before the query finished.
Now the temporary path is only configurable through raw Rust code, it would be easier to set if we also support that through config API:
```
SET datafusion.runtime.temp_dir = '/ssd/temp';
select * from very_large_table order by c1;
```
Here is a initial PR to set runtime config through configuration API: https://github.com/apache/datafusion/pull/15594
DuckDB's equivalent configuration (see `temp_directory`): https://duckdb.org/docs/stable/configuration/overview.html
### Describe the solution you'd like
_No response_
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Make the temporary directory (for spills) configurable through configuration API [datafusion]
Posted by "delamarch3 (via GitHub)" <gi...@apache.org>.
delamarch3 commented on issue #16921:
URL: https://github.com/apache/datafusion/issues/16921#issuecomment-3122059434
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Make the temporary directory (for spills) configurable through configuration API [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #16921: Make the temporary directory (for spills) configurable through configuration API
URL: https://github.com/apache/datafusion/issues/16921
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org