Make the max temp directory size (for spills) configurable through configuration API #16922
Description
Is your feature request related to a problem or challenge?
See the rationales in #16921 for a similar config option
This issue is for another config max_temp_directory_size (DuckDB's equivalent: https://duckdb.org/docs/stable/configuration/overview.html)
It's added to datafusion in #15520
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response