You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "parthchandra (via GitHub)" <gi...@apache.org> on 2025/08/07 23:03:31 UTC
[I] Document configuration flags needed for Comet Iceberg to work correctly [datafusion-comet]
parthchandra opened a new issue, #2092:
URL: https://github.com/apache/datafusion-comet/issues/2092
We need to set -
```
"spark.comet.use.lazyMaterialization" -> "false"
"spark.comet.schemaEvolution.enabled" -> "true"
"spark.sql.iceberg.parquet.reader-type" -> "COMET"
```
These need to be documented. Eventually we need to eliminate the need for the user to set these explicitly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [iceberg] Document configuration flags needed for Comet Iceberg to work correctly [datafusion-comet]
Posted by "parthchandra (via GitHub)" <gi...@apache.org>.
parthchandra closed issue #2092: [iceberg] Document configuration flags needed for Comet Iceberg to work correctly
URL: https://github.com/apache/datafusion-comet/issues/2092
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [iceberg] Document configuration flags needed for Comet Iceberg to work correctly [datafusion-comet]
Posted by "parthchandra (via GitHub)" <gi...@apache.org>.
parthchandra commented on issue #2092:
URL: https://github.com/apache/datafusion-comet/issues/2092#issuecomment-3202310531
Docs updated in #2166
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [iceberg] Document configuration flags needed for Comet Iceberg to work correctly [datafusion-comet]
Posted by "hsiang-c (via GitHub)" <gi...@apache.org>.
hsiang-c commented on issue #2092:
URL: https://github.com/apache/datafusion-comet/issues/2092#issuecomment-3181198077
One more in `0.10.0` release
```shell
"spark.comet.exec.shuffle.enabled" -> "false"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org