You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2025/07/01 17:18:22 UTC
[I] Enable `auto` scan mode for Spark 4.0.0 [datafusion-comet]
andygrove opened a new issue, #1967:
URL: https://github.com/apache/datafusion-comet/issues/1967
### What is the problem the feature request solves?
For the initial Spark 4.0.0 support, we disabled the `auto` scan mode:
```scala
private def selectScan(scanExec: FileSourceScanExec, partitionSchema: StructType): String = {
val fallbackReasons = new ListBuffer[String]()
if (CometSparkSessionExtensions.isSpark40Plus) {
fallbackReasons += s"$SCAN_NATIVE_ICEBERG_COMPAT is not implemented for Spark 4.0.0"
}
```
We should now remove this limitation.
### Describe the potential solution
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Enable `auto` scan mode for Spark 4.0.0 [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #1967: Enable `auto` scan mode for Spark 4.0.0
URL: https://github.com/apache/datafusion-comet/issues/1967
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org