You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2025/07/01 17:18:22 UTC

[I] Enable `auto` scan mode for Spark 4.0.0 [datafusion-comet]

andygrove opened a new issue, #1967:
URL: https://github.com/apache/datafusion-comet/issues/1967

   ### What is the problem the feature request solves?
   
   For the initial Spark 4.0.0 support, we disabled the `auto` scan mode:
   
   ```scala
     private def selectScan(scanExec: FileSourceScanExec, partitionSchema: StructType): String = {
   
       val fallbackReasons = new ListBuffer[String]()
   
       if (CometSparkSessionExtensions.isSpark40Plus) {
         fallbackReasons += s"$SCAN_NATIVE_ICEBERG_COMPAT  is not implemented for Spark 4.0.0"
       }
   ```
   
   We should now remove this limitation.
   
   ### Describe the potential solution
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Enable `auto` scan mode for Spark 4.0.0 [datafusion-comet]

Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #1967: Enable `auto` scan mode for Spark 4.0.0
URL: https://github.com/apache/datafusion-comet/issues/1967


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org