[PR] [comet-parquet-exec] Handle CometNativeScan RDD when DataSourceRDD instead of FileScanRDD [datafusion-comet]

["mbutrovich (via GitHub)" <gi...@apache.org>]

mbutrovich opened a new pull request, #1088:
URL: https://github.com/apache/datafusion-comet/pull/1088

   I think when prefetching is enabled (which is probably a setting not relevant to ParquetExec anyway we end up with a DataSourceRDD in the scan instead of a FileScanRDD. This extracts the partitions from that RDD type.
   ```
   Total number of tests run: 754
   Suites: completed 32, aborted 0
   Tests: succeeded 609, failed 145, canceled 1, ignored 46, pending 0
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [PR] [comet-parquet-exec] Handle CometNativeScan RDD when DataSourceRDD instead of FileScanRDD [datafusion-comet]

["andygrove (via GitHub)" <gi...@apache.org>]

andygrove merged PR #1088:
URL: https://github.com/apache/datafusion-comet/pull/1088


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org