[GitHub] [iceberg] hililiwei opened a new pull request, #7435: Core, Spark: Incremental scan return empty when start timestamp equals the end

["hililiwei (via GitHub)" <gi...@apache.org>]

hililiwei opened a new pull request, #7435:
URL: https://github.com/apache/iceberg/pull/7435

   When reading incremental data (Spark) using `start_timestamp` and `end_timestamp`, the task will fail if no new data during this time. Sometimes, these two variables are automatically passed in by the scheduler and periodically submit Spark job. During this period, there may be no new data generated in the table. 
   Might it be better to return an empty result instead?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] hililiwei commented on pull request #7435: Core, Spark: Incremental scan return empty when start timestamp equals the end

["hililiwei (via GitHub)" <gi...@apache.org>]

hililiwei commented on PR #7435:
URL: https://github.com/apache/iceberg/pull/7435#issuecomment-1540042750

   cc @Fokko @aokolnychyi 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org