[GitHub] [iceberg] RussellSpitzer commented on issue #3564: Already closed files for partition error when sorting by date due to timezone

[GitBox <gi...@apache.org>]

RussellSpitzer commented on issue #3564:
URL: https://github.com/apache/iceberg/issues/3564#issuecomment-984089046


   Already Closed files can be ignored as well if you switch to the fan out writer at the cost of potentially writing more files. In the current version It would make sense to just sort using the Iceberg partitioning algorithm rather than the Spark built in. IE Covert to UTC then get the date from that, I think spark does have a to UTC date somewhere...
   
    I believe we are targeting the distribution required code in the 13.0 release. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org