[GitHub] [iceberg] abmo-x commented on issue #4168: Flink S3Fileio incorrect commit

[GitBox <gi...@apache.org>]

abmo-x commented on issue #4168:
URL: https://github.com/apache/iceberg/issues/4168#issuecomment-1188045274

   Wanted to also add that we are seeing similar behavior for file which BaseTaskWriter logs as successfully completed and I don't see any errors for s3 upload in the logs around that time frame. 
   
   But the data file does not exist on S3, but the below log is logged which then adds the data file to the manifest.
   
   ```
   logger_name:  org.apache.iceberg.io.BaseTaskWriter 
   Complete data file GenericDataFile{content=data, file_path=PATH_TO_FILE_THAT_DOESN'T EXIST file_format=PARQUET, spec_id=0, partition=PartitionData{date=2022-07-15, hour=14}
   ```
   
   Our S3 bucket is versioned, no versions exists in s3 for that file. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org