You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/12/11 15:52:12 UTC
[GitHub] [iceberg] borislitvak edited a comment on issue #1912: Concurrent writes from multiple Spark drivers to S3 support
borislitvak edited a comment on issue #1912:
URL: https://github.com/apache/iceberg/issues/1912#issuecomment-743157280
For future visitors looking to compare s3 ACID data lake solutions, this scenario over S3 is not supported in Hudi/Delta and there does not seem to be a path for such a support.
So Iceberg is a clear winner in this regard!
Sources:
[Delta.io](https://github.com/delta-io/delta/issues/564)
[Hudi](https://github.com/apache/hudi/issues/2330)
How did you accomplish this, @aokolnychyi ?
UPDATE: As @vinothchandar mentioned, Iceberg's solution must go through a Hive Metastore which will provide with the synchronization primitives over S3. Hudi is considering providing a similar or better solution. I am not sure about the performance impact here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org