You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/02/06 18:39:00 UTC
[GitHub] [hudi] rubenssoto edited a comment on issue #2515: [SUPPORT] ERROR HoodieTimelineArchiveLog: Failed to archive commits
rubenssoto edited a comment on issue #2515:
URL: https://github.com/apache/hudi/issues/2515#issuecomment-774520707
@vinothchandar and @n3nash I decide to do more tests and I realized that only when I had the option hoodie.datasource.write.row.writer.enable TRUE on the bulk insert I had the problem "Failed to archive commits".
I tried to bootstrap my tables with that option false and the problem stopped.
To be sure if is not an EMR problem I did some tests on my machine and I had the same issue.
To reproduce: bootstrap a table using bulk_insert with option hoodie.datasource.write.row.writer.enable TRUE, do some upserts until the first archive attempt.
I changed some default options to test faster:
hoodie.keep.min.commits: String = "2",
hoodie.keep.max.commits: String = "3",
hoodie.cleaner.commits.retained: String = "1"
Spark 3.0.1
Hudi Version 0.7.0

I tried in my machine with the patch, and had the same error.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org