You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/04/19 12:04:18 UTC

[GitHub] [incubator-hudi] c-f-cooper opened a new issue #1531: run example

c-f-cooper opened a new issue #1531: run example
URL: https://github.com/apache/incubator-hudi/issues/1531
 
 
   I try to run the demo HoodieClientExample,I find the "hoodie.keep.min.commits" > "hoodie.cleaner.commits.retained",so the program runs fail,I don't know whether the logic is correct
   
   // Create the write client to write some records in
       HoodieWriteConfig cfg = HoodieWriteConfig.newBuilder().withPath(tablePath)
           .withSchema(HoodieTestDataGenerator.TRIP_EXAMPLE_SCHEMA).withParallelism(2, 2).forTable(tableName)
           .withIndexConfig(HoodieIndexConfig.newBuilder().withIndexType(IndexType.BLOOM).build())
           .withCompactionConfig(HoodieCompactionConfig.newBuilder().archiveCommitsWith(2, 3).build()).build();
   
   
   Exception in thread "main" java.lang.IllegalArgumentException: Increase hoodie.keep.min.commits=2 to be greater than hoodie.cleaner.commits.retained=10. Otherwise, there is risk of incremental pull missing data from few instants.
   	at com.google.common.base.Preconditions.checkArgument(Preconditions.java:93)
   	at org.apache.hudi.config.HoodieCompactionConfig$Builder.build(HoodieCompactionConfig.java:296)
   	at HoodieClientExample.run(HoodieClientExample.java:98)
   	at HoodieClientExample.main(HoodieClientExample.java:72)
   65941 [Thread-1] INFO  org.apache.spark.SparkContext  - Invoking stop() from shutdown hook

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] bvaradar commented on issue #1531: run example

Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #1531:
URL: https://github.com/apache/incubator-hudi/issues/1531#issuecomment-620798845


   @c-f-cooper : You can use any of 0.5.1/0.5.2 or master to see the fix.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-hudi] c-f-cooper commented on issue #1531: run example

Posted by GitBox <gi...@apache.org>.
c-f-cooper commented on issue #1531:
URL: https://github.com/apache/incubator-hudi/issues/1531#issuecomment-620336849


   0.5


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-hudi] bvaradar commented on issue #1531: run example

Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #1531:
URL: https://github.com/apache/incubator-hudi/issues/1531#issuecomment-620251761


   @c-f-cooper : Which version of hudi are you using ? This has been fixed in master ( https://github.com/apache/incubator-hudi/blob/master/hudi-client/src/test/java/HoodieClientExample.java#L98) 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-hudi] vinothchandar commented on issue #1531: run example

Posted by GitBox <gi...@apache.org>.
vinothchandar commented on issue #1531:
URL: https://github.com/apache/incubator-hudi/issues/1531#issuecomment-620775850


   could you try master or 0.5.2? 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org