You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/04/22 07:40:48 UTC

[GitHub] [incubator-hudi] lamber-ken commented on issue #1542: [HUDI-820] cleaner repair command should only inspect clean metadata files

lamber-ken commented on issue #1542:
URL: https://github.com/apache/incubator-hudi/pull/1542#issuecomment-617608459


   > Randomly saw this in test logs..
   > 
   > ```
   > 298541 [main] WARN  org.apache.hudi.common.HoodieClientTestHarness  - Closing file-system instance used in previous test-run
   > 298630 [main] WARN  org.apache.hudi.table.action.clean.CleanActionExecutor  - Failed to perform previous clean operation, instant: [==>000000023__clean__INFLIGHT]
   > org.apache.hudi.exception.HoodieIOException: Not an Avro data file
   > 	at org.apache.hudi.table.action.clean.CleanActionExecutor.runPendingClean(CleanActionExecutor.java:212)
   > 	at org.apache.hudi.table.action.clean.CleanActionExecutor.lambda$execute$5(CleanActionExecutor.java:261)
   > 	at java.util.ArrayList.forEach(ArrayList.java:1257)
   > 	at org.apache.hudi.table.action.clean.CleanActionExecutor.execute(CleanActionExecutor.java:258)
   > 	at org.apache.hudi.table.HoodieCopyOnWriteTable.clean(HoodieCopyOnWriteTable.java:197)
   > 	at org.apache.hudi.client.HoodieWriteClient.clean(HoodieWriteClient.java:630)
   > 	at org.apache.hudi.table.TestCleaner.runCleaner(TestCleaner.java:425)
   > 	at org.apache.hudi.table.TestCleaner.runCleaner(TestCleaner.java:414)
   > 	at org.apache.hudi.table.TestCleaner.testCleanPreviousCorruptedCleanFiles(TestCleaner.java:1000)
   > ```
   > 
   > (May be totally a false alarm, but just saying we should understand if all these are expected)..
   
   These are expected, in `TestCleaner#testCleanPreviousCorruptedCleanFiles` test case, create a corrupted clean files first, then run cleaner.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org