You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/05/04 16:30:00 UTC

[jira] [Updated] (HUDI-6178) Fix flaky test testHoodieIndexer

     [ https://issues.apache.org/jira/browse/HUDI-6178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-6178:
----------------------------
    Description: 
{code:java}
[ERROR] Tests run: 108, Failures: 0, Errors: 1, Skipped: 5, Time elapsed: 2,796.535 s <<< FAILURE! - in org.apache.hudi.utilities.deltastreamer.TestHoodieDeltaStreamer
[ERROR] testHoodieIndexer{HoodieRecordType}[2]  Time elapsed: 75.815 s  <<< ERROR!
    ... 8 more
Caused by: org.apache.hudi.exception.HoodieException: hoodie.properties file seems invalid. Please check for left over `.updated` files if any, manually copy it to hoodie.properties and retry
    at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$1(HoodieDeltaStreamer.java:756)
    at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
    ... 3 more
Caused by: java.lang.IllegalArgumentException: hoodie.properties file seems invalid. Please check for left over `.updated` files if any, manually copy it to hoodie.properties and retry
    at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:42)
    at org.apache.hudi.common.table.HoodieTableConfig.<init>(HoodieTableConfig.java:283)
    at org.apache.hudi.common.table.HoodieTableMetaClient.<init>(HoodieTableMetaClient.java:138)
    at org.apache.hudi.common.table.HoodieTableMetaClient.newMetaClient(HoodieTableMetaClient.java:689)
    at org.apache.hudi.common.table.HoodieTableMetaClient.access$000(HoodieTableMetaClient.java:81)
    at org.apache.hudi.common.table.HoodieTableMetaClient$Builder.build(HoodieTableMetaClient.java:770)
    at org.apache.hudi.client.BaseHoodieClient.createMetaClient(BaseHoodieClient.java:157)
    at org.apache.hudi.client.BaseHoodieWriteClient.initTable(BaseHoodieWriteClient.java:1165)
    at org.apache.hudi.client.BaseHoodieWriteClient.initTable(BaseHoodieWriteClient.java:1200)
    at org.apache.hudi.client.SparkRDDWriteClient.insert(SparkRDDWriteClient.java:163)
    at org.apache.hudi.utilities.deltastreamer.DeltaSync.writeToSink(DeltaSync.java:762)
    at org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:432)
    at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$1(HoodieDeltaStreamer.java:717)
    ... 4 more {code}

> Fix flaky test testHoodieIndexer
> --------------------------------
>
>                 Key: HUDI-6178
>                 URL: https://issues.apache.org/jira/browse/HUDI-6178
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Ethan Guo
>            Priority: Major
>
> {code:java}
> [ERROR] Tests run: 108, Failures: 0, Errors: 1, Skipped: 5, Time elapsed: 2,796.535 s <<< FAILURE! - in org.apache.hudi.utilities.deltastreamer.TestHoodieDeltaStreamer
> [ERROR] testHoodieIndexer{HoodieRecordType}[2]  Time elapsed: 75.815 s  <<< ERROR!
>     ... 8 more
> Caused by: org.apache.hudi.exception.HoodieException: hoodie.properties file seems invalid. Please check for left over `.updated` files if any, manually copy it to hoodie.properties and retry
>     at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$1(HoodieDeltaStreamer.java:756)
>     at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
>     ... 3 more
> Caused by: java.lang.IllegalArgumentException: hoodie.properties file seems invalid. Please check for left over `.updated` files if any, manually copy it to hoodie.properties and retry
>     at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:42)
>     at org.apache.hudi.common.table.HoodieTableConfig.<init>(HoodieTableConfig.java:283)
>     at org.apache.hudi.common.table.HoodieTableMetaClient.<init>(HoodieTableMetaClient.java:138)
>     at org.apache.hudi.common.table.HoodieTableMetaClient.newMetaClient(HoodieTableMetaClient.java:689)
>     at org.apache.hudi.common.table.HoodieTableMetaClient.access$000(HoodieTableMetaClient.java:81)
>     at org.apache.hudi.common.table.HoodieTableMetaClient$Builder.build(HoodieTableMetaClient.java:770)
>     at org.apache.hudi.client.BaseHoodieClient.createMetaClient(BaseHoodieClient.java:157)
>     at org.apache.hudi.client.BaseHoodieWriteClient.initTable(BaseHoodieWriteClient.java:1165)
>     at org.apache.hudi.client.BaseHoodieWriteClient.initTable(BaseHoodieWriteClient.java:1200)
>     at org.apache.hudi.client.SparkRDDWriteClient.insert(SparkRDDWriteClient.java:163)
>     at org.apache.hudi.utilities.deltastreamer.DeltaSync.writeToSink(DeltaSync.java:762)
>     at org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:432)
>     at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$1(HoodieDeltaStreamer.java:717)
>     ... 4 more {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)