You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/03/15 22:32:00 UTC

[jira] [Assigned] (HUDI-5939) Revert "[HUDI-4675] add unittest for RebalancedSparkHoodieHBaseIndex (#6458)"

     [ https://issues.apache.org/jira/browse/HUDI-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo reassigned HUDI-5939:
-------------------------------

    Assignee: Ethan Guo

> Revert "[HUDI-4675] add unittest for RebalancedSparkHoodieHBaseIndex (#6458)"
> -----------------------------------------------------------------------------
>
>                 Key: HUDI-5939
>                 URL: https://issues.apache.org/jira/browse/HUDI-5939
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Ethan Guo
>            Assignee: Ethan Guo
>            Priority: Major
>              Labels: pull-request-available
>
> HUDI-4675 causes the Azure CI to fail:
> {code:java}
> 2023-03-15T00:57:04.0841798Z [INFO] Results:
> 2023-03-15T00:57:04.0841931Z [INFO] 
> 2023-03-15T00:57:04.0842053Z [ERROR] Failures: 
> 2023-03-15T00:57:04.0842236Z [ERROR] TestRebalancedSparkHoodieHBaseIndex.testGetHBaseKeyWithPrefix()(TestRebalancedSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0842451Z [ERROR]   Run 1: expected: <true> but was: <false>
> 2023-03-15T00:57:04.0842637Z [ERROR]   Run 2: expected: <true> but was: <false>
> 2023-03-15T00:57:04.0842783Z [ERROR]   Run 3: expected: <true> but was: <false>
> 2023-03-15T00:57:04.0842942Z [ERROR]   Run 4: expected: <true> but was: <false>
> 2023-03-15T00:57:04.0843086Z [INFO] 
> 2023-03-15T00:57:04.0843228Z [ERROR] TestSparkHoodieHBaseIndex.testDelete()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0843416Z [ERROR]   Run 1: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0843568Z [ERROR]   Run 2: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0843705Z [ERROR]   Run 3: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0843855Z [ERROR]   Run 4: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0843969Z [INFO] 
> 2023-03-15T00:57:04.0844149Z [ERROR] TestSparkHoodieHBaseIndex.testEnsureTagLocationUsesCommitTimeline()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0844337Z [ERROR]   Run 1: null
> 2023-03-15T00:57:04.0844451Z [ERROR]   Run 2: null
> 2023-03-15T00:57:04.0844579Z [ERROR]   Run 3: null
> 2023-03-15T00:57:04.0844704Z [ERROR]   Run 4: null
> 2023-03-15T00:57:04.0845192Z [INFO] 
> 2023-03-15T00:57:04.0845375Z [ERROR] TestSparkHoodieHBaseIndex.testHbaseTagLocationForArchivedCommits()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0845573Z [ERROR]   Run 1: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0845712Z [ERROR]   Run 2: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0845863Z [ERROR]   Run 3: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0845998Z [ERROR]   Run 4: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0846128Z [INFO] 
> 2023-03-15T00:57:04.0846311Z [ERROR] TestSparkHoodieHBaseIndex.testSimpleTagLocationAndUpdateWithRollback()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0848613Z [ERROR]   Run 1: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0852965Z [ERROR]   Run 2: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0856734Z [ERROR]   Run 3: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0869490Z [ERROR]   Run 4: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0869894Z [INFO] 
> 2023-03-15T00:57:04.0870118Z [ERROR] TestSparkHoodieHBaseIndex.testSimpleTagLocationWithInvalidCommit()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0870359Z [ERROR]   Run 1: null
> 2023-03-15T00:57:04.0870499Z [ERROR]   Run 2: null
> 2023-03-15T00:57:04.0870653Z [ERROR]   Run 3: null
> 2023-03-15T00:57:04.0871135Z [ERROR]   Run 4: null
> 2023-03-15T00:57:04.0871421Z [INFO] 
> 2023-03-15T00:57:04.0871770Z [ERROR] TestSparkHoodieHBaseIndex.testSmallBatchSize()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0871960Z [ERROR]   Run 1: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0872127Z [ERROR]   Run 2: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0872294Z [ERROR]   Run 3: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0872756Z [ERROR]   Run 4: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0873060Z [INFO] 
> 2023-03-15T00:57:04.0873240Z [ERROR] TestSparkHoodieHBaseIndex.testTagLocationAndDuplicateUpdate()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0873427Z [ERROR]   Run 1: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0873581Z [ERROR]   Run 2: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0873744Z [ERROR]   Run 3: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0873882Z [ERROR]   Run 4: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0874016Z [INFO] 
> 2023-03-15T00:57:04.0874186Z [ERROR] TestSparkHoodieHBaseIndex.testTagLocationAndPartitionPathUpdate()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0874391Z [ERROR]   Run 1: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0874544Z [ERROR]   Run 2: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0874681Z [ERROR]   Run 3: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0874838Z [ERROR]   Run 4: expected: <20> but was: <0>
> 2023-03-15T00:57:04.0874971Z [INFO] 
> 2023-03-15T00:57:04.0875075Z [ERROR] Errors: 
> 2023-03-15T00:57:04.0875462Z [ERROR] TestSparkHoodieHBaseIndex.testTagLocationAndPartitionPathUpdateWithExplicitRollback()(TestSparkHoodieHBaseIndex)
> 2023-03-15T00:57:04.0876209Z [ERROR]   Run 1: Failed to rollback hdfs://localhost:43515/user/vsts/test-data/e29a14fc-7783-2be0-a4f5-ca8aad1139d1/test_table commits 20230315005319759
> 2023-03-15T00:57:04.0876704Z [ERROR]   Run 2: Failed to rollback hdfs://localhost:40419/user/vsts/test-data/d216b5d2-345e-af82-0474-4cb9844d468f/test_table commits 20230315005425235
> 2023-03-15T00:57:04.0877203Z [ERROR]   Run 3: Failed to rollback hdfs://localhost:44885/user/vsts/test-data/6e944ee9-3a54-17a4-8362-5451a35a429b/test_table commits 20230315005535359
> 2023-03-15T00:57:04.0877848Z [ERROR]   Run 4: Failed to rollback hdfs://localhost:34187/user/vsts/test-data/549190ee-26be-6b70-9c57-dfaa74be8764/test_table commits 20230315005645264
> 2023-03-15T00:57:04.0878074Z [INFO] 
> 2023-03-15T00:57:04.0878183Z [WARNING] Flakes: 
> 2023-03-15T00:57:04.0878705Z [WARNING] HoodieTableType).[1] COPY_ON_WRITE(testSimpleTagLocationAndUpdate(HoodieTableType))
> 2023-03-15T00:57:04.0879053Z [INFO]   Run 1: PASS
> 2023-03-15T00:57:04.0879386Z [ERROR]   Run 2: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0879769Z [INFO] 
> 2023-03-15T00:57:04.0880120Z [WARNING] HoodieTableType).[2] MERGE_ON_READ(testSimpleTagLocationAndUpdate(HoodieTableType))
> 2023-03-15T00:57:04.0880489Z [INFO]   Run 1: PASS
> 2023-03-15T00:57:04.0880654Z [ERROR]   Run 2: expected: <10> but was: <0>
> 2023-03-15T00:57:04.0880788Z [INFO] 
> 2023-03-15T00:57:04.0880924Z [INFO] 
> 2023-03-15T00:57:04.0881100Z [ERROR] Tests run: 338, Failures: 9, Errors: 1, Skipped: 0, Flakes: 2
> 2023-03-15T00:57:04.0881261Z [INFO] 
> 2023-03-15T00:57:04.1004705Z [INFO] ------------------------------------------------------------------------
> 2023-03-15T00:57:04.1004973Z [INFO] BUILD FAILURE
> 2023-03-15T00:57:04.1005226Z [INFO] ------------------------------------------------------------------------
> 2023-03-15T00:57:04.1005429Z [INFO] Total time:  01:19 h
> 2023-03-15T00:57:04.1005671Z [INFO] Finished at: 2023-03-15T00:57:04Z
> 2023-03-15T00:57:04.1006092Z [INFO] ------------------------------------------------------------------------ {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)