[jira] [Commented] (HUDI-8633) Flaky test about partition stats

["Lin Liu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-8633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902513#comment-17902513 ] 

Lin Liu commented on HUDI-8633:
-------------------------------

The root cause is the way we construct the test is not correct; not related to the Hudi code. We assume that there are 2 rows for each row key; but this is not true based on the following aggregations.
{code:java}
+------------------------------------+-----+
|_row_key                            |count|
+------------------------------------+-----+
|e98313a8-888f-4cf7-9f41-4deda69f6182|2    |
|3e6d116e-25b8-4fbd-8053-fcafc1f722ef|2    |
|ea8fd6d7-a0d8-422a-984c-361e2812c12f|2    |
|9bbc3d7a-69df-4241-ad01-b7f8198cf73f|2    |
|fa58629b-d8f8-4fcb-a3ab-5a31954d6bbd|2    |
|453ffbb8-3f1e-45fc-aecf-7148674359ad|2    |
|c148b970-72ac-4ef2-84cf-d85ab85d02e1|2    |
|73eaac9c-e481-4047-81d2-2e444ef9e2f8|2    |
|5a9b4944-fff5-482c-9859-ed99111edd89|2    |
|94e70ed7-6dea-4a72-99dc-a4831441f006|2    |
|4b72d38a-c2cd-4cd7-abf0-7bc3ff5d7191|1    |
|9bdad01f-b049-4877-b757-8775904913fe|1    |
|fe429008-7609-4871-a6c9-54fff4fee614|2    |
|0702eeb9-41ad-49a9-9faf-2845a73c5c3f|2    |
|1b5f5644-c539-4362-a822-d5dc21fe320c|2    |
|ea84346b-8b02-43d0-98c6-01e16f26ffa6|1    |
|28e03231-c4e6-4f04-a418-d8a6645fd362|1    |
|dd48bfdb-8338-4c9a-95f9-3cab5a2bcc8c|1    |
|d1969c75-50b0-4524-9c3f-350225657919|2    |
|a3d8e819-47ea-41bd-b15b-372f8ca50e1a|2    |
+------------------------------------+-----+ {code}

> Flaky test about partition stats
> --------------------------------
>
>                 Key: HUDI-8633
>                 URL: https://issues.apache.org/jira/browse/HUDI-8633
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Lin Liu
>            Assignee: Sagar Sumit
>            Priority: Major
>             Fix For: 1.0.1
>
>
> {code:java}
> 2024-12-02T22:43:30.6744814Z [ERROR] [1] tableType=COPY_ON_WRITE(testPartitionStatsWithCompactionAndCleaning(HoodieTableType))  Time elapsed: 12.795 s  <<< FAILURE!
> 2024-12-02T22:43:30.6745365Z org.opentest4j.AssertionFailedError: expected: <2> but was: <1>
> 2024-12-02T22:43:30.6745860Z 	at org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:55)
> 2024-12-02T22:43:30.6746224Z 	at org.junit.jupiter.api.AssertionUtils.failNotEqual(AssertionUtils.java:62)
> 2024-12-02T22:43:30.6746587Z 	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:166)
> 2024-12-02T22:43:30.6746938Z 	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:161)
> 2024-12-02T22:43:30.6747298Z 	at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:628)
> 2024-12-02T22:43:30.6747831Z 	at org.apache.hudi.functional.TestPartitionStatsIndex.verifyQueryPredicate(TestPartitionStatsIndex.scala:480)
> 2024-12-02T22:43:30.6748306Z 	at org.apache.hudi.functional.TestPartitionStatsIndex.testPartitionStatsWithCompactionAndCleaning(TestPartitionStatsIndex.scala:348)
> 2024-12-02T22:43:30.6748678Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2024-12-02T22:43:30.6749024Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2024-12-02T22:43:30.6749420Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2024-12-02T22:43:30.6749757Z 	at java.lang.reflect.Method.invoke(Method.java:498) {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)