You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "alexr17 (via GitHub)" <gi...@apache.org> on 2026/01/21 23:59:05 UTC

[PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

alexr17 opened a new pull request, #17975:
URL: https://github.com/apache/hudi/pull/17975

   ### Describe the issue this Pull Request addresses
   
   https://github.com/apache/hudi/issues/17974
   
   ### Summary and Changelog
   
   Always report the metric
   
   ### Impact
   
   Consistently reports the kafka delay metric
   
   ### Risk Level
   
   Low
   
   ### Documentation Update
   
   None
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Enough context is provided in the sections above
   - [ ] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3850877190

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "3849580418",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679",
       "triggerID" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 02ee843aa43f0403018cda4c729b8fa79ef9351a Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3874786532

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679",
       "triggerID" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679",
       "triggerID" : "3849580418",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 02ee843aa43f0403018cda4c729b8fa79ef9351a Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "lokeshj1703 (via GitHub)" <gi...@apache.org>.
lokeshj1703 commented on code in PR #17975:
URL: https://github.com/apache/hudi/pull/17975#discussion_r2715756682


##########
hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/helpers/TestKafkaOffsetGen.java:
##########
@@ -605,4 +607,67 @@ void mockDescribeTopicConfigs(MockedStatic<AdminClient> staticMock, Map kafkaPar
     when(mock.describeConfigs(Collections.singleton(resource))).thenReturn(mockResult);
     when(mockResult.all()).thenReturn(future);
   }
+
+  @Test
+  public void testKafkaDelayCountMetricEmittedWithLag() {
+    testUtils.createTopic(testTopicName, 1);
+    String[] messages = new String[1000];
+    for (int i = 0; i < 1000; i++) {
+      messages[i] = String.format("{\"id\":\"%d\"}", i);
+    }
+    testUtils.sendMessages(testTopicName, messages);
+
+    HoodieIngestionMetrics mockMetrics = mock(HoodieIngestionMetrics.class);
+    KafkaOffsetGen kafkaOffsetGen = new KafkaOffsetGen(getConsumerConfigs("earliest", KAFKA_CHECKPOINT_TYPE_STRING));
+
+    // Read first 250 messages, then simulate lag
+    String lastCheckpointString = testTopicName + ",0:250";
+    kafkaOffsetGen.getNextOffsetRanges(
+        Option.of(new StreamerCheckpointV2(lastCheckpointString)), 500, mockMetrics);
+
+    // Verify metric was called with lag count of 750 (1000 - 250)
+    verify(mockMetrics, times(1)).updateStreamerSourceDelayCount("kafkaDelayCount", 750L);
+  }
+
+  @Test
+  public void testKafkaDelayCountMetricEmittedWithoutCheckpoint() {
+    testUtils.createTopic(testTopicName, 1);
+    String[] messages = new String[1000];
+    for (int i = 0; i < 1000; i++) {
+      messages[i] = String.format("{\"id\":\"%d\"}", i);
+    }
+    testUtils.sendMessages(testTopicName, messages);
+
+    HoodieIngestionMetrics mockMetrics = mock(HoodieIngestionMetrics.class);
+    KafkaOffsetGen kafkaOffsetGen = new KafkaOffsetGen(getConsumerConfigs("earliest", KAFKA_CHECKPOINT_TYPE_STRING));
+
+    // First run without checkpoint
+    kafkaOffsetGen.getNextOffsetRanges(Option.empty(), 500, mockMetrics);
+
+    // Verify metric was called with 0 (no checkpoint = no lag)
+    verify(mockMetrics, times(1)).updateStreamerSourceDelayCount("kafkaDelayCount", 0L);
+  }
+
+  @Test
+  public void testKafkaDelayCountMetricEmittedWithMultiplePartitions() {
+    testUtils.createTopic(testTopicName, 2);
+    String[] messages = new String[1000];
+    for (int i = 0; i < 1000; i++) {
+      messages[i] = String.format("{\"id\":\"%d\"}", i);
+    }
+    testUtils.sendMessages(testTopicName, messages);
+
+    HoodieIngestionMetrics mockMetrics = mock(HoodieIngestionMetrics.class);
+    KafkaOffsetGen kafkaOffsetGen = new KafkaOffsetGen(getConsumerConfigs("earliest", KAFKA_CHECKPOINT_TYPE_STRING));
+
+    // Checkpoint with some consumed messages, creating lag
+    String lastCheckpointString = testTopicName + ",0:250,1:249";
+    kafkaOffsetGen.getNextOffsetRanges(
+        Option.of(new StreamerCheckpointV2(lastCheckpointString)), 300, mockMetrics);
+
+    // Verify metric was called with a lag count > 0 (exact value depends on partition distribution)
+    ArgumentCaptor<Long> delayCaptor = ArgumentCaptor.forClass(Long.class);
+    verify(mockMetrics, times(1)).updateStreamerSourceDelayCount(eq("kafkaDelayCount"), delayCaptor.capture());
+    assertTrue(delayCaptor.getValue() > 0, "Delay count should be greater than 0 when there is lag");

Review Comment:
   We can add a validation for exact delay, it would help in validation delay computation is correct for multiple partitions as well.



##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java:
##########
@@ -313,10 +313,15 @@ public OffsetRange[] getNextOffsetRanges(Option<Checkpoint> lastCheckpoint, long
       } else {
         lastCheckpointStr = lastCheckpoint.isPresent() ? Option.of(lastCheckpoint.get().getCheckpointKey()) : Option.empty();
       }
+
+      long kafkaDelayCount = 0L;
+      if (lastCheckpointStr.isPresent() && !lastCheckpointStr.get().isEmpty()) {
+        kafkaDelayCount = delayOffsetCalculation(lastCheckpointStr, topicPartitions, consumer);
+      }
+

Review Comment:
   NIT: We can move the code block where metrics are emitted



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3850689142

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "3849580418",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679",
       "triggerID" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 891ce7672d0b708edec7a1aa404d663fb803bf96 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605) 
   * 02ee843aa43f0403018cda4c729b8fa79ef9351a Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3849604000

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "3849580418",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 891ce7672d0b708edec7a1aa404d663fb803bf96 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3781746312

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 96fe94fa330ab6dbeafc97aef3dc67352769d574 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3821313186

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 96fe94fa330ab6dbeafc97aef3dc67352769d574 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265) 
   * c9971485f7dd94badb089fed73c2e20fbdef0e81 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "alexr17 (via GitHub)" <gi...@apache.org>.
alexr17 commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3849580418

   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3849591068

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3849580418",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 891ce7672d0b708edec7a1aa404d663fb803bf96 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3874774529

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11679",
       "triggerID" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3849580418",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "CANCELED",
       "url" : "TBD",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 0000 Unknown: [CANCELED](TBD) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3781983027

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 96fe94fa330ab6dbeafc97aef3dc67352769d574 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3821327891

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 96fe94fa330ab6dbeafc97aef3dc67352769d574 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265) 
   * c9971485f7dd94badb089fed73c2e20fbdef0e81 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524) 
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3821640505

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3837426450

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529) 
   * 891ce7672d0b708edec7a1aa404d663fb803bf96 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "voonhous (via GitHub) via commits" <co...@hudi.apache.org>.
voonhous closed pull request #17975: fix: kafka delay metrics reporting when offsets caught up
URL: https://github.com/apache/hudi/pull/17975


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3821305639

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 96fe94fa330ab6dbeafc97aef3dc67352769d574 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265) 
   * c9971485f7dd94badb089fed73c2e20fbdef0e81 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3837418487

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529) 
   * 891ce7672d0b708edec7a1aa404d663fb803bf96 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3837540676

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 891ce7672d0b708edec7a1aa404d663fb803bf96 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "voonhous (via GitHub)" <gi...@apache.org>.
voonhous closed pull request #17975: fix: kafka delay metrics reporting when offsets caught up
URL: https://github.com/apache/hudi/pull/17975


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3821435066

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * c9971485f7dd94badb089fed73c2e20fbdef0e81 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524) 
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3837137849

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3837125259

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3781732608

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 96fe94fa330ab6dbeafc97aef3dc67352769d574 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3874754165

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 02ee843aa43f0403018cda4c729b8fa79ef9351a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3821481743

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * c9971485f7dd94badb089fed73c2e20fbdef0e81 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524) 
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3821336811

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 96fe94fa330ab6dbeafc97aef3dc67352769d574 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265) 
   * c9971485f7dd94badb089fed73c2e20fbdef0e81 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524) 
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 66d7d2b01765d8666a4f2fcb398b6b9e5fb94652 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "alexr17 (via GitHub)" <gi...@apache.org>.
alexr17 commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3837120964

   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #17975:
URL: https://github.com/apache/hudi/pull/17975#discussion_r2775577328


##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java:
##########
@@ -313,10 +313,17 @@ public OffsetRange[] getNextOffsetRanges(Option<Checkpoint> lastCheckpoint, long
       } else {
         lastCheckpointStr = lastCheckpoint.isPresent() ? Option.of(lastCheckpoint.get().getCheckpointKey()) : Option.empty();
       }
+
+      long kafkaDelayCount = 0L;
+      if (lastCheckpointStr.isPresent() && !lastCheckpointStr.get().isEmpty()) {
+        kafkaDelayCount = delayOffsetCalculation(lastCheckpointStr, topicPartitions, consumer);
+      }
+      // Always emit the Kafka delay count metric (even when 0)
+      metrics.updateStreamerSourceDelayCount(METRIC_NAME_KAFKA_DELAY_COUNT, kafkaDelayCount);
+

Review Comment:
   nit: do we want to account for `else` branch below to account for `EARLIEST` and `GROUP` where the delay count should also be calculated?
   
   Another nit: if the check point string does not follow the format (`checkTopicCheckpoint(lastCheckpointStr)`), after the change it can fail the calculation.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-3850567008

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11265",
       "triggerID" : "96fe94fa330ab6dbeafc97aef3dc67352769d574",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11524",
       "triggerID" : "c9971485f7dd94badb089fed73c2e20fbdef0e81",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec4cbbc532c2b89cfd3e93981beb0e30d08b6240",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "triggerType" : "PUSH"
     }, {
       "hash" : "66d7d2b01765d8666a4f2fcb398b6b9e5fb94652",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11529",
       "triggerID" : "3837120964",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "triggerType" : "PUSH"
     }, {
       "hash" : "891ce7672d0b708edec7a1aa404d663fb803bf96",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605",
       "triggerID" : "3849580418",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "02ee843aa43f0403018cda4c729b8fa79ef9351a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ec4cbbc532c2b89cfd3e93981beb0e30d08b6240 UNKNOWN
   * 891ce7672d0b708edec7a1aa404d663fb803bf96 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11605) 
   * 02ee843aa43f0403018cda4c729b8fa79ef9351a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-4959918376

   ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/17975?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
   :white_check_mark: All modified and coverable lines are covered by tests.
   :white_check_mark: Project coverage is 44.22%. Comparing base ([`ec04479`](https://app.codecov.io/gh/apache/hudi/commit/ec044790fe71f04710472ad63e7859f1b29e3985?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`02ee843`](https://app.codecov.io/gh/apache/hudi/commit/02ee843aa43f0403018cda4c729b8fa79ef9351a?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
   :warning: Report is 1470 commits behind head on master.
   > :exclamation:  There is a different number of reports uploaded between BASE (ec04479) and HEAD (02ee843). Click for more details.
   > 
   > <details><summary>HEAD has 1 upload less than BASE</summary>
   >
   >| Flag | BASE (ec04479) | HEAD (02ee843) |
   >|------|------|------|
   >||1|0|
   ></details>
   
   <details><summary>Additional details and impacted files</summary>
   
   
   
   ```diff
   @@              Coverage Diff              @@
   ##             master   #17975       +/-   ##
   =============================================
   - Coverage     61.43%   44.22%   -17.21%     
   + Complexity    23082     8727    -14355     
   =============================================
     Files          2108     1248      -860     
     Lines        127636    65067    -62569     
     Branches      14534     7159     -7375     
   =============================================
   - Hits          78409    28778    -49631     
   + Misses        42873    33064     -9809     
   + Partials       6354     3225     -3129     
   ```
   
   | [Flag](https://app.codecov.io/gh/apache/hudi/pull/17975/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
   |---|---|---|
   | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/17975/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.22% <ø> (?)` | |
   
   Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
   [see 3325 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/17975/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
   </details>
   <details><summary> :rocket: New features to boost your workflow: </summary>
   
   - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] fix: kafka delay metrics reporting when offsets caught up [hudi]

Posted by "voonhous (via GitHub) via commits" <co...@hudi.apache.org>.
voonhous commented on PR #17975:
URL: https://github.com/apache/hudi/pull/17975#issuecomment-6700936177

   Temporarily closing this PR while we debug a GitHub settings error on master (#20471); it will be reopened shortly, no action needed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org