You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "nsivabalan (via GitHub)" <gi...@apache.org> on 2023/01/20 18:33:20 UTC
[GitHub] [hudi] nsivabalan opened a new pull request, #7720: [HUDI-5592] Fixing some of the flaky tests in CI
nsivabalan opened a new pull request, #7720:
URL: https://github.com/apache/hudi/pull/7720
### Change Logs
Recently we have more flakiness in our CI runs. So, taking a stab at fixing some of the high frequent tests.
Tests that were fixed:
TestHoodieDeltaStreamerWithMultiWriter.* (all tests)
TestHoodieClientOnMergeOnReadStorage ( testReadingMORTableWithoutBaseFile, testCompactionOnMORTable,
testLogCompactionOnMORTable, testLogCompactionOnMORTableWithoutBaseFile)
Reasoning for flakiness:
1. we generate only 10 inserts in our tests and it does not guarantee we have records for all 10 partitions.
2. in MOR table tests, due to small file handling, we end up expanding existing file group to pack both updates and inserts and hence no log files were generated. but tests expects compaction to happen after 5 commits which fails the test in such cases.
Fixes:
- HoodieTestDataGenerator was choosing random partition among list of partitions while generating insert records. Fixed that to do round robin. Also, bumped up the num of records inserted in some of the flaky tests to 100 from 10.
- Fixed respective MOR tests to disable small file handling.
### Impact
_Describe any public API or user-facing feature change or any performance impact._
### Risk level (write none, low medium or high below)
_If medium or high, explain what verification was done to mitigate the risks._
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change_
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1399426263
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519)
* ed32d0a3e267505657c4b68000e3302d065c5cd0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1398999706
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 744487a0dcbabe5d4a58bbea8d1475b0f2194d7b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1399076480
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 744487a0dcbabe5d4a58bbea8d1475b0f2194d7b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512)
* ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1398983526
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan merged PR #7720:
URL: https://github.com/apache/hudi/pull/7720
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1398817049
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 744487a0dcbabe5d4a58bbea8d1475b0f2194d7b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1399427376
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519)
* ed32d0a3e267505657c4b68000e3302d065c5cd0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan commented on code in PR #7720:
URL: https://github.com/apache/hudi/pull/7720#discussion_r1083231849
##########
hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestDataGenerator.java:
##########
@@ -607,8 +608,14 @@ public List<HoodieRecord> generateInsertsForPartition(String instantTime, Intege
}
public Stream<HoodieRecord> generateInsertsStream(String commitTime, Integer n, boolean isFlattened, String schemaStr, boolean containsAllPartitions) {
+ AtomicInteger partitionIndex = new AtomicInteger(0);
return generateInsertsStream(commitTime, n, isFlattened, schemaStr, containsAllPartitions,
- () -> partitionPaths[rand.nextInt(partitionPaths.length)],
+ () -> {
+ // round robin to ensure we generate inserts for all partition paths
+ String partitionToUse = partitionPaths[partitionIndex.get()];
+ partitionIndex.set((partitionIndex.get() + 1) % partitionPaths.length);
+ return partitionToUse;
Review Comment:
this is minor: 1) from UT perspective, 100 records shouldn't be different from 10 records. so why not keep it less. 2) we should ensure num records > num partitions without knowing there are always 3 partitions so some check arg will help prevent misuse leading to unexpected results
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1401586106
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
}, {
"hash" : "923044d84daa7967987d9b53df013e3214716f4e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "923044d84daa7967987d9b53df013e3214716f4e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ed32d0a3e267505657c4b68000e3302d065c5cd0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540)
* 923044d84daa7967987d9b53df013e3214716f4e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1405628768
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
}, {
"hash" : "923044d84daa7967987d9b53df013e3214716f4e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590",
"triggerID" : "923044d84daa7967987d9b53df013e3214716f4e",
"triggerType" : "PUSH"
}, {
"hash" : "933a98766914239c02fe950c6c15e48f1d3e6cfc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14657",
"triggerID" : "933a98766914239c02fe950c6c15e48f1d3e6cfc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 923044d84daa7967987d9b53df013e3214716f4e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590)
* 933a98766914239c02fe950c6c15e48f1d3e6cfc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14657)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1401599475
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
}, {
"hash" : "923044d84daa7967987d9b53df013e3214716f4e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590",
"triggerID" : "923044d84daa7967987d9b53df013e3214716f4e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ed32d0a3e267505657c4b68000e3302d065c5cd0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540)
* 923044d84daa7967987d9b53df013e3214716f4e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1402348746
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
}, {
"hash" : "923044d84daa7967987d9b53df013e3214716f4e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590",
"triggerID" : "923044d84daa7967987d9b53df013e3214716f4e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 923044d84daa7967987d9b53df013e3214716f4e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #7720:
URL: https://github.com/apache/hudi/pull/7720#discussion_r1083161581
##########
hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestDataGenerator.java:
##########
@@ -607,8 +608,14 @@ public List<HoodieRecord> generateInsertsForPartition(String instantTime, Intege
}
public Stream<HoodieRecord> generateInsertsStream(String commitTime, Integer n, boolean isFlattened, String schemaStr, boolean containsAllPartitions) {
+ AtomicInteger partitionIndex = new AtomicInteger(0);
return generateInsertsStream(commitTime, n, isFlattened, schemaStr, containsAllPartitions,
- () -> partitionPaths[rand.nextInt(partitionPaths.length)],
+ () -> {
+ // round robin to ensure we generate inserts for all partition paths
+ String partitionToUse = partitionPaths[partitionIndex.get()];
+ partitionIndex.set((partitionIndex.get() + 1) % partitionPaths.length);
+ return partitionToUse;
Review Comment:
yes, but I don't expect any savings from 100 to 10 records. Also most of our tests are doing 100 recs. so just to keep it in parity.
yes, we have only 3 partitions in TestDataGenerator. so, a minimum of 3 is required to ensure we generate for all 3 partitions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1399182271
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1398825477
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 744487a0dcbabe5d4a58bbea8d1475b0f2194d7b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1399079689
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 744487a0dcbabe5d4a58bbea8d1475b0f2194d7b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512)
* ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #7720:
URL: https://github.com/apache/hudi/pull/7720#discussion_r1083161581
##########
hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestDataGenerator.java:
##########
@@ -607,8 +608,14 @@ public List<HoodieRecord> generateInsertsForPartition(String instantTime, Intege
}
public Stream<HoodieRecord> generateInsertsStream(String commitTime, Integer n, boolean isFlattened, String schemaStr, boolean containsAllPartitions) {
+ AtomicInteger partitionIndex = new AtomicInteger(0);
return generateInsertsStream(commitTime, n, isFlattened, schemaStr, containsAllPartitions,
- () -> partitionPaths[rand.nextInt(partitionPaths.length)],
+ () -> {
+ // round robin to ensure we generate inserts for all partition paths
+ String partitionToUse = partitionPaths[partitionIndex.get()];
+ partitionIndex.set((partitionIndex.get() + 1) % partitionPaths.length);
+ return partitionToUse;
Review Comment:
yes, but I don't expect any savings from 100 to 10 records. Also most of our tests are doing 100 recs. so just to keep it in parity.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #7720:
URL: https://github.com/apache/hudi/pull/7720#discussion_r1083165130
##########
hudi-utilities/src/test/java/org/apache/hudi/utilities/deltastreamer/TestHoodieDeltaStreamerWithMultiWriter.java:
##########
@@ -82,6 +83,7 @@ void testUpsertsContinuousModeWithMultipleWritersForConflicts(HoodieTableType ta
tableBasePath = basePath + "/testtable_" + tableType;
prepareInitialConfigs(fs(), basePath, "foo");
TypedProperties props = prepareMultiWriterProps(fs(), basePath, propsFilePath);
+ props.setProperty(HoodieCompactionConfig.PARQUET_SMALL_FILE_LIMIT.key(), "0");
Review Comment:
yes, I did not want to boil the ocean just yet. so just focussing on most frequently failing tests. will file a jira to track other similar tests. https://issues.apache.org/jira/browse/HUDI-5595
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan commented on code in PR #7720:
URL: https://github.com/apache/hudi/pull/7720#discussion_r1083135286
##########
hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestDataGenerator.java:
##########
@@ -607,8 +608,14 @@ public List<HoodieRecord> generateInsertsForPartition(String instantTime, Intege
}
public Stream<HoodieRecord> generateInsertsStream(String commitTime, Integer n, boolean isFlattened, String schemaStr, boolean containsAllPartitions) {
+ AtomicInteger partitionIndex = new AtomicInteger(0);
return generateInsertsStream(commitTime, n, isFlattened, schemaStr, containsAllPartitions,
- () -> partitionPaths[rand.nextInt(partitionPaths.length)],
+ () -> {
+ // round robin to ensure we generate inserts for all partition paths
+ String partitionToUse = partitionPaths[partitionIndex.get()];
+ partitionIndex.set((partitionIndex.get() + 1) % partitionPaths.length);
+ return partitionToUse;
Review Comment:
so with this change we can guarantee all target partitions have records. then we don't need to bump 10 records to 100? so we can make it faster. We just need to make sure num records > num partitions here
##########
hudi-utilities/src/test/java/org/apache/hudi/utilities/deltastreamer/TestHoodieDeltaStreamerWithMultiWriter.java:
##########
@@ -82,6 +83,7 @@ void testUpsertsContinuousModeWithMultipleWritersForConflicts(HoodieTableType ta
tableBasePath = basePath + "/testtable_" + tableType;
prepareInitialConfigs(fs(), basePath, "foo");
TypedProperties props = prepareMultiWriterProps(fs(), basePath, propsFilePath);
+ props.setProperty(HoodieCompactionConfig.PARQUET_SMALL_FILE_LIMIT.key(), "0");
Review Comment:
should this be applicable to some cases in TestHoodieDeltaStreamer ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan commented on code in PR #7720:
URL: https://github.com/apache/hudi/pull/7720#discussion_r1083231849
##########
hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestDataGenerator.java:
##########
@@ -607,8 +608,14 @@ public List<HoodieRecord> generateInsertsForPartition(String instantTime, Intege
}
public Stream<HoodieRecord> generateInsertsStream(String commitTime, Integer n, boolean isFlattened, String schemaStr, boolean containsAllPartitions) {
+ AtomicInteger partitionIndex = new AtomicInteger(0);
return generateInsertsStream(commitTime, n, isFlattened, schemaStr, containsAllPartitions,
- () -> partitionPaths[rand.nextInt(partitionPaths.length)],
+ () -> {
+ // round robin to ensure we generate inserts for all partition paths
+ String partitionToUse = partitionPaths[partitionIndex.get()];
+ partitionIndex.set((partitionIndex.get() + 1) % partitionPaths.length);
+ return partitionToUse;
Review Comment:
this is minor: 1) from UT perspective, 100 records shouldn't be different from 10 records. the question is: if 10 works, why bump to 100? 2) we should ensure num records > num partitions without knowing there are always 3 partitions so some check arg will help prevent misuse leading to unexpected results
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1399456386
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ed32d0a3e267505657c4b68000e3302d065c5cd0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1405808155
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
}, {
"hash" : "923044d84daa7967987d9b53df013e3214716f4e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590",
"triggerID" : "923044d84daa7967987d9b53df013e3214716f4e",
"triggerType" : "PUSH"
}, {
"hash" : "933a98766914239c02fe950c6c15e48f1d3e6cfc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14657",
"triggerID" : "933a98766914239c02fe950c6c15e48f1d3e6cfc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 933a98766914239c02fe950c6c15e48f1d3e6cfc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14657)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1405830503
CI failed due to flaky tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7720: [HUDI-5592] Fixing some of the flaky tests in CI
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7720:
URL: https://github.com/apache/hudi/pull/7720#issuecomment-1405618526
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14509",
"triggerID" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"triggerType" : "PUSH"
}, {
"hash" : "744487a0dcbabe5d4a58bbea8d1475b0f2194d7b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14512",
"triggerID" : "1398983526",
"triggerType" : "MANUAL"
}, {
"hash" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14519",
"triggerID" : "ed1aa3cfe3d4c3efefbaa9d49e979d812d9414e3",
"triggerType" : "PUSH"
}, {
"hash" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14540",
"triggerID" : "ed32d0a3e267505657c4b68000e3302d065c5cd0",
"triggerType" : "PUSH"
}, {
"hash" : "923044d84daa7967987d9b53df013e3214716f4e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590",
"triggerID" : "923044d84daa7967987d9b53df013e3214716f4e",
"triggerType" : "PUSH"
}, {
"hash" : "933a98766914239c02fe950c6c15e48f1d3e6cfc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "933a98766914239c02fe950c6c15e48f1d3e6cfc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 923044d84daa7967987d9b53df013e3214716f4e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14590)
* 933a98766914239c02fe950c6c15e48f1d3e6cfc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org