You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2023/01/09 18:28:52 UTC
[GitHub] [hudi] jonvex opened a new pull request, #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
jonvex opened a new pull request, #7632:
URL: https://github.com/apache/hudi/pull/7632
### Change Logs
Added configuration option `hoodie.compact.disable.for.spark.streaming` that will prevent compaction from being run during spark streaming so that compaction can be run in a different process
### Impact
Better control of resources for spark streaming
### Risk level (write none, low medium or high below)
low
### Documentation Update
Possibly need to update https://hudi.apache.org/docs/next/compaction#offline-compaction ?
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1385640144
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2d99df06bfc13b1cc293ec6dd553d5c547405864 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231)
* d40771c52302ad4a78d4e05f57ca3a7dd900ac98 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1386230596
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8dc8184d6fbafc72835bf52f85075e2a8288061e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1530012504
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 51742efb9dff6974a613d118484daeb51e016962 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1421681708
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 41283bc343940a23875776619e441a7c02dc0ab8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668)
* 3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1385776547
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d40771c52302ad4a78d4e05f57ca3a7dd900ac98 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369)
* 8dc8184d6fbafc72835bf52f85075e2a8288061e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1518705710
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8ebc90c22834e3d5f2808b8641b14d0c02d82350 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504)
* c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1526754977
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565)
* 07f5163e41234081bb0c9f9cd9885ed150487d06 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a diff in pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
YannByron commented on code in PR #7632:
URL: https://github.com/apache/hudi/pull/7632#discussion_r1066641097
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:
##########
@@ -455,6 +455,15 @@ object DataSourceWriteOptions {
+ "This could introduce the potential issue that the job is restart(`batch id` is lost) while spark checkpoint write fails, "
+ "causing spark will retry and rewrite the data.")
+ val STREAMING_DISABLE_COMPACTION: ConfigProperty[String] = ConfigProperty
Review Comment:
@jonvex
can we use the two `hoodie.compact.schedule.inline` and `hoodie.compact.inline` configs to judge whether the compaction can be disabled in streaming. so we don't have to add a new config.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1421976680
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1529792085
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 07f5163e41234081bb0c9f9cd9885ed150487d06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714)
* 51742efb9dff6974a613d118484daeb51e016962 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #7632:
URL: https://github.com/apache/hudi/pull/7632#discussion_r1179510832
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:
##########
@@ -483,6 +483,15 @@ object DataSourceWriteOptions {
+ "This could introduce the potential issue that the job is restart(`batch id` is lost) while spark checkpoint write fails, "
+ "causing spark will retry and rewrite the data.")
+ val STREAMING_DISABLE_COMPACTION: ConfigProperty[String] = ConfigProperty
+ .key("hoodie.datasource.write.streaming.disable.compaction")
+ .defaultValue("false")
+ .sinceVersion("0.13.0")
Review Comment:
lets fix the version
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1539057263
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
}, {
"hash" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946",
"triggerID" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 872829bb0a31b07bec8b18f9d1fb4549fc3d4802 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1385766203
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2d99df06bfc13b1cc293ec6dd553d5c547405864 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231)
* d40771c52302ad4a78d4e05f57ca3a7dd900ac98 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369)
* 8dc8184d6fbafc72835bf52f85075e2a8288061e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1421689373
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 41283bc343940a23875776619e441a7c02dc0ab8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668)
* 3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1517186582
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8ebc90c22834e3d5f2808b8641b14d0c02d82350 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1538555707
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
}, {
"hash" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 51742efb9dff6974a613d118484daeb51e016962 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779)
* 872829bb0a31b07bec8b18f9d1fb4549fc3d4802 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1376120121
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1502341468
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008)
* 76958d63945198a200b4644356620065ba5f54f6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1516490315
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 76958d63945198a200b4644356620065ba5f54f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235)
* 8ebc90c22834e3d5f2808b8641b14d0c02d82350 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1518709022
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8ebc90c22834e3d5f2808b8641b14d0c02d82350 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504)
* c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1378142770
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201)
* 2d99df06bfc13b1cc293ec6dd553d5c547405864 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jonvex commented on a diff in pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
jonvex commented on code in PR #7632:
URL: https://github.com/apache/hudi/pull/7632#discussion_r1066475735
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieStreamingSink.scala:
##########
@@ -117,7 +119,8 @@ class HoodieStreamingSink(sqlContext: SQLContext,
retry(retryCnt, retryIntervalMs)(
Try(
HoodieSparkSqlWriter.write(
- sqlContext, mode, updatedOptions, data, hoodieTableConfig, writeClient, Some(triggerAsyncCompactor), Some(triggerAsyncClustering),
+ sqlContext, mode, updatedOptions, data, hoodieTableConfig, writeClient,
+ if (disableCompaction) None else Some(triggerAsyncCompactor), Some(triggerAsyncClustering),
Review Comment:
I attempted a test with the following code, but it doesn't work. If you know how to trigger the streaming that would be helpful. The destPath was never even created or populated with what I have below. I do have the commands that I used for testing this pr in the jira ticket so if I can't get this to work at least we have some documentation of testing.
```
@Test
def testStructuredStreamingWithDisabledCompaction(): Unit = {
val (sourcePath, destPath) = initStreamingSourceAndDestPath("source", "dest")
// First chunk of data
val records1 = recordsToStrings(dataGen.generateInserts("000", 100)).toList
val inputDF1 = spark.read.json(spark.sparkContext.parallelize(records1, 2))
val futures = new Array[Future[Unit]](25)
val opts = commonOpts + (DataSourceWriteOptions.TABLE_TYPE.key -> HoodieTableType.MERGE_ON_READ.name()) + (DataSourceWriteOptions.STREAMING_DISABLE_COMPACTION.key -> "true" )
futures(0) = initStreamingWriteFuture(inputDF1.schema, sourcePath, destPath, opts)
for (i <- 1 to 24) {
val records = recordsToStrings(dataGen.generateUpdates(String.format("%03d", new Integer(i)), 100)).toList
val inputDF = spark.read.json(spark.sparkContext.parallelize(records, 2))
futures(i) = initStreamingWriteFuture(inputDF.schema, sourcePath, destPath, opts)
}
waitTillAtleastNCommits(fs, destPath, 25, 1000, 5)
val metaClient = HoodieTableMetaClient.builder().setConf(fs.getConf).setBasePath(destPath)
.setLoadActiveTimelineOnLoad(true).build()
assertTrue(metaClient.getActiveTimeline.getCommitTimeline.empty())
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on code in PR #7632:
URL: https://github.com/apache/hudi/pull/7632#discussion_r1072765472
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:
##########
@@ -455,6 +455,15 @@ object DataSourceWriteOptions {
+ "This could introduce the potential issue that the job is restart(`batch id` is lost) while spark checkpoint write fails, "
+ "causing spark will retry and rewrite the data.")
+ val STREAMING_DISABLE_COMPACTION: ConfigProperty[String] = ConfigProperty
Review Comment:
inline compaction does not makes sense for streaming ingestion.So, only option users have is to leverage async compaction in a separate thread or completely disable compaction w/ ingestion process and take up async compaction by a separate process altogether.
So, given this, not sure how we can deduce this. bcoz, default value for "hoodie.compact.inline" is false which means is async. Can you help me understand. def interested to see if we can avoid the new config. we also tried to follow what deltastreamer does towards this to introduce a top level config.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1516506809
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 76958d63945198a200b4644356620065ba5f54f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235)
* 8ebc90c22834e3d5f2808b8641b14d0c02d82350 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1555109783
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
}, {
"hash" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946",
"triggerID" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"triggerType" : "PUSH"
}, {
"hash" : "4963ee8c29c56fd96d9b278bde8378b066214186",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4963ee8c29c56fd96d9b278bde8378b066214186",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 872829bb0a31b07bec8b18f9d1fb4549fc3d4802 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946)
* 4963ee8c29c56fd96d9b278bde8378b066214186 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1502457676
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 76958d63945198a200b4644356620065ba5f54f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1406809427
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8dc8184d6fbafc72835bf52f85075e2a8288061e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371)
* 41283bc343940a23875776619e441a7c02dc0ab8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1376128761
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1378266838
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2d99df06bfc13b1cc293ec6dd553d5c547405864 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1406955355
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 41283bc343940a23875776619e441a7c02dc0ab8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1529798415
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 07f5163e41234081bb0c9f9cd9885ed150487d06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714)
* 51742efb9dff6974a613d118484daeb51e016962 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1555120437
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
}, {
"hash" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946",
"triggerID" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"triggerType" : "PUSH"
}, {
"hash" : "4963ee8c29c56fd96d9b278bde8378b066214186",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17224",
"triggerID" : "4963ee8c29c56fd96d9b278bde8378b066214186",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 872829bb0a31b07bec8b18f9d1fb4549fc3d4802 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946)
* 4963ee8c29c56fd96d9b278bde8378b066214186 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17224)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1526891136
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 07f5163e41234081bb0c9f9cd9885ed150487d06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1538577088
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
}, {
"hash" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946",
"triggerID" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 51742efb9dff6974a613d118484daeb51e016962 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779)
* 872829bb0a31b07bec8b18f9d1fb4549fc3d4802 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on code in PR #7632:
URL: https://github.com/apache/hudi/pull/7632#discussion_r1066307179
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##########
@@ -344,6 +351,11 @@ public Builder withInlineLogCompaction(Boolean inlineLogCompaction) {
return this;
}
+ public Builder withOfflineCompaction(Boolean useOfflineCompaction) {
Review Comment:
lets try to align the method naming w/ the var name.
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##########
@@ -67,6 +67,13 @@ public class HoodieCompactionConfig extends HoodieConfig {
.withDocumentation("When set to true, logcompaction service is triggered after each write. While being "
+ " simpler operationally, this adds extra latency on the write path.");
+ public static final ConfigProperty<String> DISABLE_ASYNC_COMPACT_FOR_SPARK_STREAMING = ConfigProperty
Review Comment:
we have other streaming configs in DataSourceOptions.
for eg
```
val STREAMING_RETRY_CNT: ConfigProperty[String] = ConfigProperty
.key("hoodie.datasource.write.streaming.retry.count")
.defaultValue("3")
.withDocumentation("Config to indicate how many times streaming job should retry for a failed micro batch.")
val STREAMING_RETRY_INTERVAL_MS: ConfigProperty[String] = ConfigProperty
.key("hoodie.datasource.write.streaming.retry.interval.ms")
.defaultValue("2000")
.withDocumentation(" Config to indicate how long (by millisecond) before a retry should issued for failed microbatch")
```
So, lets move it there and honor the prefix "hoodie.datasource.write.streaming.disable.compaction"
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##########
@@ -67,6 +67,13 @@ public class HoodieCompactionConfig extends HoodieConfig {
.withDocumentation("When set to true, logcompaction service is triggered after each write. While being "
+ " simpler operationally, this adds extra latency on the write path.");
+ public static final ConfigProperty<String> DISABLE_ASYNC_COMPACT_FOR_SPARK_STREAMING = ConfigProperty
+ .key("hoodie.compact.disable.for.spark.streaming")
+ .defaultValue("false")
+ .withDocumentation("When set to true, compaction will not run inline nor asynchronously. Compaction can take up significant resources "
Review Comment:
some word smithing
```
By default for MOR table, async compaction is enabled with spark streaming sink. By setting this config to true, we can disable it and the expectation is that, users will schedule and execute compaction in a different process/job altogether. Some users may wish to run it separately to manage resources across table services and regular ingestion pipeline and so this could be preferred on such cases."
```
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieStreamingSink.scala:
##########
@@ -117,7 +119,8 @@ class HoodieStreamingSink(sqlContext: SQLContext,
retry(retryCnt, retryIntervalMs)(
Try(
HoodieSparkSqlWriter.write(
- sqlContext, mode, updatedOptions, data, hoodieTableConfig, writeClient, Some(triggerAsyncCompactor), Some(triggerAsyncClustering),
+ sqlContext, mode, updatedOptions, data, hoodieTableConfig, writeClient,
+ if (disableCompaction) None else Some(triggerAsyncCompactor), Some(triggerAsyncClustering),
Review Comment:
Is it possible to write tests in TestStructuredStreaming to test the functionality?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1378138327
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201)
* 2d99df06bfc13b1cc293ec6dd553d5c547405864 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1385652107
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2d99df06bfc13b1cc293ec6dd553d5c547405864 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231)
* d40771c52302ad4a78d4e05f57ca3a7dd900ac98 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jonvex commented on a diff in pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by GitBox <gi...@apache.org>.
jonvex commented on code in PR #7632:
URL: https://github.com/apache/hudi/pull/7632#discussion_r1072449116
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieStreamingSink.scala:
##########
@@ -117,7 +119,8 @@ class HoodieStreamingSink(sqlContext: SQLContext,
retry(retryCnt, retryIntervalMs)(
Try(
HoodieSparkSqlWriter.write(
- sqlContext, mode, updatedOptions, data, hoodieTableConfig, writeClient, Some(triggerAsyncCompactor), Some(triggerAsyncClustering),
+ sqlContext, mode, updatedOptions, data, hoodieTableConfig, writeClient,
+ if (disableCompaction) None else Some(triggerAsyncCompactor), Some(triggerAsyncClustering),
Review Comment:
Ok. Got my test working.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1406709706
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8dc8184d6fbafc72835bf52f85075e2a8288061e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371)
* 41283bc343940a23875776619e441a7c02dc0ab8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1526671395
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565)
* 07f5163e41234081bb0c9f9cd9885ed150487d06 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1555404858
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
}, {
"hash" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16714",
"triggerID" : "07f5163e41234081bb0c9f9cd9885ed150487d06",
"triggerType" : "PUSH"
}, {
"hash" : "51742efb9dff6974a613d118484daeb51e016962",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16779",
"triggerID" : "51742efb9dff6974a613d118484daeb51e016962",
"triggerType" : "PUSH"
}, {
"hash" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16946",
"triggerID" : "872829bb0a31b07bec8b18f9d1fb4549fc3d4802",
"triggerType" : "PUSH"
}, {
"hash" : "4963ee8c29c56fd96d9b278bde8378b066214186",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17224",
"triggerID" : "4963ee8c29c56fd96d9b278bde8378b066214186",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4963ee8c29c56fd96d9b278bde8378b066214186 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17224)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan merged PR #7632:
URL: https://github.com/apache/hudi/pull/7632
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1502332281
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008)
* 76958d63945198a200b4644356620065ba5f54f6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7632: [HUDI-3775] Allow for offline compaction of MOR tables via spark streaming
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7632:
URL: https://github.com/apache/hudi/pull/7632#issuecomment-1518853726
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14201",
"triggerID" : "3ce0e4d9600b1c0f55ff6fc0dea3762635e99b1a",
"triggerType" : "PUSH"
}, {
"hash" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14231",
"triggerID" : "2d99df06bfc13b1cc293ec6dd553d5c547405864",
"triggerType" : "PUSH"
}, {
"hash" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14369",
"triggerID" : "d40771c52302ad4a78d4e05f57ca3a7dd900ac98",
"triggerType" : "PUSH"
}, {
"hash" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14371",
"triggerID" : "8dc8184d6fbafc72835bf52f85075e2a8288061e",
"triggerType" : "PUSH"
}, {
"hash" : "41283bc343940a23875776619e441a7c02dc0ab8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14668",
"triggerID" : "41283bc343940a23875776619e441a7c02dc0ab8",
"triggerType" : "PUSH"
}, {
"hash" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15008",
"triggerID" : "3e3f5e78b9ac65fd9d171cae1de0d6c01a23d3a5",
"triggerType" : "PUSH"
}, {
"hash" : "76958d63945198a200b4644356620065ba5f54f6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16235",
"triggerID" : "76958d63945198a200b4644356620065ba5f54f6",
"triggerType" : "PUSH"
}, {
"hash" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16504",
"triggerID" : "8ebc90c22834e3d5f2808b8641b14d0c02d82350",
"triggerType" : "PUSH"
}, {
"hash" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565",
"triggerID" : "c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c7fce967ece6f3cef5cb34ddc2ff7ddffa66727f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16565)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org