You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/09/21 21:45:33 UTC
[GitHub] [hudi] nsivabalan opened a new pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
nsivabalan opened a new pull request #3698:
URL: https://github.com/apache/hudi/pull/3698
## What is the purpose of the pull request
- Timeline is not refreshed before every operation. With enabling metadata, some operations could fail if not refreshed.
- Without enabling metadata, this will not be an issue since following operations anyways will list the fs to fetch values, which is not the case with metadata table.
## Brief change log
- Added refresh of timeline before every operation.
## Verify this pull request
This change added tests and can be verified as follows:
- Enabled metadata for TestHoodieSparkMergeOnReadTableInsertUpdateDelete to verify the fix. w/o the fix, the test fails.
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dce615fd3058a817e839a852dc5de8b06d518658 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414)
* 57b876e62a44a2430ba49f51de67f19f7eb5a70d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9d702ea79b9ca6b6fb9cb83a3ef99269617b204d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391)
* 80c18c266ec08a5021dcc3fba279f7fcd68b75b7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #3698:
URL: https://github.com/apache/hudi/pull/3698
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5ae4a31318654358ee31d6069eed105ca6851f33 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389)
* 9d702ea79b9ca6b6fb9cb83a3ef99269617b204d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 80c18c266ec08a5021dcc3fba279f7fcd68b75b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413)
* dce615fd3058a817e839a852dc5de8b06d518658 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
}, {
"hash" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440",
"triggerID" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"triggerType" : "PUSH"
}, {
"hash" : "88bb193962590b1aa8851893aeaf538d28a6e967",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2442",
"triggerID" : "88bb193962590b1aa8851893aeaf538d28a6e967",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c07cf243677b940fd58254e4e8f803ed3e597a12 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440)
* 88bb193962590b1aa8851893aeaf538d28a6e967 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2442)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9d702ea79b9ca6b6fb9cb83a3ef99269617b204d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78605ec9bca5f63118d4e9c93010e32d2c6f1d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306)
* 5ae4a31318654358ee31d6069eed105ca6851f33 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dce615fd3058a817e839a852dc5de8b06d518658 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414)
* 57b876e62a44a2430ba49f51de67f19f7eb5a70d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78b26aa57880cd6ea6c20d9c0fc36109e959874f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437)
* d0c4f3f59687cf74c47c3d41328264ae7d7daab9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78b26aa57880cd6ea6c20d9c0fc36109e959874f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78605ec9bca5f63118d4e9c93010e32d2c6f1d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306)
* 5ae4a31318654358ee31d6069eed105ca6851f33 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389)
* 9d702ea79b9ca6b6fb9cb83a3ef99269617b204d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78605ec9bca5f63118d4e9c93010e32d2c6f1d0a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-925784713
cc @bvaradar as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 80c18c266ec08a5021dcc3fba279f7fcd68b75b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413)
* dce615fd3058a817e839a852dc5de8b06d518658 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-928235206
@hudi-bot azure run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9d702ea79b9ca6b6fb9cb83a3ef99269617b204d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391)
* 80c18c266ec08a5021dcc3fba279f7fcd68b75b7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a change in pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#discussion_r714762403
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -318,6 +323,7 @@ protected void completeCompaction(HoodieCommitMetadata metadata, JavaRDD<WriteSt
@Override
protected JavaRDD<WriteStatus> compact(String compactionInstantTime, boolean shouldComplete) {
HoodieSparkTable<T> table = HoodieSparkTable.create(config, context);
+ table.getHoodieView().sync();
preWrite(compactionInstantTime, WriteOperationType.COMPACT, table.getMetaClient());
Review comment:
seems like something we should do always anyway. do you see any issues around how this may not work well for Flink?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-928235206
@hudi-bot azure run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78605ec9bca5f63118d4e9c93010e32d2c6f1d0a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nbalajee commented on a change in pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nbalajee commented on a change in pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#discussion_r714966071
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -318,6 +323,7 @@ protected void completeCompaction(HoodieCommitMetadata metadata, JavaRDD<WriteSt
@Override
protected JavaRDD<WriteStatus> compact(String compactionInstantTime, boolean shouldComplete) {
HoodieSparkTable<T> table = HoodieSparkTable.create(config, context);
Review comment:
should you use createTable(config, context, true) API here?
instead of create() followed by table.getHoodieView().sync();
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78605ec9bca5f63118d4e9c93010e32d2c6f1d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
}, {
"hash" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0c4f3f59687cf74c47c3d41328264ae7d7daab9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439)
* c07cf243677b940fd58254e4e8f803ed3e597a12 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dce615fd3058a817e839a852dc5de8b06d518658 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
}, {
"hash" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440",
"triggerID" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c07cf243677b940fd58254e4e8f803ed3e597a12 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924410099
@nbalajee @n3nash : Can you folks please review this. This is a blocker for synchronous metadata patch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78b26aa57880cd6ea6c20d9c0fc36109e959874f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437)
* d0c4f3f59687cf74c47c3d41328264ae7d7daab9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
}, {
"hash" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440",
"triggerID" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"triggerType" : "PUSH"
}, {
"hash" : "88bb193962590b1aa8851893aeaf538d28a6e967",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2442",
"triggerID" : "88bb193962590b1aa8851893aeaf538d28a6e967",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 88bb193962590b1aa8851893aeaf538d28a6e967 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2442)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5ae4a31318654358ee31d6069eed105ca6851f33 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389)
* 9d702ea79b9ca6b6fb9cb83a3ef99269617b204d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-927191342
@nbalajee @n3nash @bvaradar : can you folks review the patch. addressed all comments.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 57b876e62a44a2430ba49f51de67f19f7eb5a70d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434)
* 78b26aa57880cd6ea6c20d9c0fc36109e959874f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#discussion_r715744876
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -318,6 +323,7 @@ protected void completeCompaction(HoodieCommitMetadata metadata, JavaRDD<WriteSt
@Override
protected JavaRDD<WriteStatus> compact(String compactionInstantTime, boolean shouldComplete) {
HoodieSparkTable<T> table = HoodieSparkTable.create(config, context);
+ table.getHoodieView().sync();
preWrite(compactionInstantTime, WriteOperationType.COMPACT, table.getMetaClient());
Review comment:
@danny0405 : I am in need of this for [metadata sync patch](https://github.com/apache/hudi/pull/3590). If you don't mind, I will land this patch now. But we can discuss and get to a consensus. If need be, I can put up a follow patch to make it conditional.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
}, {
"hash" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440",
"triggerID" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"triggerType" : "PUSH"
}, {
"hash" : "88bb193962590b1aa8851893aeaf538d28a6e967",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "88bb193962590b1aa8851893aeaf538d28a6e967",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c07cf243677b940fd58254e4e8f803ed3e597a12 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440)
* 88bb193962590b1aa8851893aeaf538d28a6e967 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 57b876e62a44a2430ba49f51de67f19f7eb5a70d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434)
* 78b26aa57880cd6ea6c20d9c0fc36109e959874f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 78605ec9bca5f63118d4e9c93010e32d2c6f1d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306)
* 5ae4a31318654358ee31d6069eed105ca6851f33 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #3698:
URL: https://github.com/apache/hudi/pull/3698
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
}, {
"hash" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440",
"triggerID" : "c07cf243677b940fd58254e4e8f803ed3e597a12",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0c4f3f59687cf74c47c3d41328264ae7d7daab9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439)
* c07cf243677b940fd58254e4e8f803ed3e597a12 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2440)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
}, {
"hash" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2437",
"triggerID" : "78b26aa57880cd6ea6c20d9c0fc36109e959874f",
"triggerType" : "PUSH"
}, {
"hash" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439",
"triggerID" : "d0c4f3f59687cf74c47c3d41328264ae7d7daab9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0c4f3f59687cf74c47c3d41328264ae7d7daab9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 80c18c266ec08a5021dcc3fba279f7fcd68b75b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#issuecomment-924412554
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2306",
"triggerID" : "78605ec9bca5f63118d4e9c93010e32d2c6f1d0a",
"triggerType" : "PUSH"
}, {
"hash" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2389",
"triggerID" : "5ae4a31318654358ee31d6069eed105ca6851f33",
"triggerType" : "PUSH"
}, {
"hash" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2391",
"triggerID" : "9d702ea79b9ca6b6fb9cb83a3ef99269617b204d",
"triggerType" : "PUSH"
}, {
"hash" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2413",
"triggerID" : "80c18c266ec08a5021dcc3fba279f7fcd68b75b7",
"triggerType" : "PUSH"
}, {
"hash" : "dce615fd3058a817e839a852dc5de8b06d518658",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2414",
"triggerID" : "dce615fd3058a817e839a852dc5de8b06d518658",
"triggerType" : "PUSH"
}, {
"hash" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434",
"triggerID" : "57b876e62a44a2430ba49f51de67f19f7eb5a70d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 57b876e62a44a2430ba49f51de67f19f7eb5a70d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2434)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a change in pull request #3698: [HUDI-2474] Refreshing timeline for every operation in Hudi
Posted by GitBox <gi...@apache.org>.
danny0405 commented on a change in pull request #3698:
URL: https://github.com/apache/hudi/pull/3698#discussion_r713564251
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -318,6 +323,7 @@ protected void completeCompaction(HoodieCommitMetadata metadata, JavaRDD<WriteSt
@Override
protected JavaRDD<WriteStatus> compact(String compactionInstantTime, boolean shouldComplete) {
HoodieSparkTable<T> table = HoodieSparkTable.create(config, context);
+ table.getHoodieView().sync();
preWrite(compactionInstantTime, WriteOperationType.COMPACT, table.getMetaClient());
Review comment:
Is there any possibility that we only sync the view when metadata table is enabled ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org