You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/03 00:12:52 UTC
[GitHub] [hudi] nsivabalan opened a new pull request #4941: [HUDI-3544] Fixing populateMeta fields update to metadata table
nsivabalan opened a new pull request #4941:
URL: https://github.com/apache/hudi/pull/4941
## What is the purpose of the pull request
PopulateMetafields value for metadata table will never get updated once metadata table get initialized for the first time. With 0.11, we are making populate meta fields as false for metadata table which was true by default in 0.10.0. So fixing the update in this patch by re-initializing the metaclient if property value has changed.
## Brief change log
Add re-intialization of metadata table metaclient and table config if populate meta fields have changed.
## Verify this pull requests
This change added tests and can be verified as follows:
- TestHoodieBackedMetadata.testUpdationOfPopulateMetaFieldsForMetadataTable
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1058055259
thanks @codope for fixing it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057834934
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
}, {
"hash" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6495",
"triggerID" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
* 91b3cb2b024729a66fc5425f9aba51cfdea158c2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6495)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057532638
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057530660
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057832567
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
}, {
"hash" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
* 91b3cb2b024729a66fc5425f9aba51cfdea158c2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057569508
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057832567
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
}, {
"hash" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
* 91b3cb2b024729a66fc5425f9aba51cfdea158c2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057903790
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
}, {
"hash" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6495",
"triggerID" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 91b3cb2b024729a66fc5425f9aba51cfdea158c2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6495)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope merged pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
codope merged pull request #4941:
URL: https://github.com/apache/hudi/pull/4941
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057532638
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057834934
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
}, {
"hash" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6495",
"triggerID" : "91b3cb2b024729a66fc5425f9aba51cfdea158c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
* 91b3cb2b024729a66fc5425f9aba51cfdea158c2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6495)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057569508
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6483)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4941: [HUDI-3544] Fixing "populate meta fields" update to metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4941:
URL: https://github.com/apache/hudi/pull/4941#issuecomment-1057530660
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9718564c43d4b75f6021df5193df758f5464a138",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9718564c43d4b75f6021df5193df758f5464a138",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9718564c43d4b75f6021df5193df758f5464a138 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org