You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/11/01 12:22:23 UTC
[GitHub] [hudi] nsivabalan opened a new pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
nsivabalan opened a new pull request #3900:
URL: https://github.com/apache/hudi/pull/3900
## What is the purpose of the pull request
- In single writer mode with metadata enabled, there are chances an async table service in data table could concurrently update metadata table along with another writer. So, this patch adds fix, where in, only regular writes from data table can trigger table services in metadata table. So, compaction, clustering, cleaning, rollback and restore in data table can't trigger table service(compaction, cleaning) in metadata table.
## Brief change log
- Update methods in HoodieTableMetadataWriter has been updated to take in an extra argument whether a caller is a table service or not.
- commit() in HoodieBackedTableMetadataWriter takes an additional argument whether to trigger table services or not. compaction, clustering, cleaning, rollback will set this arg as false while regular writes will set it to true.
## Verify this pull request
- Added test to TestHoodieBackedMetadata to test the change.
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962501435
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-963695239
@hudi-bot azure run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 972220b90912d6481234a8842e89494c2aa7d87c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962494141
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
* ded981cec883c3e6b0cee12058512a190aa7e0c8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 972220b90912d6481234a8842e89494c2aa7d87c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034)
* 1745ace2e2600f758fef7f9c065c0dba21a42589 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#discussion_r744155790
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/BaseActionExecutor.java
##########
@@ -57,7 +57,7 @@ public BaseActionExecutor(HoodieEngineContext context, HoodieWriteConfig config,
* @param metadata commit metadata of interest.
*/
protected final void writeTableMetadata(HoodieCommitMetadata metadata) {
- table.getMetadataWriter().ifPresent(w -> w.update(metadata, instantTime));
+ table.getMetadataWriter().ifPresent(w -> w.update(metadata, instantTime, false));
Review comment:
yeah, we can't assume so. will fix it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962714095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962547652
CI is failing though. FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962494141
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
* ded981cec883c3e6b0cee12058512a190aa7e0c8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a change in pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#discussion_r744197331
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##########
@@ -244,14 +245,15 @@ void emitCommitMetrics(String instantTime, HoodieCommitMetadata metadata, String
/**
* Any pre-commit actions like conflict resolution or updating metadata table goes here.
- * @param instantTime commit instant time.
+ * @param hoodieInstant hoodie instant of inflight operation.
* @param metadata commit metadata for which pre commit is being invoked.
*/
- protected void preCommit(String instantTime, HoodieCommitMetadata metadata) {
+ protected void preCommit(HoodieInstant hoodieInstant, HoodieCommitMetadata metadata) {
// Create a Hoodie table after starting the transaction which encapsulated the commits and files visible.
// Important to create this after the lock to ensure latest commits show up in the timeline without need for reload
HoodieTable table = createTable(config, hadoopConf);
- table.getMetadataWriter().ifPresent(w -> ((HoodieTableMetadataWriter)w).update(metadata, instantTime));
+ boolean isTableService = table.isTableService(hoodieInstant.getAction());
Review comment:
rename. `isTableServiceAction()`
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/BaseActionExecutor.java
##########
@@ -56,8 +56,9 @@ public BaseActionExecutor(HoodieEngineContext context, HoodieWriteConfig config,
* Writes commits metadata to table metadata.
* @param metadata commit metadata of interest.
*/
- protected final void writeTableMetadata(HoodieCommitMetadata metadata) {
- table.getMetadataWriter().ifPresent(w -> w.update(metadata, instantTime));
+ protected final void writeTableMetadata(HoodieCommitMetadata metadata, String actionType) {
+ boolean isTableService = table.isTableService(actionType);
Review comment:
fix name
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java
##########
@@ -523,23 +523,24 @@ private void initializeFileGroups(HoodieTableMetaClient dataMetaClient, Metadata
* @param instantTime instant time of interest.
* @param convertMetadataFunction converter function to convert the respective metadata to List of HoodieRecords to be written to metadata table.
* @param <T> type of commit metadata.
+ * @param canTriggerTableService true if table services can be triggered. false otherwise.
*/
- private <T> void processAndCommit(String instantTime, ConvertMetadataFunction convertMetadataFunction) {
+ private <T> void processAndCommit(String instantTime, ConvertMetadataFunction convertMetadataFunction, boolean canTriggerTableService) {
if (enabled && metadata != null) {
List<HoodieRecord> records = convertMetadataFunction.convertMetadata();
- commit(records, MetadataPartitionType.FILES.partitionPath(), instantTime);
+ commit(records, MetadataPartitionType.FILES.partitionPath(), instantTime, canTriggerTableService);
}
}
/**
* Update from {@code HoodieCommitMetadata}.
- *
* @param commitMetadata {@code HoodieCommitMetadata}
* @param instantTime Timestamp at which the commit was performed
+ * @param isTableService
Review comment:
javadoc
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -474,13 +475,14 @@ private void completeTableService(TableServiceType tableServiceType, HoodieCommi
}
@Override
- protected void preCommit(String instantTime, HoodieCommitMetadata metadata) {
+ protected void preCommit(HoodieInstant hoodieInstant, HoodieCommitMetadata metadata) {
// Create a Hoodie table after startTxn which encapsulated the commits and files visible.
// Important to create this after the lock to ensure latest commits show up in the timeline without need for reload
HoodieTable table = createTable(config, hadoopConf);
TransactionUtils.resolveWriteConflictIfAny(table, this.txnManager.getCurrentTransactionOwner(),
Option.of(metadata), config, txnManager.getLastCompletedTransactionOwner());
- table.getMetadataWriter().ifPresent(w -> ((HoodieTableMetadataWriter)w).update(metadata, instantTime));
+ boolean isTableService = table.isTableService(hoodieInstant.getAction());
Review comment:
rename do you need this variable everywhere? just call the method inline?
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -406,9 +406,10 @@ private void writeTableMetadata(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD
HoodieInstant hoodieInstant) {
try {
this.txnManager.beginTransaction(Option.of(hoodieInstant), Option.empty());
+ boolean isTableService = table.isTableService(hoodieInstant.getAction());
Review comment:
rename
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java
##########
@@ -728,6 +729,11 @@ public HoodieEngineContext getContext() {
return getMetadataWriter(Option.empty());
}
+ public boolean isTableService(String actionType) {
Review comment:
lets override this at the sub classes? so no need for table type check
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##########
@@ -244,14 +245,15 @@ void emitCommitMetrics(String instantTime, HoodieCommitMetadata metadata, String
/**
* Any pre-commit actions like conflict resolution or updating metadata table goes here.
- * @param instantTime commit instant time.
+ * @param hoodieInstant hoodie instant of inflight operation.
* @param metadata commit metadata for which pre commit is being invoked.
*/
- protected void preCommit(String instantTime, HoodieCommitMetadata metadata) {
+ protected void preCommit(HoodieInstant hoodieInstant, HoodieCommitMetadata metadata) {
// Create a Hoodie table after starting the transaction which encapsulated the commits and files visible.
// Important to create this after the lock to ensure latest commits show up in the timeline without need for reload
HoodieTable table = createTable(config, hadoopConf);
- table.getMetadataWriter().ifPresent(w -> ((HoodieTableMetadataWriter)w).update(metadata, instantTime));
+ boolean isTableService = table.isTableService(hoodieInstant.getAction());
Review comment:
and also variables
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##########
@@ -244,14 +245,15 @@ void emitCommitMetrics(String instantTime, HoodieCommitMetadata metadata, String
/**
* Any pre-commit actions like conflict resolution or updating metadata table goes here.
- * @param instantTime commit instant time.
+ * @param hoodieInstant hoodie instant of inflight operation.
Review comment:
drop "hoodie" extraneous context
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##########
@@ -244,14 +245,15 @@ void emitCommitMetrics(String instantTime, HoodieCommitMetadata metadata, String
/**
* Any pre-commit actions like conflict resolution or updating metadata table goes here.
- * @param instantTime commit instant time.
+ * @param hoodieInstant hoodie instant of inflight operation.
* @param metadata commit metadata for which pre commit is being invoked.
*/
- protected void preCommit(String instantTime, HoodieCommitMetadata metadata) {
+ protected void preCommit(HoodieInstant hoodieInstant, HoodieCommitMetadata metadata) {
Review comment:
rename: hoodieInstant -> inflightInstant?
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -474,13 +475,14 @@ private void completeTableService(TableServiceType tableServiceType, HoodieCommi
}
@Override
- protected void preCommit(String instantTime, HoodieCommitMetadata metadata) {
+ protected void preCommit(HoodieInstant hoodieInstant, HoodieCommitMetadata metadata) {
Review comment:
rename
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-963723444
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
}, {
"hash" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3232",
"triggerID" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 24471e3fbeb0b60332f44f0a9ecb72a98bfccd43 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3232)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-963696229
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
}, {
"hash" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
* 24471e3fbeb0b60332f44f0a9ecb72a98bfccd43 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956864765
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-957015285
@hudi-bot azure run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6144a546d222f7417fa039003e1e3600cc940c99 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009)
* 972220b90912d6481234a8842e89494c2aa7d87c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962704902
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962719670
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-963697518
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
}, {
"hash" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3232",
"triggerID" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
* 24471e3fbeb0b60332f44f0a9ecb72a98bfccd43 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3232)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6144a546d222f7417fa039003e1e3600cc940c99 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 972220b90912d6481234a8842e89494c2aa7d87c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034)
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962704593
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
* 593e91273c600b170ed8a24bda833071ca2a0090 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962501435
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962739557
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962494456
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6144a546d222f7417fa039003e1e3600cc940c99 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-963696229
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
}, {
"hash" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
* 24471e3fbeb0b60332f44f0a9ecb72a98bfccd43 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962713456
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962714095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962717786
@hudi-bot azure run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6144a546d222f7417fa039003e1e3600cc940c99 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6144a546d222f7417fa039003e1e3600cc940c99 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009)
* 972220b90912d6481234a8842e89494c2aa7d87c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-957358545
@hudi-bot azure run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956864765
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-963697518
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
}, {
"hash" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3232",
"triggerID" : "24471e3fbeb0b60332f44f0a9ecb72a98bfccd43",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
* 24471e3fbeb0b60332f44f0a9ecb72a98bfccd43 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3232)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #3900:
URL: https://github.com/apache/hudi/pull/3900
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962704593
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
* 593e91273c600b170ed8a24bda833071ca2a0090 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962719670
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-961588790
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956864765
@hudi-bot azure run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-961588790
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-961588790
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#discussion_r744155808
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -305,7 +305,8 @@ protected void completeCompaction(HoodieCommitMetadata metadata, JavaRDD<WriteSt
String compactionCommitTime) {
this.context.setJobStatus(this.getClass().getSimpleName(), "Collect compaction write status and commit compaction");
List<HoodieWriteStat> writeStats = writeStatuses.map(WriteStatus::getStat).collect();
- writeTableMetadata(table, metadata, new HoodieInstant(HoodieInstant.State.INFLIGHT, HoodieTimeline.COMPACTION_ACTION, compactionCommitTime));
+ writeTableMetadata(table, metadata, new HoodieInstant(HoodieInstant.State.INFLIGHT, HoodieTimeline.COMPACTION_ACTION, compactionCommitTime),
Review comment:
yes, agreed. would be simpler. will fix it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a change in pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#discussion_r743985200
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/BaseActionExecutor.java
##########
@@ -57,7 +57,7 @@ public BaseActionExecutor(HoodieEngineContext context, HoodieWriteConfig config,
* @param metadata commit metadata of interest.
*/
protected final void writeTableMetadata(HoodieCommitMetadata metadata) {
- table.getMetadataWriter().ifPresent(w -> w.update(metadata, instantTime));
+ table.getMetadataWriter().ifPresent(w -> w.update(metadata, instantTime, false));
Review comment:
hmmm. should we assume it's a table service at this level? The idea is that even if BaseActionExecutor is further extended, they don't end up scheduling this on metadata table.
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -305,7 +305,8 @@ protected void completeCompaction(HoodieCommitMetadata metadata, JavaRDD<WriteSt
String compactionCommitTime) {
this.context.setJobStatus(this.getClass().getSimpleName(), "Collect compaction write status and commit compaction");
List<HoodieWriteStat> writeStats = writeStatuses.map(WriteStatus::getStat).collect();
- writeTableMetadata(table, metadata, new HoodieInstant(HoodieInstant.State.INFLIGHT, HoodieTimeline.COMPACTION_ACTION, compactionCommitTime));
+ writeTableMetadata(table, metadata, new HoodieInstant(HoodieInstant.State.INFLIGHT, HoodieTimeline.COMPACTION_ACTION, compactionCommitTime),
Review comment:
Instead of passing a flag everywhere, can't we just limit this based on the action types and table types alone. i.e
canTriggerTableServices = true iff (table_type = `cow` && action_type in ("commit")) or (table_type = `mor` && action_type in ("deltacommit")).
won't that be simpler?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962494456
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1745ace2e2600f758fef7f9c065c0dba21a42589 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064)
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-956209542
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962713456
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962704902
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ded981cec883c3e6b0cee12058512a190aa7e0c8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185)
* 593e91273c600b170ed8a24bda833071ca2a0090 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3900: [HUDI-2595] Fixing metadata table updates such that only regular writes from data table can trigger table services in metadata table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3900:
URL: https://github.com/apache/hudi/pull/3900#issuecomment-962739557
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6144a546d222f7417fa039003e1e3600cc940c99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3009",
"triggerID" : "6144a546d222f7417fa039003e1e3600cc940c99",
"triggerType" : "PUSH"
}, {
"hash" : "972220b90912d6481234a8842e89494c2aa7d87c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3034",
"triggerID" : "972220b90912d6481234a8842e89494c2aa7d87c",
"triggerType" : "PUSH"
}, {
"hash" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3064",
"triggerID" : "1745ace2e2600f758fef7f9c065c0dba21a42589",
"triggerType" : "PUSH"
}, {
"hash" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3185",
"triggerID" : "ded981cec883c3e6b0cee12058512a190aa7e0c8",
"triggerType" : "PUSH"
}, {
"hash" : "593e91273c600b170ed8a24bda833071ca2a0090",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3196",
"triggerID" : "593e91273c600b170ed8a24bda833071ca2a0090",
"triggerType" : "PUSH"
}, {
"hash" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198",
"triggerID" : "227c9ea66dba5175e08fbf3af5de926136e2d2b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 227c9ea66dba5175e08fbf3af5de926136e2d2b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3198)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org