You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/06/29 08:53:55 UTC
[GitHub] [hudi] Samrat002 opened a new pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Samrat002 opened a new pull request #3184:
URL: https://github.com/apache/hudi/pull/3184
## What is the purpose of the pull request
*Add INSERT_OVERWRITE support to DeltaStreamer*
## Brief change log
- Added support for `INSERT_OVERWRITE` in HoodieDeltaStreamer.
- add new method `insertOverwrite` in AbstractHoodieWriteClient.
- provide implementation to the added method in `HoodieJavaWriteClient` and `SparkRDDWriteClient` which overwrites the abstract class AbstractHoodieWriteClient.
## Verify this pull request
This pull request is a trivial rework/code cleanup without any test coverage.
## Committer checklist
- [x] Has a corresponding JIRA in PR title & commit
- [x] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893)
* 9dfca3c418c07d0c6175e473dc2a4a4dc395500b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-874086074
@codope
I have added the tests for both `INSER_OVERWRITE` and `INSERT_OVERWRITE_TABLE` .
please review ^
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671607820
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -475,8 +485,8 @@ public void refreshTimeline() throws IOException {
LOG.warn("Some records failed to be merged but forcing commit since commitOnErrors set. Errors/Total="
+ totalErrorRecords + "/" + totalRecords);
}
-
- boolean success = writeClient.commit(instantTime, writeStatusRDD, Option.of(checkpointCommitMetadata));
+ String commitActionType = CommitUtils.getCommitActionType(cfg.operation, HoodieTableType.valueOf(cfg.tableType));
Review comment:
I meant to fix it in this PR itself. just one line java docs to each method. @codope : Can you coordinate w/ samrat and fix the docs.
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
:) I get it. Guess that test also needs some fixing.
Basically we wanna verify that insert_overwrite does not overwrite mismatched partitions. So, better to cover it as part of tests. If you feel, it might take lot of time to get this in, its ok. Do file a ticket. One of us from the community will follow up.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r666687674
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -449,6 +449,9 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
Review comment:
Thanks! Could you also add unit tests for the two operation types in `TestHoodieDeltaStreamer`? Specifically, we can start with insert/bulk insert and then verify for insert_overwrite, with and without partition, that the writes are successful.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (814e45c) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `16.79%`.
> The diff coverage is `n/a`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 27.30% -16.80%
+ Complexity 5157 1292 -3865
=============================================
Files 936 386 -550
Lines 41629 15343 -26286
Branches 4189 1339 -2850
=============================================
- Hits 18362 4190 -14172
+ Misses 21638 10849 -10789
+ Partials 1629 304 -1325
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <0.00%> (-13.56%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <0.00%> (-50.88%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.26% <0.00%> (+50.14%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...able/action/compact/CompactionTriggerStrategy.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RhYmxlL2FjdGlvbi9jb21wYWN0L0NvbXBhY3Rpb25UcmlnZ2VyU3RyYXRlZ3kuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [667 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...814e45c](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7acf0aa52de742a15af565ab53f8ab14e572b86a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889)
* b257edc1588b22e93386028f5a6c88c27ddbf087 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b257edc1588b22e93386028f5a6c88c27ddbf087 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891)
* b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-881168606
@vinothchandar
please review
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 7acf0aa52de742a15af565ab53f8ab14e572b86a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882560612
> Hey, can you confirm you rebased it w/ upstream master correctly? I see lot of commit msgs while trying to squash and merge?
@nsivabalan rebased it correctly there are only changes related to intended changes in the pr.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7acf0aa52de742a15af565ab53f8ab14e572b86a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889)
* b257edc1588b22e93386028f5a6c88c27ddbf087 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891)
* b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4f3a389384a1fbf0deb654caa490f3b32c3b7e41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (14ddcc5) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `29.87%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 46.16% 16.29% -29.88%
+ Complexity 5370 473 -4897
=============================================
Files 921 280 -641
Lines 39953 10877 -29076
Branches 4288 1106 -3182
=============================================
- Hits 18444 1772 -16672
+ Misses 19630 8946 -10684
+ Partials 1879 159 -1720
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `58.36% <0.00%> (-0.08%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `70.46% <0.00%> (-0.82%)` | :arrow_down: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [709 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...14ddcc5](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7acf0aa52de742a15af565ab53f8ab14e572b86a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889)
* b257edc1588b22e93386028f5a6c88c27ddbf087 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671598590
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
hi @nsivabalan ,
for the 2nd point
do we need to cover the test case here, because I see test (https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/TestHoodieClientOnCopyOnWriteStorage.java#L1227)
This test case is to check Deltastreamer when `op` is `INSERT_OVERWRITE`. Moreover, it is using the same `SparkRDDWriteClient`. I feel it would be redundant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* f6c78526f3a54ef66e501fc4d5163c3001b5b1eb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
}, {
"hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012",
"triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"triggerType" : "PUSH"
}, {
"hash" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* d055e23ffb53336e100dab0689980dcf714cd8ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012)
* d3a2190ce3fc62e1fbebb48efac1598616f79824 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 814e45c99f54bb11ed54263cc4077e0a08689b48 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921)
* 740f4390fd6dd5798d5bee5f046a258dffd9887a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d055e23) into [master](https://codecov.io/gh/apache/hudi/commit/572a2144124b90b2dbef8183ee19a95b21de2716?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (572a214) will **decrease** coverage by `45.01%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 47.83% 2.82% -45.02%
+ Complexity 5565 85 -5480
============================================
Files 936 284 -652
Lines 41663 11877 -29786
Branches 4197 986 -3211
============================================
- Hits 19929 335 -19594
+ Misses 19960 11516 -8444
+ Partials 1774 26 -1748
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.53%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-51.10%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `8.97% <0.00%> (-50.80%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-72.73%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [770 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [572a214...d055e23](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (740f439) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `30.41%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 46.16% 15.74% -30.42%
+ Complexity 5370 493 -4877
=============================================
Files 921 284 -637
Lines 39953 11839 -28114
Branches 4288 982 -3306
=============================================
- Hits 18444 1864 -16580
+ Misses 19630 9812 -9818
+ Partials 1879 163 -1716
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <ø> (-49.20%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.18% <100.00%> (+0.74%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `70.64% <100.00%> (-0.64%)` | :arrow_down: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [736 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...740f439](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b257edc1588b22e93386028f5a6c88c27ddbf087 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891)
* b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671015657
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -455,6 +459,12 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
+ writeStatusRDD = writeClient.insertOverwrite(records, instantTime).getWriteStatuses();
+ break;
+ case INSERT_OVERWRITE_TABLE:
Review comment:
Haven't thought about it.
we can definitely do it.
I will do it in the following pr.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
}, {
"hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 67a6e364db93b253692c3e257f4007c20e3cea65 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008)
* d055e23ffb53336e100dab0689980dcf714cd8ee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 69713cc326c4cbacf9d4ea4e6927588af8b1c8ce Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864)
* 7acf0aa52de742a15af565ab53f8ab14e572b86a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r668941306
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java
##########
@@ -66,11 +65,6 @@ protected Partitioner getPartitioner(WorkloadProfile profile) {
return new SparkInsertOverwritePartitioner(profile, context, table, config);
}
- @Override
- protected String getCommitActionType() {
Review comment:
@satishkotha greetings !
with reference to the function!
https://github.com/apache/hudi/blob/03668dbaf1a60428d7e0d68c6622605e0809150a/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java#L70
Why specifically we need `HoodieTimeline.REPLACE_COMMIT_ACTION` for `SparkInsertOverwriteCommitActionExecutor` ?
If you can enlighten it would be really helpful
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882512987
Hey, can you confirm you rebased it w/ upstream master correctly? I see lot of commit msgs while trying to squash and merge?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-879154991
@hudi-bot run travis
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882512987
Hey, can you confirm you rebased it w/ upstream master correctly? I see lot of commit msgs while trying to squash and merge?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 15ea5785bc8556cd17b6dc4da5cce7d542fbd896 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7c22413ebdf647e33166ccb91a16110d12599207 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-879154991
@hudi-bot run travis
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-879154991
@hudi-bot run travis
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 740f4390fd6dd5798d5bee5f046a258dffd9887a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923)
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4f3a389384a1fbf0deb654caa490f3b32c3b7e41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821)
* 53ce329dd8973ea83fdafb3e9522d62aaad9222d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826)
* d63d6c59a8ba4226acdb618452716c60b97b891c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 14ddcc5fdc8c524742e2edbec9c18e9c0b059506 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533)
* 15ea5785bc8556cd17b6dc4da5cce7d542fbd896 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r663108267
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -449,6 +449,9 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
Review comment:
Should we also handle `INSERT_OVERWRITE_TABLE` case?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* d72b47dc2abbeb4862458275ec72e4e35ccdc2f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990)
* f6c78526f3a54ef66e501fc4d5163c3001b5b1eb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (f6c7852) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `41.28%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 2.82% -41.29%
+ Complexity 5157 85 -5072
============================================
Files 936 284 -652
Lines 41629 11877 -29752
Branches 4189 986 -3203
============================================
- Hits 18362 335 -18027
+ Misses 21638 11516 -10122
+ Partials 1629 26 -1603
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `8.97% <0.00%> (-0.15%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [729 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...f6c7852](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r670990427
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -455,6 +459,12 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
+ writeStatusRDD = writeClient.insertOverwrite(records, instantTime).getWriteStatuses();
+ break;
+ case INSERT_OVERWRITE_TABLE:
Review comment:
Do we plan to add "Delete_partition" in a follow up PR? Not looking to expand the scope of this PR. just asking
##########
File path: hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/HoodieTestSuiteWriter.java
##########
@@ -163,6 +163,26 @@ private boolean allowWriteClientAccess(DagNode dagNode) {
}
}
+ public JavaRDD<WriteStatus> insertOverwrite(Option<String> instantTime) throws Exception {
Review comment:
awesome in fixing test suite as well :)
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
- I see lot of commonality between both these tests. Can we reuse code as much as possible.
- InsertOverwrite overwrites only the partitions matching the incoming records. But guess we are not really testing that. Do you think we can test this scenario.
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -475,8 +485,8 @@ public void refreshTimeline() throws IOException {
LOG.warn("Some records failed to be merged but forcing commit since commitOnErrors set. Errors/Total="
+ totalErrorRecords + "/" + totalRecords);
}
-
- boolean success = writeClient.commit(instantTime, writeStatusRDD, Option.of(checkpointCommitMetadata));
+ String commitActionType = CommitUtils.getCommitActionType(cfg.operation, HoodieTableType.valueOf(cfg.tableType));
Review comment:
Since you folks did some investigation around this, Do you think we need to improve docs on
WriteClient.startCommitWithTime(). There are two overloaded methods. may be clearly calling out when to call which one would benefit all.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r667935176
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -449,6 +449,9 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
Review comment:
@codope ,
I tried to add unit test cases, They are not passing. can you please help me with debugging what is missed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r669257559
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java
##########
@@ -66,11 +65,6 @@ protected Partitioner getPartitioner(WorkloadProfile profile) {
return new SparkInsertOverwritePartitioner(profile, context, table, config);
}
- @Override
- protected String getCommitActionType() {
Review comment:
@satishkotha greetings !
with reference to the function!
https://github.com/apache/hudi/blob/03668dbaf1a60428d7e0d68c6622605e0809150a/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java#L70
Why specifically we need `HoodieTimeline.REPLACE_COMMIT_ACTION` for `SparkInsertOverwriteCommitActionExecutor` ?
What is the intention behind it If you can enlighten it would be really helpful!
cc: @codope
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671636353
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -455,6 +459,12 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
+ writeStatusRDD = writeClient.insertOverwrite(records, instantTime).getWriteStatuses();
+ break;
+ case INSERT_OVERWRITE_TABLE:
Review comment:
created the following tasks for `delete_partition` support in deltaStreamer
https://issues.apache.org/jira/browse/HUDI-2189
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (67a6e36) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `16.56%`.
> The diff coverage is `77.77%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 27.54% -16.57%
+ Complexity 5157 1304 -3853
=============================================
Files 936 386 -550
Lines 41629 15385 -26244
Branches 4189 1343 -2846
=============================================
- Hits 18362 4238 -14124
+ Misses 21638 10842 -10796
+ Partials 1629 305 -1324
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <ø> (-13.55%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <77.77%> (+50.75%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <77.77%> (+73.41%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [671 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...67a6e36](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r669332169
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java
##########
@@ -66,11 +65,6 @@ protected Partitioner getPartitioner(WorkloadProfile profile) {
return new SparkInsertOverwritePartitioner(profile, context, table, config);
}
- @Override
- protected String getCommitActionType() {
Review comment:
This is necessary, since otherwise we use commit or deltacommit actions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (740f439) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `18.86%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 46.16% 27.30% -18.87%
+ Complexity 5370 1292 -4078
=============================================
Files 921 386 -535
Lines 39953 15347 -24606
Branches 4288 1339 -2949
=============================================
- Hits 18444 4190 -14254
+ Misses 19630 10853 -8777
+ Partials 1879 304 -1575
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <ø> (-9.56%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <ø> (-49.20%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.18% <100.00%> (+0.74%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `70.64% <100.00%> (-0.64%)` | :arrow_down: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [654 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...740f439](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4f3a389384a1fbf0deb654caa490f3b32c3b7e41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821)
* 53ce329dd8973ea83fdafb3e9522d62aaad9222d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r665838584
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -200,7 +200,8 @@ public HoodieWriteResult insertOverwrite(JavaRDD<HoodieRecord<T>> records, final
table.validateInsertSchema();
preWrite(instantTime, WriteOperationType.INSERT_OVERWRITE, table.getMetaClient());
HoodieWriteMetadata result = table.insertOverwrite(context, instantTime, records);
- return new HoodieWriteResult(postWrite(result, instantTime, table), result.getPartitionToReplaceFileIds());
+ return new HoodieWriteResult(postWrite(result, instantTime, table),
Review comment:
Would be good to avoiid unrelated cosmetic changes and do them separately :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911)
* c0063ddcc875e3e13348861ebaf21ef47126a691 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-879154991
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671635600
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
created a ticket
https://issues.apache.org/jira/browse/HUDI-2188.
I will pick this test next. It will take some more time to write it for me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c0063ddcc875e3e13348861ebaf21ef47126a691 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920)
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 814e45c99f54bb11ed54263cc4077e0a08689b48 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (cf901c6) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `41.27%`.
> The diff coverage is `n/a`.
> :exclamation: Current head cf901c6 differs from pull request most recent head 814e45c. Consider uploading reports for the commit 814e45c to get more accurate results
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 2.83% -41.28%
+ Complexity 5157 85 -5072
============================================
Files 936 284 -652
Lines 41629 11835 -29794
Branches 4189 982 -3207
============================================
- Hits 18362 335 -18027
+ Misses 21638 11474 -10164
+ Partials 1629 26 -1603
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <0.00%> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <0.00%> (-50.88%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.11% <0.00%> (ø)` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...able/action/compact/CompactionTriggerStrategy.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RhYmxlL2FjdGlvbi9jb21wYWN0L0NvbXBhY3Rpb25UcmlnZ2VyU3RyYXRlZ3kuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [721 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...814e45c](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* f6c78526f3a54ef66e501fc4d5163c3001b5b1eb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998)
* 67a6e364db93b253692c3e257f4007c20e3cea65 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 8b9d7763258e22d2bc0c40933f4a55e1080c2402 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989)
* d72b47dc2abbeb4862458275ec72e4e35ccdc2f7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 026842812197f1d47960d2df5d0d65270c49eb59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #3184:
URL: https://github.com/apache/hudi/pull/3184
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (88b4611) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **increase** coverage by `0.00%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=========================================
Coverage 44.10% 44.11%
- Complexity 5157 5158 +1
=========================================
Files 936 936
Lines 41629 41633 +4
Branches 4189 4189
=========================================
+ Hits 18362 18365 +3
- Misses 21638 21639 +1
Partials 1629 1629
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `39.97% <ø> (ø)` | |
| hudiclient | `34.46% <ø> (ø)` | |
| hudicommon | `48.71% <ø> (+0.02%)` | :arrow_up: |
| hudiflink | `59.68% <ø> (ø)` | |
| hudihadoopmr | `52.02% <ø> (ø)` | |
| hudisparkdatasource | `67.21% <ø> (ø)` | |
| hudisync | `55.73% <ø> (ø)` | |
| huditimelineservice | `64.07% <ø> (ø)` | |
| hudiutilities | `9.10% <0.00%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [...ache/hudi/common/fs/inline/InMemoryFileSystem.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2ZzL2lubGluZS9Jbk1lbW9yeUZpbGVTeXN0ZW0uamF2YQ==) | `89.65% <0.00%> (+10.34%)` | :arrow_up: |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...88b4611](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
}, {
"hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012",
"triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 67a6e364db93b253692c3e257f4007c20e3cea65 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008)
* d055e23ffb53336e100dab0689980dcf714cd8ee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882128823
thanks, I guess it would be easier w/ writeClient test, but w/ delta streamer it might be hard to get this done. Anyways, will land this in.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #3184:
URL: https://github.com/apache/hudi/pull/3184
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 14ddcc5fdc8c524742e2edbec9c18e9c0b059506 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 740f4390fd6dd5798d5bee5f046a258dffd9887a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671636759
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -475,8 +485,8 @@ public void refreshTimeline() throws IOException {
LOG.warn("Some records failed to be merged but forcing commit since commitOnErrors set. Errors/Total="
+ totalErrorRecords + "/" + totalRecords);
}
-
- boolean success = writeClient.commit(instantTime, writeStatusRDD, Option.of(checkpointCommitMetadata));
+ String commitActionType = CommitUtils.getCommitActionType(cfg.operation, HoodieTableType.valueOf(cfg.tableType));
Review comment:
added the usage doc as per my understanding, please check if it needs improvement
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d3a2190) into [master](https://codecov.io/gh/apache/hudi/commit/2099bf41db76e9a6e946aa41c318b7c0e18be04d?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (2099bf4) will **decrease** coverage by `20.29%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 47.84% 27.54% -20.30%
+ Complexity 5564 1304 -4260
=============================================
Files 936 386 -550
Lines 41652 15385 -26267
Branches 4195 1343 -2852
=============================================
- Hits 19928 4238 -15690
+ Misses 19952 10842 -9110
+ Partials 1772 305 -1467
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <ø> (-13.61%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-51.10%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <100.00%> (+0.10%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <100.00%> (+0.69%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [620 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [2099bf4...d3a2190](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-876087554
@codope please let me know when you have reviewed again
@nsivabalan can then make a final pass to land.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r668941306
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java
##########
@@ -66,11 +65,6 @@ protected Partitioner getPartitioner(WorkloadProfile profile) {
return new SparkInsertOverwritePartitioner(profile, context, table, config);
}
- @Override
- protected String getCommitActionType() {
Review comment:
@satishkotha greetings !
with reference to the function!
https://github.com/apache/hudi/blob/03668dbaf1a60428d7e0d68c6622605e0809150a/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java#L70
Why specifically we need `HoodieTimeline.REPLACE_COMMIT_ACTION` for `SparkInsertOverwriteCommitActionExecutor` ?
If you can enlighten it would be really helpful
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 14ddcc5fdc8c524742e2edbec9c18e9c0b059506 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 14ddcc5fdc8c524742e2edbec9c18e9c0b059506 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533)
* 15ea5785bc8556cd17b6dc4da5cce7d542fbd896 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-879154991
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882512987
Hey, can you confirm you rebased it w/ upstream master correctly? I see lot of commit msgs while trying to squash and merge?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 026842812197f1d47960d2df5d0d65270c49eb59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833)
* 7c22413ebdf647e33166ccb91a16110d12599207 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* d72b47dc2abbeb4862458275ec72e4e35ccdc2f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990)
* f6c78526f3a54ef66e501fc4d5163c3001b5b1eb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671635600
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
created a ticket
https://issues.apache.org/jira/browse/HUDI-2188
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r669487932
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java
##########
@@ -66,11 +65,6 @@ protected Partitioner getPartitioner(WorkloadProfile profile) {
return new SparkInsertOverwritePartitioner(profile, context, table, config);
}
- @Override
- protected String getCommitActionType() {
Review comment:
@vinothchandar,
I wasn't able to get it properly, If you explain a bit more elaborately! i can make change accordingly
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 55947cfd5db5815a1030141ab69a15b9e1e96686 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 88b4611172dc71243ca6c6bdca61e89b86b8120d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930)
* 55947cfd5db5815a1030141ab69a15b9e1e96686 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r663325011
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -449,6 +449,9 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
Review comment:
added insert_overwrite_table case .
Also added `hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/dag/nodes/InsertOverwriteTableNode.java` for test
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893)
* 9dfca3c418c07d0c6175e473dc2a4a4dc395500b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907)
* f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
}, {
"hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012",
"triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"triggerType" : "PUSH"
}, {
"hash" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1019",
"triggerID" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* d055e23ffb53336e100dab0689980dcf714cd8ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012)
* d3a2190ce3fc62e1fbebb48efac1598616f79824 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1019)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882560612
> Hey, can you confirm you rebased it w/ upstream master correctly? I see lot of commit msgs while trying to squash and merge?
@nsivabalan rebased it correctly there are only changes related to intended changes in the pr.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671635600
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
created a ticket
https://issues.apache.org/jira/browse/HUDI-2188.
I will pick this test next. It will take me some time to write it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870412402
Update :- Working on writing the tests for insert_overwrite .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r666654583
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -200,7 +200,8 @@ public HoodieWriteResult insertOverwrite(JavaRDD<HoodieRecord<T>> records, final
table.validateInsertSchema();
preWrite(instantTime, WriteOperationType.INSERT_OVERWRITE, table.getMetaClient());
HoodieWriteMetadata result = table.insertOverwrite(context, instantTime, records);
- return new HoodieWriteResult(postWrite(result, instantTime, table), result.getPartitionToReplaceFileIds());
+ return new HoodieWriteResult(postWrite(result, instantTime, table),
Review comment:
reverted the cosmetic changes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (15ea578) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `43.27%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 46.16% 2.89% -43.28%
+ Complexity 5370 82 -5288
============================================
Files 921 280 -641
Lines 39953 11550 -28403
Branches 4288 945 -3343
============================================
- Hits 18444 334 -18110
+ Misses 19630 11190 -8440
+ Partials 1879 26 -1853
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.30% <0.00%> (-49.14%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-71.29%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/utilities/sources/ParquetDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUGFycXVldERGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [763 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...15ea578](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d63d6c59a8ba4226acdb618452716c60b97b891c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ce329dd8973ea83fdafb3e9522d62aaad9222d Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826)
* d63d6c59a8ba4226acdb618452716c60b97b891c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 740f4390fd6dd5798d5bee5f046a258dffd9887a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923)
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 88b4611172dc71243ca6c6bdca61e89b86b8120d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893)
* 9dfca3c418c07d0c6175e473dc2a4a4dc395500b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911)
* c0063ddcc875e3e13348861ebaf21ef47126a691 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #3184:
URL: https://github.com/apache/hudi/pull/3184
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
}, {
"hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* f6c78526f3a54ef66e501fc4d5163c3001b5b1eb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998)
* 67a6e364db93b253692c3e257f4007c20e3cea65 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008)
* d055e23ffb53336e100dab0689980dcf714cd8ee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 69713cc326c4cbacf9d4ea4e6927588af8b1c8ce Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864)
* 7acf0aa52de742a15af565ab53f8ab14e572b86a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (88b4611) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `4.21%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 39.88% -4.22%
+ Complexity 5157 4468 -689
============================================
Files 936 856 -80
Lines 41629 37173 -4456
Branches 4189 3501 -688
============================================
- Hits 18362 14828 -3534
+ Misses 21638 21229 -409
+ Partials 1629 1116 -513
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `39.97% <ø> (ø)` | |
| hudiclient | `34.46% <ø> (ø)` | |
| hudicommon | `48.71% <ø> (+0.02%)` | :arrow_up: |
| hudiflink | `59.68% <ø> (ø)` | |
| hudihadoopmr | `52.02% <ø> (ø)` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <ø> (-50.88%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.10% <0.00%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...main/java/org/apache/hudi/hive/HiveSyncConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN5bmNDb25maWcuamF2YQ==) | `0.00% <0.00%> (-98.25%)` | :arrow_down: |
| [...he/hudi/hive/replication/GlobalHiveSyncConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvcmVwbGljYXRpb24vR2xvYmFsSGl2ZVN5bmNDb25maWcuamF2YQ==) | `0.00% <0.00%> (-95.00%)` | :arrow_down: |
| [.../apache/hudi/hive/MultiPartKeysValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTXVsdGlQYXJ0S2V5c1ZhbHVlRXh0cmFjdG9yLmphdmE=) | `0.00% <0.00%> (-90.91%)` | :arrow_down: |
| [...in/java/org/apache/hudi/hive/SchemaDifference.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvU2NoZW1hRGlmZmVyZW5jZS5qYXZh) | `0.00% <0.00%> (-84.85%)` | :arrow_down: |
| [...he/hudi/hive/replication/ReplicationStateSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvcmVwbGljYXRpb24vUmVwbGljYXRpb25TdGF0ZVN5bmMuamF2YQ==) | `0.00% <0.00%> (-80.77%)` | :arrow_down: |
| [...c/main/java/org/apache/hudi/hive/HiveSyncTool.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN5bmNUb29sLmphdmE=) | `0.00% <0.00%> (-77.85%)` | :arrow_down: |
| [...in/java/org/apache/hudi/hive/util/ConfigUtils.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvdXRpbC9Db25maWdVdGlscy5qYXZh) | `0.00% <0.00%> (-73.92%)` | :arrow_down: |
| ... and [91 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...88b4611](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r666654583
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -200,7 +200,8 @@ public HoodieWriteResult insertOverwrite(JavaRDD<HoodieRecord<T>> records, final
table.validateInsertSchema();
preWrite(instantTime, WriteOperationType.INSERT_OVERWRITE, table.getMetaClient());
HoodieWriteMetadata result = table.insertOverwrite(context, instantTime, records);
- return new HoodieWriteResult(postWrite(result, instantTime, table), result.getPartitionToReplaceFileIds());
+ return new HoodieWriteResult(postWrite(result, instantTime, table),
Review comment:
I used the plugin to adhere to code style, which might have caused it. I will change it back to the previous state
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c0063ddcc875e3e13348861ebaf21ef47126a691 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920)
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 814e45c99f54bb11ed54263cc4077e0a08689b48 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (15ea578) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `18.85%`.
> The diff coverage is `50.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 46.16% 27.31% -18.86%
+ Complexity 5370 1266 -4104
=============================================
Files 921 376 -545
Lines 39953 15007 -24946
Branches 4288 1297 -2991
=============================================
- Hits 18444 4099 -14345
+ Misses 19630 10612 -9018
+ Partials 1879 296 -1583
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `21.06% <100.00%> (-9.41%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `57.91% <25.00%> (-0.53%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `69.89% <25.00%> (-1.39%)` | :arrow_down: |
| [...va/org/apache/hudi/client/SparkRDDWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY2xpZW50L1NwYXJrUkREV3JpdGVDbGllbnQuamF2YQ==) | `72.19% <100.00%> (+0.13%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [627 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...15ea578](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (55947cf) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **increase** coverage by `3.69%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
+ Coverage 44.10% 47.80% +3.69%
- Complexity 5157 5570 +413
============================================
Files 936 936
Lines 41629 41632 +3
Branches 4189 4188 -1
============================================
+ Hits 18362 19903 +1541
+ Misses 21638 19960 -1678
- Partials 1629 1769 +140
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `39.97% <ø> (ø)` | |
| hudiclient | `34.46% <ø> (ø)` | |
| hudicommon | `48.67% <ø> (-0.02%)` | :arrow_down: |
| hudiflink | `59.68% <ø> (ø)` | |
| hudihadoopmr | `52.02% <ø> (ø)` | |
| hudisparkdatasource | `67.35% <ø> (+0.13%)` | :arrow_up: |
| hudisync | `55.97% <ø> (+0.24%)` | :arrow_up: |
| huditimelineservice | `64.07% <ø> (ø)` | |
| hudiutilities | `59.37% <100.00%> (+50.25%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `72.29% <100.00%> (+72.29%)` | :arrow_up: |
| [...e/hudi/common/table/log/HoodieLogFormatWriter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGb3JtYXRXcml0ZXIuamF2YQ==) | `78.12% <0.00%> (-1.57%)` | :arrow_down: |
| [...c/main/java/org/apache/hudi/hive/HiveSyncTool.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN5bmNUb29sLmphdmE=) | `78.12% <0.00%> (+0.27%)` | :arrow_up: |
| [...in/scala/org/apache/hudi/HoodieStreamingSink.scala](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVN0cmVhbWluZ1Npbmsuc2NhbGE=) | `32.00% <0.00%> (+4.00%)` | :arrow_up: |
| [.../apache/hudi/utilities/HoodieSnapshotExporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVNuYXBzaG90RXhwb3J0ZXIuamF2YQ==) | `88.79% <0.00%> (+5.17%)` | :arrow_up: |
| [...ache/hudi/hive/replication/GlobalHiveSyncTool.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvcmVwbGljYXRpb24vR2xvYmFsSGl2ZVN5bmNUb29sLmphdmE=) | `70.96% <0.00%> (+10.44%)` | :arrow_up: |
| [...e/hudi/utilities/transform/ChainedTransformer.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3RyYW5zZm9ybS9DaGFpbmVkVHJhbnNmb3JtZXIuamF2YQ==) | `100.00% <0.00%> (+11.11%)` | :arrow_up: |
| [...g/apache/hudi/utilities/schema/SchemaProvider.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFQcm92aWRlci5qYXZh) | `71.42% <0.00%> (+14.28%)` | :arrow_up: |
| [...g/apache/hudi/utilities/HiveIncrementalPuller.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hpdmVJbmNyZW1lbnRhbFB1bGxlci5qYXZh) | `14.64% <0.00%> (+14.64%)` | :arrow_up: |
| [...in/java/org/apache/hudi/utilities/UtilHelpers.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL1V0aWxIZWxwZXJzLmphdmE=) | `68.02% <0.00%> (+33.72%)` | :arrow_up: |
| ... and [43 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...55947cf](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 026842812197f1d47960d2df5d0d65270c49eb59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833)
* 7c22413ebdf647e33166ccb91a16110d12599207 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911)
* c0063ddcc875e3e13348861ebaf21ef47126a691 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920)
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4f3a389384a1fbf0deb654caa490f3b32c3b7e41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821)
* 53ce329dd8973ea83fdafb3e9522d62aaad9222d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (814e45c) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `41.27%`.
> The diff coverage is `n/a`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 2.83% -41.28%
+ Complexity 5157 85 -5072
============================================
Files 936 284 -652
Lines 41629 11835 -29794
Branches 4189 982 -3207
============================================
- Hits 18362 335 -18027
+ Misses 21638 11474 -10164
+ Partials 1629 26 -1603
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <0.00%> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <0.00%> (-50.88%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.11% <0.00%> (ø)` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...able/action/compact/CompactionTriggerStrategy.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RhYmxlL2FjdGlvbi9jb21wYWN0L0NvbXBhY3Rpb25UcmlnZ2VyU3RyYXRlZ3kuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [721 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...814e45c](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (814e45c) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `28.35%`.
> The diff coverage is `n/a`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 15.74% -28.36%
+ Complexity 5157 493 -4664
=============================================
Files 936 284 -652
Lines 41629 11835 -29794
Branches 4189 982 -3207
=============================================
- Hits 18362 1864 -16498
+ Misses 21638 9808 -11830
+ Partials 1629 163 -1466
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <0.00%> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <0.00%> (-50.88%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.26% <0.00%> (+50.14%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...able/action/compact/CompactionTriggerStrategy.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RhYmxlL2FjdGlvbi9jb21wYWN0L0NvbXBhY3Rpb25UcmlnZ2VyU3RyYXRlZ3kuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [769 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...814e45c](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d63d6c59a8ba4226acdb618452716c60b97b891c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828)
* 026842812197f1d47960d2df5d0d65270c49eb59 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671598590
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
hi @nsivabalan ,
for the 2nd point
do we need to cover the test case here, because I see test (https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/TestHoodieClientOnCopyOnWriteStorage.java#L1227)
This test case is to check Deltastreamer when `op` is `INSERT_OVERWRITE`. Moreover using the same `SparkRDDWriteClient`. I feel it would be redundant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671598590
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
hi @nsivabalan ,
for the 2nd point
do we need to cover the test senerio here, because I see test (https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/TestHoodieClientOnCopyOnWriteStorage.java#L1227)
This test case is to check Deltastreamer when `op` is `INSERT_OVERWRITE`. Moreover, it is using the same `SparkRDDWriteClient`.
please suggest if m looking at the correct test!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d63d6c59a8ba4226acdb618452716c60b97b891c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828)
* 026842812197f1d47960d2df5d0d65270c49eb59 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r666687005
##########
File path: hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/HoodieDeltaStreamerWrapper.java
##########
@@ -53,14 +54,37 @@ public HoodieDeltaStreamerWrapper(Config cfg, JavaSparkContext jssc) throws Exce
return upsert(WriteOperationType.BULK_INSERT);
}
+ public JavaRDD<WriteStatus> insertOverwrite() throws
+ Exception {
+ return insertOverwrite(WriteOperationType.INSERT_OVERWRITE);
+ }
+
+ public JavaRDD<WriteStatus> insertOverwrite(WriteOperationType operation) throws Exception {
+ cfg.operation = operation;
+ return deltaSyncService.get().getDeltaSync().syncOnce().getRight();
+ }
+
+ public JavaRDD<WriteStatus> insertOverwriteTable() throws
+ Exception {
+ return insertOverwriteTable(WriteOperationType.INSERT_OVERWRITE_TABLE);
+ }
+
+ public JavaRDD<WriteStatus> insertOverwriteTable(WriteOperationType operation) throws
Review comment:
Instead of new method, can we not reuse `insertOverwrite()` method in line 62? Note that these wrapper methods are only used for integration test suite.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* f6c78526f3a54ef66e501fc4d5163c3001b5b1eb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998)
* 67a6e364db93b253692c3e257f4007c20e3cea65 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671636353
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -455,6 +459,12 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
+ writeStatusRDD = writeClient.insertOverwrite(records, instantTime).getWriteStatuses();
+ break;
+ case INSERT_OVERWRITE_TABLE:
Review comment:
created tasks for `delete_partition` support in deltaStreamer
https://issues.apache.org/jira/browse/HUDI-2189
I will work on it next .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882245385
@nsivabalan
FYI ,
Two follow up tickets I have started working
- created tasks for delete_partition support in deltaStreamer
https://issues.apache.org/jira/browse/HUDI-2189
- will write the test for the `writeClient`
https://issues.apache.org/jira/browse/HUDI-2188
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 14ddcc5fdc8c524742e2edbec9c18e9c0b059506 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 55947cfd5db5815a1030141ab69a15b9e1e96686 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951)
* 8b9d7763258e22d2bc0c40933f4a55e1080c2402 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989)
* d72b47dc2abbeb4862458275ec72e4e35ccdc2f7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r670925854
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -449,6 +449,9 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
Review comment:
Thank you @codope for your help in debugging and pointing out the missing parts in `DeltaSync` :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870412402
Update :- Working on writing the tests for insert_overwrite .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 15ea5785bc8556cd17b6dc4da5cce7d542fbd896 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682)
* 4f3a389384a1fbf0deb654caa490f3b32c3b7e41 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 15ea5785bc8556cd17b6dc4da5cce7d542fbd896 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682)
* 4f3a389384a1fbf0deb654caa490f3b32c3b7e41 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 15ea5785bc8556cd17b6dc4da5cce7d542fbd896 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9dfca3c418c07d0c6175e473dc2a4a4dc395500b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907)
* f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 69713cc326c4cbacf9d4ea4e6927588af8b1c8ce Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864)
* 7acf0aa52de742a15af565ab53f8ab14e572b86a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter commented on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (14ddcc5) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `43.09%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 46.16% 3.07% -43.10%
+ Complexity 5370 82 -5288
============================================
Files 921 280 -641
Lines 39953 10877 -29076
Branches 4288 1106 -3182
============================================
- Hits 18444 334 -18110
+ Misses 19630 10517 -9113
+ Partials 1879 26 -1853
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.45% <0.00%> (-48.99%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-71.29%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/utilities/sources/ParquetDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUGFycXVldERGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [755 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...14ddcc5](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-881202427
Can you fix "How did you verify the Pull Request" section in the desc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-873419073
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d3a2190) into [master](https://codecov.io/gh/apache/hudi/commit/2099bf41db76e9a6e946aa41c318b7c0e18be04d?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (2099bf4) will **decrease** coverage by `0.17%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 47.84% 47.67% -0.18%
+ Complexity 5564 5504 -60
============================================
Files 936 930 -6
Lines 41652 41209 -443
Branches 4195 4171 -24
============================================
- Hits 19928 19645 -283
+ Misses 19952 19810 -142
+ Partials 1772 1754 -18
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `39.97% <ø> (ø)` | |
| hudiclient | `34.52% <ø> (ø)` | |
| hudicommon | `48.67% <ø> (-0.02%)` | :arrow_down: |
| hudiflink | `59.44% <ø> (ø)` | |
| hudihadoopmr | `52.02% <ø> (ø)` | |
| hudisparkdatasource | `67.27% <ø> (ø)` | |
| hudisync | `55.97% <ø> (ø)` | |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <100.00%> (+0.10%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [.../java/org/apache/hudi/common/util/CommitUtils.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvQ29tbWl0VXRpbHMuamF2YQ==) | `40.47% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <100.00%> (+0.69%)` | :arrow_up: |
| [...e/hudi/common/table/log/HoodieLogFormatWriter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGb3JtYXRXcml0ZXIuamF2YQ==) | `78.12% <0.00%> (-1.57%)` | :arrow_down: |
| [...di/timeline/service/handlers/FileSliceHandler.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS10aW1lbGluZS1zZXJ2aWNlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RpbWVsaW5lL3NlcnZpY2UvaGFuZGxlcnMvRmlsZVNsaWNlSGFuZGxlci5qYXZh) | | |
| [...udi/timeline/service/handlers/BaseFileHandler.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS10aW1lbGluZS1zZXJ2aWNlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RpbWVsaW5lL3NlcnZpY2UvaGFuZGxlcnMvQmFzZUZpbGVIYW5kbGVyLmphdmE=) | | |
| [.../apache/hudi/timeline/service/TimelineService.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS10aW1lbGluZS1zZXJ2aWNlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RpbWVsaW5lL3NlcnZpY2UvVGltZWxpbmVTZXJ2aWNlLmphdmE=) | | |
| [...g/apache/hudi/timeline/service/RequestHandler.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS10aW1lbGluZS1zZXJ2aWNlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RpbWVsaW5lL3NlcnZpY2UvUmVxdWVzdEhhbmRsZXIuamF2YQ==) | | |
| [...apache/hudi/timeline/service/handlers/Handler.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS10aW1lbGluZS1zZXJ2aWNlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RpbWVsaW5lL3NlcnZpY2UvaGFuZGxlcnMvSGFuZGxlci5qYXZh) | | |
| [...udi/timeline/service/handlers/TimelineHandler.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS10aW1lbGluZS1zZXJ2aWNlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RpbWVsaW5lL3NlcnZpY2UvaGFuZGxlcnMvVGltZWxpbmVIYW5kbGVyLmphdmE=) | | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [2099bf4...d3a2190](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (740f439) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **increase** coverage by `1.61%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
+ Coverage 46.16% 47.77% +1.61%
- Complexity 5370 5565 +195
============================================
Files 921 936 +15
Lines 39953 41633 +1680
Branches 4288 4189 -99
============================================
+ Hits 18444 19891 +1447
- Misses 19630 19976 +346
+ Partials 1879 1766 -113
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `39.97% <ø> (+0.01%)` | :arrow_up: |
| hudiclient | `34.46% <ø> (+4.00%)` | :arrow_up: |
| hudicommon | `48.69% <ø> (+1.10%)` | :arrow_up: |
| hudiflink | `59.68% <ø> (-0.18%)` | :arrow_down: |
| hudihadoopmr | `52.02% <ø> (+0.73%)` | :arrow_up: |
| hudisparkdatasource | `67.21% <ø> (+0.15%)` | :arrow_up: |
| hudisync | `55.73% <ø> (+1.68%)` | :arrow_up: |
| huditimelineservice | `64.07% <ø> (-0.29%)` | :arrow_down: |
| hudiutilities | `59.18% <100.00%> (+0.74%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `70.64% <100.00%> (-0.64%)` | :arrow_down: |
| [...e/hudi/common/util/collection/RocksDBBasedMap.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvY29sbGVjdGlvbi9Sb2Nrc0RCQmFzZWRNYXAuamF2YQ==) | `0.00% <0.00%> (-39.29%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `63.63% <0.00%> (-36.37%)` | :arrow_down: |
| [...n/java/org/apache/hudi/index/SparkHoodieIndex.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW5kZXgvU3BhcmtIb29kaWVJbmRleC5qYXZh) | `56.52% <0.00%> (-30.15%)` | :arrow_down: |
| [...ion/cluster/SparkClusteringPlanActionExecutor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdGFibGUvYWN0aW9uL2NsdXN0ZXIvU3BhcmtDbHVzdGVyaW5nUGxhbkFjdGlvbkV4ZWN1dG9yLmphdmE=) | `60.00% <0.00%> (-15.00%)` | :arrow_down: |
| [.../keygen/factory/HoodieAvroKeyGeneratorFactory.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9mYWN0b3J5L0hvb2RpZUF2cm9LZXlHZW5lcmF0b3JGYWN0b3J5LmphdmE=) | `71.42% <0.00%> (-10.93%)` | :arrow_down: |
| [...keygen/factory/HoodieSparkKeyGeneratorFactory.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkva2V5Z2VuL2ZhY3RvcnkvSG9vZGllU3BhcmtLZXlHZW5lcmF0b3JGYWN0b3J5LmphdmE=) | `71.42% <0.00%> (-10.93%)` | :arrow_down: |
| [...ache/hudi/common/fs/inline/InMemoryFileSystem.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2ZzL2lubGluZS9Jbk1lbW9yeUZpbGVTeXN0ZW0uamF2YQ==) | `79.31% <0.00%> (-10.35%)` | :arrow_down: |
| [...java/org/apache/hudi/table/HoodieTableFactory.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS90YWJsZS9Ib29kaWVUYWJsZUZhY3RvcnkuamF2YQ==) | `84.61% <0.00%> (-7.06%)` | :arrow_down: |
| [...in/scala/org/apache/hudi/IncrementalRelation.scala](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9odWRpL0luY3JlbWVudGFsUmVsYXRpb24uc2NhbGE=) | `76.13% <0.00%> (-5.69%)` | :arrow_down: |
| ... and [150 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...740f439](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (8b9d776) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **increase** coverage by `3.73%`.
> The diff coverage is `77.77%`.
> :exclamation: Current head 8b9d776 differs from pull request most recent head d72b47d. Consider uploading reports for the commit d72b47d to get more accurate results
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
+ Coverage 44.10% 47.84% +3.73%
- Complexity 5157 5567 +410
============================================
Files 936 936
Lines 41629 41671 +42
Branches 4189 4197 +8
============================================
+ Hits 18362 19939 +1577
+ Misses 21638 19958 -1680
- Partials 1629 1774 +145
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `39.97% <ø> (ø)` | |
| hudiclient | `34.52% <ø> (+0.05%)` | :arrow_up: |
| hudicommon | `48.67% <ø> (-0.02%)` | :arrow_down: |
| hudiflink | `59.36% <ø> (-0.33%)` | :arrow_down: |
| hudihadoopmr | `52.02% <ø> (ø)` | |
| hudisparkdatasource | `67.33% <ø> (+0.11%)` | :arrow_up: |
| hudisync | `55.97% <ø> (+0.24%)` | :arrow_up: |
| huditimelineservice | `64.07% <ø> (ø)` | |
| hudiutilities | `59.87% <77.77%> (+50.75%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <77.77%> (+73.41%)` | :arrow_up: |
| [...va/org/apache/hudi/sink/utils/PayloadCreation.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS9zaW5rL3V0aWxzL1BheWxvYWRDcmVhdGlvbi5qYXZh) | `60.86% <0.00%> (-21.74%)` | :arrow_down: |
| [...he/hudi/sink/partitioner/BucketAssignFunction.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS9zaW5rL3BhcnRpdGlvbmVyL0J1Y2tldEFzc2lnbkZ1bmN0aW9uLmphdmE=) | `80.00% <0.00%> (-2.96%)` | :arrow_down: |
| [...ala/org/apache/spark/sql/hudi/HoodieSqlUtils.scala](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9Ib29kaWVTcWxVdGlscy5zY2FsYQ==) | `66.12% <0.00%> (-2.30%)` | :arrow_down: |
| [...e/hudi/common/table/log/HoodieLogFormatWriter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGb3JtYXRXcml0ZXIuamF2YQ==) | `78.12% <0.00%> (-1.57%)` | :arrow_down: |
| [...java/org/apache/hudi/sink/StreamWriteFunction.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS9zaW5rL1N0cmVhbVdyaXRlRnVuY3Rpb24uamF2YQ==) | `80.48% <0.00%> (-0.82%)` | :arrow_down: |
| [...g/apache/hudi/sink/partitioner/BucketAssigner.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS9zaW5rL3BhcnRpdGlvbmVyL0J1Y2tldEFzc2lnbmVyLmphdmE=) | `82.97% <0.00%> (-0.36%)` | :arrow_down: |
| [...in/java/org/apache/hudi/table/HoodieTableSink.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS90YWJsZS9Ib29kaWVUYWJsZVNpbmsuamF2YQ==) | `10.00% <0.00%> (-0.35%)` | :arrow_down: |
| [...va/org/apache/hudi/configuration/FlinkOptions.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS9jb25maWd1cmF0aW9uL0ZsaW5rT3B0aW9ucy5qYXZh) | `96.52% <0.00%> (-0.05%)` | :arrow_down: |
| ... and [65 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...d72b47d](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
}, {
"hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012",
"triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"triggerType" : "PUSH"
}, {
"hash" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1019",
"triggerID" : "d3a2190ce3fc62e1fbebb48efac1598616f79824",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* d3a2190ce3fc62e1fbebb48efac1598616f79824 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1019)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (8b9d776) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `41.28%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 2.82% -41.29%
+ Complexity 5157 85 -5072
============================================
Files 936 284 -652
Lines 41629 11877 -29752
Branches 4189 986 -3203
============================================
- Hits 18362 335 -18027
+ Misses 21638 11516 -10122
+ Partials 1629 26 -1603
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `8.97% <0.00%> (-0.15%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [729 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...8b9d776](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (55947cf) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `28.29%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 15.81% -28.30%
+ Complexity 5157 495 -4662
=============================================
Files 936 284 -652
Lines 41629 11838 -29791
Branches 4189 981 -3208
=============================================
- Hits 18362 1872 -16490
+ Misses 21638 9803 -11835
+ Partials 1629 163 -1466
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.37% <100.00%> (+50.25%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `72.29% <100.00%> (+72.29%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [770 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...55947cf](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (740f439) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `43.33%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 46.16% 2.82% -43.34%
+ Complexity 5370 85 -5285
============================================
Files 921 284 -637
Lines 39953 11839 -28114
Branches 4288 982 -3306
============================================
- Hits 18444 335 -18109
+ Misses 19630 11478 -8152
+ Partials 1879 26 -1853
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <ø> (-49.20%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.10% <0.00%> (-49.34%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-71.29%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/utilities/sources/ParquetDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUGFycXVldERGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [776 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...740f439](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
}, {
"hash" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=998",
"triggerID" : "f6c78526f3a54ef66e501fc4d5163c3001b5b1eb",
"triggerType" : "PUSH"
}, {
"hash" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1008",
"triggerID" : "67a6e364db93b253692c3e257f4007c20e3cea65",
"triggerType" : "PUSH"
}, {
"hash" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012",
"triggerID" : "d055e23ffb53336e100dab0689980dcf714cd8ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* d055e23ffb53336e100dab0689980dcf714cd8ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1012)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 55947cfd5db5815a1030141ab69a15b9e1e96686 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951)
* 8b9d7763258e22d2bc0c40933f4a55e1080c2402 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r663108267
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -449,6 +449,9 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
Review comment:
Should we also handle `INSERT_OVERWRITE_TABLE` case?
Also, could you please add test to cover this scenario?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 740f4390fd6dd5798d5bee5f046a258dffd9887a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923)
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 88b4611172dc71243ca6c6bdca61e89b86b8120d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-882560612
> Hey, can you confirm you rebased it w/ upstream master correctly? I see lot of commit msgs while trying to squash and merge?
@nsivabalan rebased it correctly there are only changes related to intended changes in the pr.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d63d6c5) into [master](https://codecov.io/gh/apache/hudi/commit/371526789d663dee85041eb31c27c52c81ef87ef?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (3715267) will **decrease** coverage by `24.52%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 27.40% 2.88% -24.53%
+ Complexity 1287 85 -1202
============================================
Files 381 281 -100
Lines 15108 11622 -3486
Branches 1305 952 -353
============================================
- Hits 4141 335 -3806
- Misses 10667 11261 +594
+ Partials 300 26 -274
```
| Flag | Coverage Δ | |
|---|---|---|
| hudiclient | `0.00% <ø> (-21.06%)` | :arrow_down: |
| hudisync | `5.37% <ø> (ø)` | |
| hudiutilities | `9.25% <0.00%> (-49.33%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-71.15%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/utilities/sources/ParquetDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUGFycXVldERGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [139 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [3715267...d63d6c5](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 88b4611172dc71243ca6c6bdca61e89b86b8120d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930)
* 55947cfd5db5815a1030141ab69a15b9e1e96686 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671635600
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
created a ticket
https://issues.apache.org/jira/browse/HUDI-2188.
I will pick this test next. It will take me some time to write it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 14ddcc5fdc8c524742e2edbec9c18e9c0b059506 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (f6c7852) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `28.01%`.
> The diff coverage is `77.77%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 16.09% -28.02%
+ Complexity 5157 505 -4652
=============================================
Files 936 284 -652
Lines 41629 11877 -29752
Branches 4189 986 -3203
=============================================
- Hits 18362 1912 -16450
+ Misses 21638 9801 -11837
+ Partials 1629 164 -1465
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <77.77%> (+50.75%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <77.77%> (+73.41%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [774 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...f6c7852](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (f6c7852) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `16.56%`.
> The diff coverage is `77.77%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 27.54% -16.57%
+ Complexity 5157 1304 -3853
=============================================
Files 936 386 -550
Lines 41629 15385 -26244
Branches 4189 1343 -2846
=============================================
- Hits 18362 4238 -14124
+ Misses 21638 10842 -10796
+ Partials 1629 305 -1324
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <ø> (-13.55%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <77.77%> (+50.75%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <77.77%> (+73.41%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [672 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...f6c7852](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-874086074
@codope
I have added the tests for both `INSER_OVERWRITE` and `INSERT_OVERWRITE_TABLE` .
please review ^
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r666687674
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java
##########
@@ -449,6 +449,9 @@ public void refreshTimeline() throws IOException {
case BULK_INSERT:
writeStatusRDD = writeClient.bulkInsert(records, instantTime);
break;
+ case INSERT_OVERWRITE:
Review comment:
Thanks! Could you also add a unit test for the two operation types in `TestHoodieDeltaStreamer`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 88b4611172dc71243ca6c6bdca61e89b86b8120d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* d72b47dc2abbeb4862458275ec72e4e35ccdc2f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=990)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
}, {
"hash" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d72b47dc2abbeb4862458275ec72e4e35ccdc2f7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 8b9d7763258e22d2bc0c40933f4a55e1080c2402 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989)
* d72b47dc2abbeb4862458275ec72e4e35ccdc2f7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (67a6e36) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `28.01%`.
> The diff coverage is `77.77%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 16.09% -28.02%
+ Complexity 5157 505 -4652
=============================================
Files 936 284 -652
Lines 41629 11877 -29752
Branches 4189 986 -3203
=============================================
- Hits 18362 1912 -16450
+ Misses 21638 9801 -11837
+ Partials 1629 164 -1465
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <77.77%> (+50.75%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <77.77%> (+73.41%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [773 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...67a6e36](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (740f439) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `7.15%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 46.16% 39.01% -7.16%
+ Complexity 5370 1982 -3388
============================================
Files 921 466 -455
Lines 39953 19807 -20146
Branches 4288 2027 -2261
============================================
- Hits 18444 7727 -10717
+ Misses 19630 11263 -8367
+ Partials 1879 817 -1062
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <ø> (-9.56%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `67.21% <ø> (+0.15%)` | :arrow_up: |
| hudisync | `55.73% <ø> (+1.68%)` | :arrow_up: |
| huditimelineservice | `64.07% <ø> (-0.29%)` | :arrow_down: |
| hudiutilities | `59.18% <100.00%> (+0.74%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `70.64% <100.00%> (-0.64%)` | :arrow_down: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...able/action/compact/CompactionTriggerStrategy.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL3RhYmxlL2FjdGlvbi9jb21wYWN0L0NvbXBhY3Rpb25UcmlnZ2VyU3RyYXRlZ3kuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...serdefined/AbstractUserDefinedMetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvdXNlcmRlZmluZWQvQWJzdHJhY3RVc2VyRGVmaW5lZE1ldHJpY3NSZXBvcnRlci5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [596 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...740f439](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 15ea5785bc8556cd17b6dc4da5cce7d542fbd896 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* 814e45c99f54bb11ed54263cc4077e0a08689b48 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921)
* 740f4390fd6dd5798d5bee5f046a258dffd9887a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (55947cf) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `16.75%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 27.35% -16.76%
+ Complexity 5157 1294 -3863
=============================================
Files 936 386 -550
Lines 41629 15346 -26283
Branches 4189 1338 -2851
=============================================
- Hits 18362 4198 -14164
+ Misses 21638 10844 -10794
+ Partials 1629 304 -1325
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <ø> (-13.56%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.37% <100.00%> (+50.25%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `72.29% <100.00%> (+72.29%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [668 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...55947cf](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (15ea578) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `30.70%`.
> The diff coverage is `25.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 46.16% 15.46% -30.71%
+ Complexity 5370 478 -4892
=============================================
Files 921 280 -641
Lines 39953 11550 -28403
Branches 4288 945 -3343
=============================================
- Hits 18444 1786 -16658
+ Misses 19630 9605 -10025
+ Partials 1879 159 -1720
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `57.91% <25.00%> (-0.53%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `69.89% <25.00%> (-1.39%)` | :arrow_down: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [719 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...15ea578](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (7c22413) into [master](https://codecov.io/gh/apache/hudi/commit/371526789d663dee85041eb31c27c52c81ef87ef?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (3715267) will **decrease** coverage by `24.52%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 27.40% 2.88% -24.53%
+ Complexity 1287 85 -1202
============================================
Files 381 281 -100
Lines 15108 11622 -3486
Branches 1305 952 -353
============================================
- Hits 4141 335 -3806
- Misses 10667 11261 +594
+ Partials 300 26 -274
```
| Flag | Coverage Δ | |
|---|---|---|
| hudiclient | `0.00% <ø> (-21.06%)` | :arrow_down: |
| hudisync | `5.37% <ø> (ø)` | |
| hudiutilities | `9.25% <0.00%> (-49.33%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-71.15%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/utilities/sources/ParquetDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUGFycXVldERGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [139 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [3715267...7c22413](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 69713cc326c4cbacf9d4ea4e6927588af8b1c8ce Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864)
* 7acf0aa52de742a15af565ab53f8ab14e572b86a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ce329dd8973ea83fdafb3e9522d62aaad9222d Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826)
* d63d6c59a8ba4226acdb618452716c60b97b891c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
}, {
"hash" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=920",
"triggerID" : "c0063ddcc875e3e13348861ebaf21ef47126a691",
"triggerType" : "PUSH"
}, {
"hash" : "cf901c664f7baaab834b3f02a819144b5558f952",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf901c664f7baaab834b3f02a819144b5558f952",
"triggerType" : "PUSH"
}, {
"hash" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=921",
"triggerID" : "814e45c99f54bb11ed54263cc4077e0a08689b48",
"triggerType" : "PUSH"
}, {
"hash" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=923",
"triggerID" : "740f4390fd6dd5798d5bee5f046a258dffd9887a",
"triggerType" : "PUSH"
}, {
"hash" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da57d0d9a37bf1f86b19ecb79f26813c540a3aa3",
"triggerType" : "PUSH"
}, {
"hash" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=930",
"triggerID" : "88b4611172dc71243ca6c6bdca61e89b86b8120d",
"triggerType" : "PUSH"
}, {
"hash" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951",
"triggerID" : "55947cfd5db5815a1030141ab69a15b9e1e96686",
"triggerType" : "PUSH"
}, {
"hash" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989",
"triggerID" : "8b9d7763258e22d2bc0c40933f4a55e1080c2402",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf901c664f7baaab834b3f02a819144b5558f952 UNKNOWN
* da57d0d9a37bf1f86b19ecb79f26813c540a3aa3 UNKNOWN
* 55947cfd5db5815a1030141ab69a15b9e1e96686 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=951)
* 8b9d7763258e22d2bc0c40933f4a55e1080c2402 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=989)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d3a2190) into [master](https://codecov.io/gh/apache/hudi/commit/2099bf41db76e9a6e946aa41c318b7c0e18be04d?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (2099bf4) will **decrease** coverage by `31.74%`.
> The diff coverage is `100.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 47.84% 16.09% -31.75%
+ Complexity 5564 505 -5059
=============================================
Files 936 284 -652
Lines 41652 11877 -29775
Branches 4195 986 -3209
=============================================
- Hits 19928 1912 -18016
+ Misses 19952 9801 -10151
+ Partials 1772 164 -1608
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.53%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-51.10%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <100.00%> (+0.10%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <100.00%> (+0.69%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [722 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [2099bf4...d3a2190](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (0268428) into [master](https://codecov.io/gh/apache/hudi/commit/371526789d663dee85041eb31c27c52c81ef87ef?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (3715267) will **decrease** coverage by `24.52%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 27.40% 2.88% -24.53%
+ Complexity 1287 85 -1202
============================================
Files 381 281 -100
Lines 15108 11622 -3486
Branches 1305 952 -353
============================================
- Hits 4141 335 -3806
- Misses 10667 11261 +594
+ Partials 300 26 -274
```
| Flag | Coverage Δ | |
|---|---|---|
| hudiclient | `0.00% <ø> (-21.06%)` | :arrow_down: |
| hudisync | `5.37% <ø> (ø)` | |
| hudiutilities | `9.25% <0.00%> (-49.33%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-71.15%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/utilities/sources/ParquetDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUGFycXVldERGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [139 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [3715267...0268428](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
Samrat002 commented on a change in pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#discussion_r671635600
##########
File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##########
@@ -1695,6 +1695,54 @@ public void testJdbcSourceIncrementalFetchInContinuousMode() {
}
}
+ @Test
+ public void testInsertOverwrite() throws Exception {
+ String tableBasePath = dfsBasePath + "/insert_overwrite";
+ // Initial insert
+ HoodieDeltaStreamer.Config cfg = TestHelpers.makeConfig(tableBasePath, WriteOperationType.INSERT);
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // No new data => no commits.
+ cfg.sourceLimit = 0;
+ new HoodieDeltaStreamer(cfg, jsc).sync();
+ TestHelpers.assertRecordCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertDistanceCount(1000, tableBasePath + "/*/*.parquet", sqlContext);
+ TestHelpers.assertCommitMetadata("00000", tableBasePath, dfs, 1);
+ // insert overwrite
+ cfg.sourceLimit = 1000;
+ cfg.operation = WriteOperationType.INSERT_OVERWRITE;
Review comment:
- tried to club the repeated code please review
- created a ticket
https://issues.apache.org/jira/browse/HUDI-2188.
I will pick this test next. It will take some more time to write it for me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (67a6e36) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `41.28%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 2.82% -41.29%
+ Complexity 5157 85 -5072
============================================
Files 936 284 -652
Lines 41629 11877 -29752
Branches 4189 986 -3203
============================================
- Hits 18362 335 -18027
+ Misses 21638 11516 -10122
+ Partials 1629 26 -1603
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `8.97% <0.00%> (-0.15%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [728 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...67a6e36](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=533",
"triggerID" : "14ddcc5fdc8c524742e2edbec9c18e9c0b059506",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=674",
"triggerID" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"triggerType" : "PUSH"
}, {
"hash" : "15ea5785bc8556cd17b6dc4da5cce7d542fbd896",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=682",
"triggerID" : "873419073",
"triggerType" : "MANUAL"
}, {
"hash" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=821",
"triggerID" : "4f3a389384a1fbf0deb654caa490f3b32c3b7e41",
"triggerType" : "PUSH"
}, {
"hash" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=826",
"triggerID" : "53ce329dd8973ea83fdafb3e9522d62aaad9222d",
"triggerType" : "PUSH"
}, {
"hash" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=828",
"triggerID" : "d63d6c59a8ba4226acdb618452716c60b97b891c",
"triggerType" : "PUSH"
}, {
"hash" : "026842812197f1d47960d2df5d0d65270c49eb59",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=833",
"triggerID" : "026842812197f1d47960d2df5d0d65270c49eb59",
"triggerType" : "PUSH"
}, {
"hash" : "7c22413ebdf647e33166ccb91a16110d12599207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=837",
"triggerID" : "7c22413ebdf647e33166ccb91a16110d12599207",
"triggerType" : "PUSH"
}, {
"hash" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=864",
"triggerID" : "69713cc326c4cbacf9d4ea4e6927588af8b1c8ce",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"triggerType" : "PUSH"
}, {
"hash" : "7acf0aa52de742a15af565ab53f8ab14e572b86a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=889",
"triggerID" : "879154991",
"triggerType" : "MANUAL"
}, {
"hash" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=891",
"triggerID" : "b257edc1588b22e93386028f5a6c88c27ddbf087",
"triggerType" : "PUSH"
}, {
"hash" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=893",
"triggerID" : "b6fdaa5c3378c7ba92a02b47c1886217f9d9ebf0",
"triggerType" : "PUSH"
}, {
"hash" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907",
"triggerID" : "9dfca3c418c07d0c6175e473dc2a4a4dc395500b",
"triggerType" : "PUSH"
}, {
"hash" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911",
"triggerID" : "f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9dfca3c418c07d0c6175e473dc2a4a4dc395500b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=907)
* f15a539b1ea1ed7fb9a5b8a31cc9b88d68a6710f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=911)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (88b4611) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `41.27%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 2.82% -41.28%
+ Complexity 5157 85 -5072
============================================
Files 936 284 -652
Lines 41629 11839 -29790
Branches 4189 982 -3207
============================================
- Hits 18362 335 -18027
+ Misses 21638 11478 -10160
+ Partials 1629 26 -1603
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.85% <ø> (-50.88%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.10% <0.00%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [722 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...88b4611](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870410669
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter commented on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter commented on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (14ddcc5) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `43.09%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 46.16% 3.07% -43.10%
+ Complexity 5370 82 -5288
============================================
Files 921 280 -641
Lines 39953 10877 -29076
Branches 4288 1106 -3182
============================================
- Hits 18444 334 -18110
+ Misses 19630 10517 -9113
+ Partials 1879 26 -1853
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.45% <0.00%> (-48.99%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (-71.29%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...apache/hudi/utilities/sources/JsonKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkthZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/utilities/sources/ParquetDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUGFycXVldERGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [755 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...14ddcc5](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (8b9d776) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `28.01%`.
> The diff coverage is `77.77%`.
> :exclamation: Current head 8b9d776 differs from pull request most recent head d72b47d. Consider uploading reports for the commit d72b47d to get more accurate results
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 16.09% -28.02%
+ Complexity 5157 505 -4652
=============================================
Files 936 284 -652
Lines 41629 11877 -29752
Branches 4189 986 -3203
=============================================
- Hits 18362 1912 -16450
+ Misses 21638 9801 -11837
+ Partials 1629 164 -1465
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <77.77%> (+50.75%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <77.77%> (+73.41%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [774 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...d72b47d](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (55947cf) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `41.27%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
============================================
- Coverage 44.10% 2.82% -41.28%
+ Complexity 5157 85 -5072
============================================
Files 936 284 -652
Lines 41629 11838 -29791
Branches 4189 981 -3208
============================================
- Hits 18362 335 -18027
+ Misses 21638 11477 -10161
+ Partials 1629 26 -1603
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-34.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `9.09% <0.00%> (-0.03%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `0.00% <0.00%> (ø)` | |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [722 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...55947cf](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (8b9d776) into [master](https://codecov.io/gh/apache/hudi/commit/d024439764ceeca6366cb33689b729a1c69a6272?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (d024439) will **decrease** coverage by `16.56%`.
> The diff coverage is `77.77%`.
> :exclamation: Current head 8b9d776 differs from pull request most recent head d72b47d. Consider uploading reports for the commit d72b47d to get more accurate results
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 44.10% 27.54% -16.57%
+ Complexity 5157 1304 -3853
=============================================
Files 936 386 -550
Lines 41629 15385 -26244
Branches 4189 1343 -2846
=============================================
- Hits 18362 4238 -14124
+ Misses 21638 10842 -10796
+ Partials 1629 305 -1324
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `20.91% <ø> (-13.55%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `4.88% <ø> (-50.86%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `59.87% <77.77%> (+50.75%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | |
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `73.41% <77.77%> (+73.41%)` | :arrow_up: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...che/hudi/config/HoodieMetricsPrometheusConfig.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbmZpZy9Ib29kaWVNZXRyaWNzUHJvbWV0aGV1c0NvbmZpZy5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [672 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [d024439...d72b47d](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3184: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
Posted by GitBox <gi...@apache.org>.
codecov-commenter edited a comment on pull request #3184:
URL: https://github.com/apache/hudi/pull/3184#issuecomment-870526141
# [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
> Merging [#3184](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (14ddcc5) into [master](https://codecov.io/gh/apache/hudi/commit/039aeb6dcee0a8eb4372c079ec07b8fc2582e41f?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (039aeb6) will **decrease** coverage by `29.87%`.
> The diff coverage is `0.00%`.
[](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
```diff
@@ Coverage Diff @@
## master #3184 +/- ##
=============================================
- Coverage 46.16% 16.29% -29.88%
+ Complexity 5370 473 -4897
=============================================
Files 921 280 -641
Lines 39953 10877 -29076
Branches 4288 1106 -3182
=============================================
- Hits 18444 1772 -16672
+ Misses 19630 8946 -10684
+ Partials 1879 159 -1720
```
| Flag | Coverage Δ | |
|---|---|---|
| hudicli | `?` | |
| hudiclient | `0.00% <ø> (-30.47%)` | :arrow_down: |
| hudicommon | `?` | |
| hudiflink | `?` | |
| hudihadoopmr | `?` | |
| hudisparkdatasource | `?` | |
| hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: |
| huditimelineservice | `?` | |
| hudiutilities | `58.36% <0.00%> (-0.08%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
|---|---|---|
| [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `70.46% <0.00%> (-0.82%)` | :arrow_down: |
| [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...he/hudi/hive/HiveStylePartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvSGl2ZVN0eWxlUGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../apache/hudi/keygen/constant/KeyGeneratorType.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9jb25zdGFudC9LZXlHZW5lcmF0b3JUeXBlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [...pache/hudi/client/utils/ConcatenatingIterator.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC91dGlscy9Db25jYXRlbmF0aW5nSXRlcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| [.../hudi/execution/bulkinsert/BulkInsertSortMode.java](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2V4ZWN1dGlvbi9idWxraW5zZXJ0L0J1bGtJbnNlcnRTb3J0TW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: |
| ... and [709 more](https://codecov.io/gh/apache/hudi/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
------
[Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Last update [039aeb6...14ddcc5](https://codecov.io/gh/apache/hudi/pull/3184?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org