You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/09/01 23:51:52 UTC
[GitHub] [hudi] yihua opened a new pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
yihua opened a new pull request #3583:
URL: https://github.com/apache/hudi/pull/3583
## What is the purpose of the pull request
This PR adds the DAG nodes of create table, insert, merge, update, and delete in Spark SQL for testing Spark SQL in the integration test suite.
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
}, {
"hash" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181",
"triggerID" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ee56df45519ba852edefea620f4d85cc9e826ad3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151)
* 5addff56d3f28cfb20a088081afbce1fedcf2e5f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
}, {
"hash" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ee56df45519ba852edefea620f4d85cc9e826ad3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151)
* 5addff56d3f28cfb20a088081afbce1fedcf2e5f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ea44e15a953fdec17fd955491e3a8691641cee2b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106)
* 36707813c8687d32950f518a240fa0ddfedc1479 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d535f4a9da4ffc767c44fe0c84008712f65b3152 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d535f4a9da4ffc767c44fe0c84008712f65b3152 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075)
* 8dbdfab101b62ec3755a87f144defa684b74f40a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #3583: [HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #3583:
URL: https://github.com/apache/hudi/pull/3583
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8dbdfab101b62ec3755a87f144defa684b74f40a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105)
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ea44e15a953fdec17fd955491e3a8691641cee2b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ea44e15a953fdec17fd955491e3a8691641cee2b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106)
* 36707813c8687d32950f518a240fa0ddfedc1479 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d535f4a9da4ffc767c44fe0c84008712f65b3152 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075)
* 8dbdfab101b62ec3755a87f144defa684b74f40a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ee56df45519ba852edefea620f4d85cc9e826ad3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* 36707813c8687d32950f518a240fa0ddfedc1479 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125)
* ee56df45519ba852edefea620f4d85cc9e826ad3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* 36707813c8687d32950f518a240fa0ddfedc1479 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125)
* ee56df45519ba852edefea620f4d85cc9e826ad3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
}, {
"hash" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181",
"triggerID" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"triggerType" : "PUSH"
}, {
"hash" : "c615e8ad16070896cbecb0d5dc73d9aa52f0fe24",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c615e8ad16070896cbecb0d5dc73d9aa52f0fe24",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* 5addff56d3f28cfb20a088081afbce1fedcf2e5f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181)
* c615e8ad16070896cbecb0d5dc73d9aa52f0fe24 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8dbdfab101b62ec3755a87f144defa684b74f40a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105)
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ea44e15a953fdec17fd955491e3a8691641cee2b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8dbdfab101b62ec3755a87f144defa684b74f40a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105)
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* ea44e15a953fdec17fd955491e3a8691641cee2b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #3583: [HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#discussion_r707462938
##########
File path: docker/demo/config/test-suite/spark-sql-nonpartitioned-external-mor.yaml
##########
@@ -0,0 +1,39 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+dag_name: sspark-sql-nonpartitioned-external-mor.yaml
+dag_rounds: 1
+dag_intermittent_delay_mins: 1
+dag_content:
+ create_table:
+ config:
+ table_type: mor
+ table_location: /tmp/hudi/test_suite_hudi_table1
Review comment:
Yes. This config has been replaced by `is_external` and the table location for an external table is determined using the target base path.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d535f4a9da4ffc767c44fe0c84008712f65b3152 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075)
* 8dbdfab101b62ec3755a87f144defa684b74f40a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105)
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979)
* d535f4a9da4ffc767c44fe0c84008712f65b3152 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* 36707813c8687d32950f518a240fa0ddfedc1479 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
}, {
"hash" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181",
"triggerID" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* 5addff56d3f28cfb20a088081afbce1fedcf2e5f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#discussion_r705665469
##########
File path: hudi-integ-test/src/main/scala/org/apache/hudi/integ/testsuite/utils/SparkUtils.scala
##########
@@ -0,0 +1,53 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.integ.testsuite.utils
+
+import org.apache.avro.Schema
+import org.apache.avro.generic.GenericRecord
+import org.apache.hudi.HoodieSparkUtils
+import org.apache.hudi.integ.testsuite.configuration.DeltaConfig.Config
+import org.apache.hudi.integ.testsuite.dag.ExecutionContext
+import org.apache.spark.rdd.RDD
+
+/**
+ * Utils for test nodes in Spark
+ */
+object SparkUtils {
+
+ /**
+ * Generates records for delete operations in Spark.
+ *
+ * @param config Node configs.
+ * @param context The context needed for an execution of a node.
+ * @return Records in {@link RDD}.
+ */
+ def generateRecordsForDelete(config: Config, context: ExecutionContext): RDD[GenericRecord] = {
Review comment:
Why in a separate utils class. I see this has been used only in SparkDeleteNode. We could just make it as private method right ?
##########
File path: docker/demo/config/test-suite/spark-sql-nonpartitioned-external-mor.yaml
##########
@@ -0,0 +1,39 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+dag_name: sspark-sql-nonpartitioned-external-mor.yaml
+dag_rounds: 1
+dag_intermittent_delay_mins: 1
+dag_content:
+ create_table:
+ config:
+ table_type: mor
+ table_location: /tmp/hudi/test_suite_hudi_table1
Review comment:
we should be leveraging on inputBasePath config or, we can rely on the writeConfig.basePath
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
}, {
"hash" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181",
"triggerID" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"triggerType" : "PUSH"
}, {
"hash" : "c615e8ad16070896cbecb0d5dc73d9aa52f0fe24",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2193",
"triggerID" : "c615e8ad16070896cbecb0d5dc73d9aa52f0fe24",
"triggerType" : "PUSH"
}, {
"hash" : "c339e7a4a0f4b6645881ddb9709d90a320dee6bc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c339e7a4a0f4b6645881ddb9709d90a320dee6bc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* 5addff56d3f28cfb20a088081afbce1fedcf2e5f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181)
* c615e8ad16070896cbecb0d5dc73d9aa52f0fe24 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2193)
* c339e7a4a0f4b6645881ddb9709d90a320dee6bc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #3583: [HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#discussion_r707463372
##########
File path: hudi-integ-test/src/main/scala/org/apache/hudi/integ/testsuite/utils/SparkUtils.scala
##########
@@ -0,0 +1,53 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.integ.testsuite.utils
+
+import org.apache.avro.Schema
+import org.apache.avro.generic.GenericRecord
+import org.apache.hudi.HoodieSparkUtils
+import org.apache.hudi.integ.testsuite.configuration.DeltaConfig.Config
+import org.apache.hudi.integ.testsuite.dag.ExecutionContext
+import org.apache.spark.rdd.RDD
+
+/**
+ * Utils for test nodes in Spark
+ */
+object SparkUtils {
+
+ /**
+ * Generates records for delete operations in Spark.
+ *
+ * @param config Node configs.
+ * @param context The context needed for an execution of a node.
+ * @return Records in {@link RDD}.
+ */
+ def generateRecordsForDelete(config: Config, context: ExecutionContext): RDD[GenericRecord] = {
Review comment:
Right. It was used by Spark SQL delete node but no longer. Fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3583: [WIP][HUDI-2388] Add DAG nodes for Spark SQL in integration test suite
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3583:
URL: https://github.com/apache/hudi/pull/3583#issuecomment-910917581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1979",
"triggerID" : "1849c0e8f4111a9667b5e9d2fd133bcd3a2e2cd5",
"triggerType" : "PUSH"
}, {
"hash" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2075",
"triggerID" : "d535f4a9da4ffc767c44fe0c84008712f65b3152",
"triggerType" : "PUSH"
}, {
"hash" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2105",
"triggerID" : "8dbdfab101b62ec3755a87f144defa684b74f40a",
"triggerType" : "PUSH"
}, {
"hash" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e87596ce68cd1e8362162527e8de60731fb0efe",
"triggerType" : "PUSH"
}, {
"hash" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb78a81386000da034b092c3fcc44cf0af1ad8c5",
"triggerType" : "PUSH"
}, {
"hash" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2106",
"triggerID" : "ea44e15a953fdec17fd955491e3a8691641cee2b",
"triggerType" : "PUSH"
}, {
"hash" : "36707813c8687d32950f518a240fa0ddfedc1479",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2125",
"triggerID" : "36707813c8687d32950f518a240fa0ddfedc1479",
"triggerType" : "PUSH"
}, {
"hash" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2151",
"triggerID" : "ee56df45519ba852edefea620f4d85cc9e826ad3",
"triggerType" : "PUSH"
}, {
"hash" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181",
"triggerID" : "5addff56d3f28cfb20a088081afbce1fedcf2e5f",
"triggerType" : "PUSH"
}, {
"hash" : "c615e8ad16070896cbecb0d5dc73d9aa52f0fe24",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2193",
"triggerID" : "c615e8ad16070896cbecb0d5dc73d9aa52f0fe24",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e87596ce68cd1e8362162527e8de60731fb0efe UNKNOWN
* fb78a81386000da034b092c3fcc44cf0af1ad8c5 UNKNOWN
* 5addff56d3f28cfb20a088081afbce1fedcf2e5f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2181)
* c615e8ad16070896cbecb0d5dc73d9aa52f0fe24 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2193)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org