You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/09 09:28:48 UTC
[GitHub] [hudi] flashJd opened a new pull request, #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
flashJd opened a new pull request, #6643:
URL: https://github.com/apache/hudi/pull/6643
### Change Logs
When create a table not using hive catalog in spark, we can not easily do read_optimized query in sqark-sql(using global hudi config file is inconvenient),so I add the read_optimize spark_session config to use in spark-sql
Reference `hoodie.schema.on.read.enable` spark_session config
https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala#648
### Impact
_Describe any public API or user-facing feature change or any performance impact._
**Risk level: none | low | medium | high**
_Choose one. If medium or high, explain what verification was done to mitigate the risks._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1289992858
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 180e976b0e06e21469fcf3e7f946e451c45744a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1573323904
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 180e976b0e06e21469fcf3e7f946e451c45744a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541)
* 9bb916dce004481edaa9891aad1e8768e27bae92 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1289797568
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 180e976b0e06e21469fcf3e7f946e451c45744a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1301512185
@flashJd
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1241977036
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] flashJd commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "flashJd (via GitHub)" <gi...@apache.org>.
flashJd commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1473771328
> @flashJd : Can you look at the failing testcase
I'll look at it soon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1241765009
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1576093875
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
}, {
"hash" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593",
"triggerID" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"triggerType" : "PUSH"
}, {
"hash" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17595",
"triggerID" : "1576082478",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17595)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1301512075
looks like the new test that you added is fialing in CI? can you check that please. and rebase w/ latest master. there was an flaky test that was fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1575896384
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
}, {
"hash" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593",
"triggerID" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9bb916dce004481edaa9891aad1e8768e27bae92 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573)
* bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1576012261
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
}, {
"hash" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593",
"triggerID" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "bvaradar (via GitHub)" <gi...@apache.org>.
bvaradar commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1457431119
@flashJd : Can you look at the failing testcase
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1285296986
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269)
* 180e976b0e06e21469fcf3e7f946e451c45744a8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1576408934
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
}, {
"hash" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593",
"triggerID" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"triggerType" : "PUSH"
}, {
"hash" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17595",
"triggerID" : "1576082478",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17593) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17595)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1575892345
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
}, {
"hash" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9bb916dce004481edaa9891aad1e8768e27bae92 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573)
* bf69cb9457ef0d0690a0d30a5e7b5d3db399b75e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1285305682
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269)
* 180e976b0e06e21469fcf3e7f946e451c45744a8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1286394561
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 180e976b0e06e21469fcf3e7f946e451c45744a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] flashJd commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "flashJd (via GitHub)" <gi...@apache.org>.
flashJd commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1576082478
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1289788167
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1241758971
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1573531446
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9bb916dce004481edaa9891aad1e8768e27bae92 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=17573)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1573313788
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11269",
"triggerID" : "f1da1b1eb5d7d96a8040d4d7ebbf17d886386a54",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389",
"triggerID" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"triggerType" : "PUSH"
}, {
"hash" : "180e976b0e06e21469fcf3e7f946e451c45744a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541",
"triggerID" : "1289788167",
"triggerType" : "MANUAL"
}, {
"hash" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9bb916dce004481edaa9891aad1e8768e27bae92",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 180e976b0e06e21469fcf3e7f946e451c45744a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12389) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12541)
* 9bb916dce004481edaa9891aad1e8768e27bae92 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] flashJd commented on pull request #6643: [HUDI-4823]Add read_optimize spark_session config to use in spark-sql
Posted by "flashJd (via GitHub)" <gi...@apache.org>.
flashJd commented on PR #6643:
URL: https://github.com/apache/hudi/pull/6643#issuecomment-1576085073
@xushiyan @nsivabalan I've rebased master, the CI error seems has no bussiness with this PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org