You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "suryaprasanna (via GitHub)" <gi...@apache.org> on 2025/12/07 07:44:12 UTC
[PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
suryaprasanna opened a new pull request, #17510:
URL: https://github.com/apache/hudi/pull/17510
### Describe the issue this Pull Request addresses
When `JavaSparkContext` is initialized directly without enabling Hive support, Spark SQL queries fail with "table not found" errors. This affects various Hudi utilities that need to run SQL queries against Hive tables.
This PR fixes the issue by creating `SparkSession` with Hive support enabled first, then deriving `JavaSparkContext` from it.
### Summary and Changelog
**What users gain:**
- Hudi utilities can now run Spark SQL queries against Hive tables without failures
- Consistent SparkContext creation with Hive support across all utilities
**Changes:**
- **UtilHelpers**: Modified `buildSparkContext()` methods to create `SparkSession` with Hive support enabled, then derive `JavaSparkContext` from it
- **HoodieTestSuiteJob, HoodieDataTableValidator, HoodieDropPartitionsTool, HoodieMetadataTableValidator, HoodieSnapshotExporter, TableSizeStats**: Updated to use refactored `buildSparkContext()` methods
### Impact
- **Public API**: No breaking changes. Internal utility method signatures remain the same.
- **User-facing feature**: Fixes failures when running SQL queries in Hudi utilities
- **Performance**: No performance impact
### Risk Level
**Low**
The change only affects how `JavaSparkContext` is created internally. All existing utilities continue to work with the new approach, and Hive support is a standard Spark feature.
### Documentation Update
none
- The config description must be updated if new configs are added or the default value of the configs are changed.
- Any new feature or user-facing change requires updating the Hudi website. Please follow the
[instruction](https://hudi.apache.org/contribute/developer-setup#website) to make changes to the website. -->
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [x] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797440533
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
* 229439286ec420df8f49cd2f1a25e2e42a2c970d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339)
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* 83bef1fd5a5f70bdbae1751d64dc0a388fccc296 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3821016214
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
}, {
"hash" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460",
"triggerID" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"triggerType" : "PUSH"
}, {
"hash" : "60c32daf888804078870d9315632a7fb9b2f97a2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11521",
"triggerID" : "60c32daf888804078870d9315632a7fb9b2f97a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* eb89dc95ec19e94e7b08fd098088c2b4282dd503 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460)
* 60c32daf888804078870d9315632a7fb9b2f97a2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11521)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797250389
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977)
* 8c3bf2a5d17dce382f5be6f283e9b8b430f99fda Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334)
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3807699142
hey @CTTY : can you follow up on reviews
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3621791179
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ef51637ad23f574e48e0048fa99e10b0e8fd731 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on code in PR #17510:
URL: https://github.com/apache/hudi/pull/17510#discussion_r2726024629
##########
hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/HoodieTestSuiteJob.java:
##########
@@ -183,8 +183,8 @@ public static void main(String[] args) throws Exception {
System.exit(1);
}
- JavaSparkContext jssc = UtilHelpers.buildSparkContext("workload-generator-" + cfg.outputTypeName
- + "-" + cfg.inputFormatName, cfg.sparkMaster);
+ JavaSparkContext jssc = UtilHelpers.buildSparkContextWithHiveSync("workload-generator-" + cfg.outputTypeName
Review Comment:
Fixed it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3820847775
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
}, {
"hash" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460",
"triggerID" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"triggerType" : "PUSH"
}, {
"hash" : "60c32daf888804078870d9315632a7fb9b2f97a2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60c32daf888804078870d9315632a7fb9b2f97a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* eb89dc95ec19e94e7b08fd098088c2b4282dd503 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460)
* 60c32daf888804078870d9315632a7fb9b2f97a2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3821247854
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
}, {
"hash" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460",
"triggerID" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"triggerType" : "PUSH"
}, {
"hash" : "60c32daf888804078870d9315632a7fb9b2f97a2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11521",
"triggerID" : "60c32daf888804078870d9315632a7fb9b2f97a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* 60c32daf888804078870d9315632a7fb9b2f97a2 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11521)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797186935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977)
* 8c3bf2a5d17dce382f5be6f283e9b8b430f99fda Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797409994
> Hi @suryaprasanna , thanks for the contribution!
>
> IIUC, with this change, users no longer need to specify enableHiveSupport() in their SparkSession explicitly, is that correct? Is there any implications to the non-hive users?
In the latest commit, I added a config called enableHiveSupport, if users pass it to true to enables the hive sync support, otherwise not. But HoodieStreamer I passed it to be true. That way, users creating spark context from other modules like hudi-integ-test dont see any failures,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "CTTY (via GitHub)" <gi...@apache.org>.
CTTY commented on code in PR #17510:
URL: https://github.com/apache/hudi/pull/17510#discussion_r2734253119
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/HoodieMultiTableStreamer.java:
##########
@@ -370,6 +370,9 @@ public static class Config implements Serializable {
@Parameter(names = {"--sync-tool-classes"}, description = "Meta sync client tool, using comma to separate multi tools")
public String syncClientToolClassNames = HiveSyncTool.class.getName();
+ @Parameter(names = {"--enable-hive-support", "-ehs"}, description = "Enables hive support during spark context initialization.", required = false)
+ public Boolean enableHiveSupport = false;
Review Comment:
does this need to be true as well?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797432818
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
* 229439286ec420df8f49cd2f1a25e2e42a2c970d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339)
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797586072
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* 83bef1fd5a5f70bdbae1751d64dc0a388fccc296 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3813794443
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
}, {
"hash" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* 83bef1fd5a5f70bdbae1751d64dc0a388fccc296 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342)
* eb89dc95ec19e94e7b08fd098088c2b4282dd503 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3621790042
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ef51637ad23f574e48e0048fa99e10b0e8fd731 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797395676
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
* 229439286ec420df8f49cd2f1a25e2e42a2c970d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797464602
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* 229439286ec420df8f49cd2f1a25e2e42a2c970d Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339)
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* 83bef1fd5a5f70bdbae1751d64dc0a388fccc296 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "CTTY (via GitHub)" <gi...@apache.org>.
CTTY merged PR #17510:
URL: https://github.com/apache/hudi/pull/17510
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3623175057
@CTTY could you help review this PR?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797278053
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8c3bf2a5d17dce382f5be6f283e9b8b430f99fda Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334)
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797398946
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
* 229439286ec420df8f49cd2f1a25e2e42a2c970d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339)
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on code in PR #17510:
URL: https://github.com/apache/hudi/pull/17510#discussion_r2738493669
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/HoodieMultiTableStreamer.java:
##########
@@ -370,6 +370,9 @@ public static class Config implements Serializable {
@Parameter(names = {"--sync-tool-classes"}, description = "Meta sync client tool, using comma to separate multi tools")
public String syncClientToolClassNames = HiveSyncTool.class.getName();
+ @Parameter(names = {"--enable-hive-support", "-ehs"}, description = "Enables hive support during spark context initialization.", required = false)
+ public Boolean enableHiveSupport = false;
Review Comment:
Yeah, makes sense. Made the change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3814487037
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
}, {
"hash" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460",
"triggerID" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* eb89dc95ec19e94e7b08fd098088c2b4282dd503 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797258100
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977)
* 8c3bf2a5d17dce382f5be6f283e9b8b430f99fda Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334)
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797331265
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "CTTY (via GitHub)" <gi...@apache.org>.
CTTY commented on code in PR #17510:
URL: https://github.com/apache/hudi/pull/17510#discussion_r2596973875
##########
hudi-integ-test/src/main/java/org/apache/hudi/integ/testsuite/HoodieTestSuiteJob.java:
##########
@@ -183,8 +183,8 @@ public static void main(String[] args) throws Exception {
System.exit(1);
}
- JavaSparkContext jssc = UtilHelpers.buildSparkContext("workload-generator-" + cfg.outputTypeName
- + "-" + cfg.inputFormatName, cfg.sparkMaster);
+ JavaSparkContext jssc = UtilHelpers.buildSparkContextWithHiveSync("workload-generator-" + cfg.outputTypeName
Review Comment:
I don't see `buildSparkContextWithHiveSync` anywhere?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3621793419
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ef51637ad23f574e48e0048fa99e10b0e8fd731 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975)
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3621840666
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3621828014
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ef51637ad23f574e48e0048fa99e10b0e8fd731 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975)
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3621802721
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ef51637ad23f574e48e0048fa99e10b0e8fd731 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975)
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3813984498
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11339",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
}, {
"hash" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13",
"triggerType" : "PUSH"
}, {
"hash" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eab8cd7b63b9c641cfcc4302c41f6435a9770981",
"triggerType" : "PUSH"
}, {
"hash" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342",
"triggerID" : "83bef1fd5a5f70bdbae1751d64dc0a388fccc296",
"triggerType" : "PUSH"
}, {
"hash" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460",
"triggerID" : "eb89dc95ec19e94e7b08fd098088c2b4282dd503",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* a8db9da7ccd2371b3e53f1e60c5785a22ddc2c13 UNKNOWN
* eab8cd7b63b9c641cfcc4302c41f6435a9770981 UNKNOWN
* 83bef1fd5a5f70bdbae1751d64dc0a388fccc296 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11342)
* eb89dc95ec19e94e7b08fd098088c2b4282dd503 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11460)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797191563
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977)
* 8c3bf2a5d17dce382f5be6f283e9b8b430f99fda Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334)
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797179356
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977)
* 8c3bf2a5d17dce382f5be6f283e9b8b430f99fda UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: enable Hive support when creating JavaSparkContext for Spark SQL queries [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17510:
URL: https://github.com/apache/hudi/pull/17510#issuecomment-3797352343
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9975",
"triggerID" : "6ef51637ad23f574e48e0048fa99e10b0e8fd731",
"triggerType" : "PUSH"
}, {
"hash" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9977",
"triggerID" : "a9e34d1f42fa0f6d3cc4327707b4504fbe21c80c",
"triggerType" : "PUSH"
}, {
"hash" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11334",
"triggerID" : "8c3bf2a5d17dce382f5be6f283e9b8b430f99fda",
"triggerType" : "PUSH"
}, {
"hash" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95b01d5efd7b10b9e3c16d99548ecfd22d585c85",
"triggerType" : "PUSH"
}, {
"hash" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337",
"triggerID" : "de406ddb71c392ac034f4dfa5a77472f49afe55a",
"triggerType" : "PUSH"
}, {
"hash" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "229439286ec420df8f49cd2f1a25e2e42a2c970d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 95b01d5efd7b10b9e3c16d99548ecfd22d585c85 UNKNOWN
* de406ddb71c392ac034f4dfa5a77472f49afe55a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11337)
* 229439286ec420df8f49cd2f1a25e2e42a2c970d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org