You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Gatsby-Lee (via GitHub)" <gi...@apache.org> on 2024/07/22 17:58:09 UTC
[PR] Revert back to overwrite=true in HoodieSnapshotExporter [hudi]
Gatsby-Lee opened a new pull request, #11668:
URL: https://github.com/apache/hudi/pull/11668
### Change Logs
The discussion about this change has been done with @xushiyan. ( https://github.com/apache/hudi/issues/11640 )
The HoodieSnapshotExporter was updated with overwrite=false as of 0.13.0 ( https://issues.apache.org/jira/browse/HUDI-712 )
But, the change introduced a regression impact that caused Spark Job failed when failed Tasks are retried on Spark due to the created target by the previous failed Task. ( By the way, this is a task level )
On the Job level, the target path existence is checked by the existing logic
### Impact
HoodieSnapshotExporter will work as usual although Spark Tasks failed and retried.
### Risk level (write none, low medium or high below)
low
### Documentation Update
no need
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Revert back to overwrite=true in HoodieSnapshotExporter [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11668:
URL: https://github.com/apache/hudi/pull/11668#issuecomment-2243569827
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5b7c982dfa17db6d7a3bdc5550871e037897557c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b7c982dfa17db6d7a3bdc5550871e037897557c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5b7c982dfa17db6d7a3bdc5550871e037897557c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Revert back to overwrite=true in HoodieSnapshotExporter [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11668:
URL: https://github.com/apache/hudi/pull/11668#issuecomment-2243585727
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5b7c982dfa17db6d7a3bdc5550871e037897557c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24950",
"triggerID" : "5b7c982dfa17db6d7a3bdc5550871e037897557c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5b7c982dfa17db6d7a3bdc5550871e037897557c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24950)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-712] Revert back to overwrite=true in HoodieSnapshotExporter [hudi]
Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan merged PR #11668:
URL: https://github.com/apache/hudi/pull/11668
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org