You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "CTTY (via GitHub)" <gi...@apache.org> on 2024/07/10 06:04:14 UTC
[PR] [HUDI-3625][RFC-60] Add StorageStrtegy to HoodieStorage [hudi]
CTTY opened a new pull request, #11607:
URL: https://github.com/apache/hudi/pull/11607
### Change Logs
This is a part of RFC-60: Object Storage Storage Strategy https://github.com/apache/hudi/blob/master/rfc/rfc-60/rfc-60.md. The end goal is to leverage the HoodieStorage layer to further separate Hudi logic from File IO, allowing more flexibility in the physical location of files.
This PR will add StorageStrategy to HoodieStorage, but StorageStrategy will NOT be used anywhere just yet.
### Impact
No impact.
### Risk level (write none, low medium or high below)
None
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none"._
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-3625][RFC-60] Add StorageStrategy to HoodieStorage [hudi]
Posted by "zhangyue19921010 (via GitHub)" <gi...@apache.org>.
zhangyue19921010 commented on PR #11607:
URL: https://github.com/apache/hudi/pull/11607#issuecomment-2510475839
Hey @CTTY I'm YueZhang, Coming from JD.com May I ask, are you still contributing to this PR? During the process of launching Hudi on JD.com, we also encountered performance bottlenecks in storage layers such as HDFS, and we also implemented similar tiered storage practices as mentioned in your PR. , improving the conventional Hudi table storage, realizing the concept of logical tables, and achieving good results on PRD. Can we build this capability together?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-3625][RFC-60] Add StorageStrategy to HoodieStorage [hudi]
Posted by "zhangyue19921010 (via GitHub)" <gi...@apache.org>.
zhangyue19921010 commented on PR #11607:
URL: https://github.com/apache/hudi/pull/11607#issuecomment-2510472439
Hey @CTTY I'm YueZhang, Coming from JD.com
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-3625][RFC-60] Add StorageStrategy to HoodieStorage [hudi]
Posted by "zhangyue19921010 (via GitHub)" <gi...@apache.org>.
zhangyue19921010 commented on PR #11607:
URL: https://github.com/apache/hudi/pull/11607#issuecomment-2513469823
Still Conflicting @CTTY Orz..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org