You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "tanvipenumudy (via GitHub)" <gi...@apache.org> on 2023/10/03 10:33:29 UTC
[PR] HDDS-9374. RangeKeysGenerator freon tool should support objects creation >2GB [ozone]
tanvipenumudy opened a new pull request, #5386:
URL: https://github.com/apache/ozone/pull/5386
## What changes were proposed in this pull request?
To address the current limitation in RangeKeysGenerator, which restricts object creation to a maximum size of 2 GB by utilizing [ContentGenerator](https://github.com/apache/ozone/blob/master/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/ContentGenerator.java).
This approach involves writing random keys from a finite buffer, rather than using the existing RandomUtils#nextBytes method, consequently resolving the issue of accommodating long values for objectSizeInBytes.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-9374
## How was this patch tested?
- Existing test cases should cover the code changes
- Tested the changes manually
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-9374. RangeKeysGenerator freon tool should support objects creation >2GB [ozone]
Posted by "ayushtkn (via GitHub)" <gi...@apache.org>.
ayushtkn commented on PR #5386:
URL: https://github.com/apache/ozone/pull/5386#issuecomment-1748235199
Merged, Thanx @tanvipenumudy for the contribution!!!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-9374. RangeKeysGenerator freon tool should support objects creation >2GB [ozone]
Posted by "ayushtkn (via GitHub)" <gi...@apache.org>.
ayushtkn merged PR #5386:
URL: https://github.com/apache/ozone/pull/5386
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-9374. RangeKeysGenerator freon tool should support objects creation >2GB [ozone]
Posted by "tanvipenumudy (via GitHub)" <gi...@apache.org>.
tanvipenumudy commented on PR #5386:
URL: https://github.com/apache/ozone/pull/5386#issuecomment-1748385615
Thank you @ayushtkn for the review!
> Side note: maybe in future we should explore allowing data units for --size rather than bytes like 3GB, 100MB or so, should be easier to use.
I agree - created a Jira: [HDDS-9393](https://issues.apache.org/jira/browse/HDDS-9393) for addressing this suggestion, thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org