You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2020/01/24 01:59:19 UTC
[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #487: [WIP]
HDDS-2883. Change the default client settings accordingly with change in
default chunk size.
bharatviswa504 opened a new pull request #487: [WIP] HDDS-2883. Change the default client settings accordingly with change in default chunk size.
URL: https://github.com/apache/hadoop-ozone/pull/487
## What changes were proposed in this pull request?
This Jira proposes to change the following values
ozone.client.stream.buffer.flush.size - 64MB -> 16MB
ozone.client.stream.buffer.max.size - 128 MB -> 32MB
ozone.scm.chunk.size - 16MB -> 4MB
In this way, the client-side holding buffer size will be reduced, and data is transferred at smaller size intervals.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-2883
## How was this patch tested?
Multiple teragen tests are run on a 6 node cluster with these values and along changes from HDDS-2920 and HDDS-2921 we have seen teragen completed successfully.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #487: HDDS-2883.
Change the default client settings accordingly with change in default chunk
size.
Posted by GitBox <gi...@apache.org>.
bharatviswa504 commented on issue #487: HDDS-2883. Change the default client settings accordingly with change in default chunk size.
URL: https://github.com/apache/hadoop-ozone/pull/487#issuecomment-581635550
Thank You @adoroszlai and @arp7 for the review.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #487: [WIP]
HDDS-2883. Change the default client settings accordingly with change in
default chunk size.
Posted by GitBox <gi...@apache.org>.
bharatviswa504 commented on issue #487: [WIP] HDDS-2883. Change the default client settings accordingly with change in default chunk size.
URL: https://github.com/apache/hadoop-ozone/pull/487#issuecomment-580947575
> Thanks @bharatviswa504 for working on this. Shouldn't the default values be changed in `OzoneConfigKeys`, too?
Thank You @adoroszlai for the review. Yes, we need to update. Updated in the latest commit.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org
[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #487: HDDS-2883.
Change the default client settings accordingly with change in default chunk
size.
Posted by GitBox <gi...@apache.org>.
bharatviswa504 merged pull request #487: HDDS-2883. Change the default client settings accordingly with change in default chunk size.
URL: https://github.com/apache/hadoop-ozone/pull/487
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org