You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Ritesh H Shukla (Jira)" <ji...@apache.org> on 2021/11/02 05:56:00 UTC
[jira] [Comment Edited] (HDDS-5887) Measure performance for the new
changes.
[ https://issues.apache.org/jira/browse/HDDS-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437139#comment-17437139 ]
Ritesh H Shukla edited comment on HDDS-5887 at 11/2/21, 5:55 AM:
-----------------------------------------------------------------
On a secure cluster. This patch was tested to confirm the 10x performance improvement
[root@secures3-1 ~]# ~/warp stat --bucket bucket --obj.size=1KiB --host=secures3-1:9879 --access-key=om/secures3-1.gce.cloudera.com@GCE.CLOUDERA.COM --secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146 --insecure --tls
warp: Benchmark data written to "warp-stat-2021-11-01[222647]-7yCJ.csv.zst"
----------------------------------------
Operation: PUT
* Average: 0.07 MiB/s, 66.69 obj/s
Throughput, split into 149 x 1s:
* Fastest: 128.9KiB/s, 128.93 obj/s
* 50% Median: 69.4KiB/s, 69.38 obj/s
* Slowest: 7.9KiB/s, 7.92 obj/s
----------------------------------------
Operation: STAT
* Average: 115.36 obj/s
Throughput, split into 298 x 1s:
* Fastest: 318.66 obj/s
* 50% Median: 124.15 obj/s
* Slowest: 9.52 obj/s
warp: Cleanup Done.[root@secures3-1 ~]# ~/warp stat --bucket bucket --obj.size=1KiB --host=secures3-1:9879 --access-key=om/secures3-1.gce.cloudera.com@GCE.CLOUDERA.COM --secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146 --insecure --tls
warp: Benchmark data written to "warp-stat-2021-11-01[224905]-7dan.csv.zst"
----------------------------------------
Operation: PUT
* Average: 0.21 MiB/s, 217.51 obj/s
Throughput, split into 45 x 1s:
* Fastest: 317.3KiB/s, 317.28 obj/s
* 50% Median: 240.5KiB/s, 240.55 obj/s
* Slowest: 58.8KiB/s, 58.78 obj/s
----------------------------------------
Operation: STAT
* Average: 1379.91 obj/s
Throughput, split into 299 x 1s:
* Fastest: 1485.17 obj/s
* 50% Median: 1397.08 obj/s
* Slowest: 750.49 obj/s
was (Author: kerneltime):
On a secure cluster. This patch was tested to confirm the 10x performance improvement
{{[root@secures3-1 ~]# ~/warp stat --bucket bucket --obj.size=1KiB --host=secures3-1:9879 --access-key=om/secures3-1.gce.cloudera.com@GCE.CLOUDERA.COM --secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146 --insecure --tls}}
{{warp: Benchmark data written to "warp-stat-2021-11-01[222647]-7yCJ.csv.zst"}}{{----------------------------------------}}
{{Operation: PUT}}
{{* Average: 0.07 MiB/s, 66.69 obj/s}}{{Throughput, split into 149 x 1s:}}
{{ * Fastest: 128.9KiB/s, 128.93 obj/s}}
{{ * 50% Median: 69.4KiB/s, 69.38 obj/s}}
{{ * Slowest: 7.9KiB/s, 7.92 obj/s}}{{----------------------------------------}}
{{Operation: STAT}}
{{* Average: 115.36 obj/s}}{{Throughput, split into 298 x 1s:}}
{{ * Fastest: 318.66 obj/s}}
{{ * 50% Median: 124.15 obj/s}}
{{ * Slowest: 9.52 obj/s}}
{{warp: Cleanup Done.[root@secures3-1 ~]# ~/warp stat --bucket bucket --obj.size=1KiB --host=secures3-1:9879 --access-key=om/secures3-1.gce.cloudera.com@GCE.CLOUDERA.COM --secret-key=aa54dc20f44335bbfd3598016889e0a43eb46a060dea63ee49d9988c75d35146 --insecure --tls}}
{{warp: Benchmark data written to "warp-stat-2021-11-01[224905]-7dan.csv.zst"}}
----------------------------------------
Operation: PUT
* Average: 0.21 MiB/s, 217.51 obj/s
Throughput, split into 45 x 1s:
* Fastest: 317.3KiB/s, 317.28 obj/s
* 50% Median: 240.5KiB/s, 240.55 obj/s
* Slowest: 58.8KiB/s, 58.78 obj/s
----------------------------------------
Operation: STAT
* Average: 1379.91 obj/s
Throughput, split into 299 x 1s:
* Fastest: 1485.17 obj/s
* 50% Median: 1397.08 obj/s
* Slowest: 750.49 obj/s
> Measure performance for the new changes.
> ----------------------------------------
>
> Key: HDDS-5887
> URL: https://issues.apache.org/jira/browse/HDDS-5887
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Ritesh H Shukla
> Assignee: Ritesh H Shukla
> Priority: Major
>
> The performance for this change needs to be profiled before and after the change.
> The expectation is that S3G should be able to serve a large number of clients and have significantly better performance.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org