You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ratis.apache.org by "runzhiwang (Jira)" <ji...@apache.org> on 2021/05/07 08:52:00 UTC
[jira] [Comment Edited] (RATIS-1312) Compare the performance
between HDFS and DataStreamApi
[ https://issues.apache.org/jira/browse/RATIS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340674#comment-17340674 ]
runzhiwang edited comment on RATIS-1312 at 5/7/21, 8:51 AM:
------------------------------------------------------------
[~szetszwo] Hi, with the RATIS-1372 and RATIS-1373, streaming's performance is almost similar to HDFS when without writting disk. And I will send an email for this test result.
1. When write 200files * 128MB, packet size is 4MB, both streaming and hdfs cost about 22 seconds, i.e. about 1163MB, which is the max bandwidth of network interface card.
2. When write 400files * 128MB, packet size is 4MB, both streaming and hdfs cost about 46 seconds.
was (Author: yjxxtd):
[~szetszwo] Hi, with the RATIS-1372 and RATIS-1373, streaming's performance is almost similar to HDFS when without writting disk.
1. When write 200files * 128MB, packet size is 4MB, both streaming and hdfs cost about 22 seconds, i.e. about 1163MB, which is the max bandwidth of network interface card.
2. When write 400files * 128MB, packet size is 4MB, both streaming and hdfs cost about 46 seconds.
> Compare the performance between HDFS and DataStreamApi
> ------------------------------------------------------
>
> Key: RATIS-1312
> URL: https://issues.apache.org/jira/browse/RATIS-1312
> Project: Ratis
> Issue Type: Sub-task
> Reporter: runzhiwang
> Assignee: runzhiwang
> Priority: Major
> Attachments: hdfs.svg, image-2021-03-10-11-23-19-681.png, image-2021-03-10-11-23-42-092.png, screenshot-1.png, screenshot-2.png, streaming.svg
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)