You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Yibo Cai (Jira)" <ji...@apache.org> on 2022/01/18 05:30:00 UTC
[jira] [Comment Edited] (ARROW-15229) [C++][FlightRPC] Evaluate UCX/RDMA transport performance
[ https://issues.apache.org/jira/browse/ARROW-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477580#comment-17477580 ]
Yibo Cai edited comment on ARROW-15229 at 1/18/22, 5:29 AM:
------------------------------------------------------------
*UCX/RDMA benchmark*
_higher speed and flat latency_
{code:bash}
server:~$ UCX_TLS=rc_x UCX_NET_DEVICES=mlx5_3:1 release/arrow-flight-perf-server --server-host 10.10.222.102 -transport=ucx
Server location: ucx://10.10.222.102:31337
Server host: 10.10.222.102
Server port: 31337
client:~$ UCX_TLS=rc_x UCX_NET_DEVICES=mlx5_1:1 release/arrow-flight-benchmark -server_host 10.10.222.102 -num_streams=1 -num_threads=1 -records_per_stream=123456789 -transport ucx
Testing method: DoGet
Number of perf runs: 1
Number of concurrent gets/puts: 1
Batch size: 131071
Batches read: 30141
Bytes read: 3950617248
Nanos: 968867736
Speed: 3888.67 MB/s
Throughput: 31109.5 batches/s
Latency mean: 30 us
Latency quantile=0.5: 30 us
Latency quantile=0.95: 31 us
Latency quantile=0.99: 33 us
Latency max: 606 us
{code}
was (Author: yibo):
*UCX/RDMA benchmark*
{code:bash}
server:~$ UCX_TLS=rc_x UCX_NET_DEVICES=mlx5_3:1 release/arrow-flight-perf-server --server-host 10.10.222.102 -transport=ucx
Server location: ucx://10.10.222.102:31337
Server host: 10.10.222.102
Server port: 31337
client:~$ UCX_TLS=rc_x UCX_NET_DEVICES=mlx5_1:1 release/arrow-flight-benchmark -server_host 10.10.222.102 -num_streams=1 -num_threads=1 -records_per_stream=123456789 -transport ucx
Testing method: DoGet
Number of perf runs: 1
Number of concurrent gets/puts: 1
Batch size: 131071
Batches read: 30141
Bytes read: 3950617248
Nanos: 968867736
Speed: 3888.67 MB/s
Throughput: 31109.5 batches/s
Latency mean: 30 us
Latency quantile=0.5: 30 us
Latency quantile=0.95: 31 us
Latency quantile=0.99: 33 us
Latency max: 606 us
{code}
> [C++][FlightRPC] Evaluate UCX/RDMA transport performance
> --------------------------------------------------------
>
> Key: ARROW-15229
> URL: https://issues.apache.org/jira/browse/ARROW-15229
> Project: Apache Arrow
> Issue Type: Task
> Components: C++, FlightRPC
> Reporter: Yibo Cai
> Assignee: Yibo Cai
> Priority: Major
>
> Evaluate FlgihtRPC UCX transport performance over 100Gb/RDMA network, based on https://github.com/lidavidm/arrow/tree/flight-ucx.
> cc [~lidavidm], will be great if you can give a stable branch (or commit id) for evaluation purpose.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)