[jira] [Resolved] (ARROW-7200) [C++][Flight] Running Arrow Flight benchmark on two hosts doesn't work

["Wes McKinney (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney resolved ARROW-7200.
---------------------------------
    Resolution: Fixed

Resolved in https://github.com/apache/arrow/commit/2a9e6c6dafe8f0c88589d7f961da5c07bfaaf5cf

> [C++][Flight] Running Arrow Flight benchmark on two hosts doesn't work
> ----------------------------------------------------------------------
>
>                 Key: ARROW-7200
>                 URL: https://issues.apache.org/jira/browse/ARROW-7200
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Benchmarking, C++, FlightRPC
>    Affects Versions: 0.15.0, 0.15.1
>         Environment: AWS EC2
> Instance type: t3a.xlarge
> AMI: ubuntu/images/hvm-ssd/ubuntu-bionic-18.04-amd64-server-20191002
> Number of instances: 2
> They are capable of pinging each other.
>            Reporter: Chengxin Ma
>            Assignee: Chengxin Ma
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.0.0
>
>         Attachments: Screen Shot 2019-11-18 at 16.00.38.png, Screen Shot 2019-11-19 at 14.41.40.png
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> I was trying to evaluate the performance of Apache Arrow Flight on two hosts (one as the client and the other one as the server), using [the official benchmark|[https://github.com/apache/arrow/blob/master/cpp/src/arrow/flight/flight_benchmark.cc]].
> Flags I used to build the project were:
>  
> {code:java}
> -DARROW_FLIGHT=ON
> -DCMAKE_BUILD_TYPE=Debug
> -DARROW_BUILD_BENCHMARKS=ON
> {code}
>  
> The branch I used was maint-0.15.x since there was a build error on the master branch. _(The build error on master only existed in the environment where I set up two hosts: AWS. On my local environment (macOS) the build was successful on the master branch. I don't think this build error is relevant to the issue since there is no difference in the cpp source code.)_
> On the host acting as the server, I ran 
> {code:java}
> ./arrow-flight-perf-server{code}
> On the host acting as the client, I ran 
> {code:java}
> ./arrow-flight-benchmark --server_host ip-172-31-11-18{code}
> It gives the following error: 
> {code:java}
> Failed with error: << IOError: gRPC returned unavailable error, with message: Connect Failed. Detail: Unavailable{code}
>  
>  If I ran 
> {code:java}
> ./arrow-flight-benchmark --server_host ip-172-31-11-17{code}
> the error will be different:
> {code:java}
> IOError: Server was not available after 10 attempts{code}
> This is understandable since this host doesn't exist at all.
> This indicates that Flight is able to find the existing host (ip-172-31-11-18), but the communication somehow didn't succeed.
> The benchmark works fine if I run it with the localhost, either by not specifying the server_host flag or running the server in another process on the same host.
> I am not sure if the problem is in the environment or in the code itself. Could someone please give me some hint on how to resolve the problem?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)