Suggestions on deploying Arrow Flight gRPC Server

[Susmit Sarkar <su...@gmail.com>]

Hello Community,

We have built an Arrow flight (Python 3.9) server

Now polyglot clients will query the flight server

pyarrow==17.0.0
grpcio==1.67.0

What is the ideal deployment strategy in a production environment?

Currently our flight server is deployed in a kubernetes cluster with 3
pods, behind a Load balancer.

Came across this article, which made me ask this forum in specific

https://kubernetes.io/blog/2018/11/07/grpc-load-balancing-on-kubernetes-without-tears/#why-does-grpc-need-special-load-balancing

Suggestions are welcome!!

Wishes & Regards
Susmit

Re: Suggestions on deploying Arrow Flight gRPC Server

[David Li <li...@apache.org>]

I think that's a bit broad of a question to answer. In general, you are best off following advice meant for gRPC and your particular environment (Kubernetes or otherwise); Flight does not change that aspect of gRPC. If you have specific questions about gRPC vis-a-vis Flight (e.g. how to enable a particular load balancing configuration) we may be able to help better.

On Mon, Oct 28, 2024, at 05:12, Susmit Sarkar wrote:
> Hello Community,
>
> We have built an Arrow flight (Python 3.9) server
>
> Now polyglot clients will query the flight server
>
> pyarrow==17.0.0
> grpcio==1.67.0
>
> What is the ideal deployment strategy in a production environment?
>
> Currently our flight server is deployed in a kubernetes cluster with 3
> pods, behind a Load balancer.
>
> Came across this article, which made me ask this forum in specific
>
> https://kubernetes.io/blog/2018/11/07/grpc-load-balancing-on-kubernetes-without-tears/#why-does-grpc-need-special-load-balancing
>
> Suggestions are welcome!!
>
> Wishes & Regards
> Susmit