You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by VanHuy Pham <hu...@gmail.com> on 2012/06/29 22:33:15 UTC
Thrift Server
Hi hive folks,
Does hive thrift server support multiple requests from clients at the
same time?
It looks like the server serves the request sequentially, which means
it processes each request one by one. Am I wrong here?
I make two clients, which make two requests (select data) to two
different in hive; judging by the terminal screen of the hive server, it
processes one request, finishes it, and process the other.
Van
Re: Thrift Server
Posted by VanHuy Pham <hu...@gmail.com>.
Mark,
JDBC does not talk to hive via thrift server. I shut down the thrift
server, JDBC still works. However, you might be right in the case of
non-local connection, or as they call "standalone mode".
Van
On Thu, Jul 5, 2012 at 8:47 PM, Mark Grover <mg...@oanda.com> wrote:
> Hi Ransom,
> JDBC talks to the Hive driver via the Hive Thrift server. Since the thrift
> server is limited to single connection at a time, out of curiosity, how
> much benefit do concurrent connections through JDBC give you, given that
> they will also be handled serially when being sent to the Thrift server?
>
> Thanks in advance!
> Mark
>
> ----- Original Message -----
> From: "Hezhiqiang (Ransom)" <ra...@huawei.com>
> To: user@hive.apache.org
> Cc: "Zhaojun (Terry)" <te...@huawei.com>
> Sent: Friday, June 29, 2012 9:31:01 PM
> Subject: RE: Thrift Server
>
> Hi Van
> In my test, JDBC supported about 25 connections in the same time without
> delay.
> If more connections , it will line up and timeout exception will happen.
>
>
> Regards
> Ransom
>
>
>
> -----Original Message-----
> From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
> Sent: Saturday, June 30, 2012 8:59 AM
> To: user@hive.apache.org
> Subject: Re: Thrift Server
>
> Thanks for the response.
> I see. Would JDBC then be a better option for concurrent connections?
> I am not aware of the implementation of hive-JDBC so wonder if it
> support multiple connections?
> Any idea?
>
> On 6/29/12, Hezhiqiang (Ransom) <ra...@huawei.com> wrote:
> > Hi Van
> > Hive doesn’t supported multiple connections now.
> > it's impossible for HiveServer to support concurrent connections
> > using the current Thrift API
> > you can see:
> > https://issues.apache.org/jira/browse/HIVE-2935
> >
> https://cwiki.apache.org/confluence/download/attachments/27362054/HiveServer2HadoopSummit2012BoF.pdf?version=1&modificationDate=1339790767000
> >
> >
> > From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
> > Sent: Saturday, June 30, 2012 4:33 AM
> > To: user@hive.apache.org
> > Subject: Thrift Server
> >
> > Hi hive folks,
> > Does hive thrift server support multiple requests from clients at the
> > same time?
> > It looks like the server serves the request sequentially, which
> means it
> > processes each request one by one. Am I wrong here?
> > I make two clients, which make two requests (select data) to two
> > different in hive; judging by the terminal screen of the hive server, it
> > processes one request, finishes it, and process the other.
> >
> > Van
> >
>
Re: Thrift Server
Posted by Mark Grover <mg...@oanda.com>.
Hi Ransom,
JDBC talks to the Hive driver via the Hive Thrift server. Since the thrift server is limited to single connection at a time, out of curiosity, how much benefit do concurrent connections through JDBC give you, given that they will also be handled serially when being sent to the Thrift server?
Thanks in advance!
Mark
----- Original Message -----
From: "Hezhiqiang (Ransom)" <ra...@huawei.com>
To: user@hive.apache.org
Cc: "Zhaojun (Terry)" <te...@huawei.com>
Sent: Friday, June 29, 2012 9:31:01 PM
Subject: RE: Thrift Server
Hi Van
In my test, JDBC supported about 25 connections in the same time without delay.
If more connections , it will line up and timeout exception will happen.
Regards
Ransom
-----Original Message-----
From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
Sent: Saturday, June 30, 2012 8:59 AM
To: user@hive.apache.org
Subject: Re: Thrift Server
Thanks for the response.
I see. Would JDBC then be a better option for concurrent connections?
I am not aware of the implementation of hive-JDBC so wonder if it
support multiple connections?
Any idea?
On 6/29/12, Hezhiqiang (Ransom) <ra...@huawei.com> wrote:
> Hi Van
> Hive doesn’t supported multiple connections now.
> it's impossible for HiveServer to support concurrent connections
> using the current Thrift API
> you can see:
> https://issues.apache.org/jira/browse/HIVE-2935
> https://cwiki.apache.org/confluence/download/attachments/27362054/HiveServer2HadoopSummit2012BoF.pdf?version=1&modificationDate=1339790767000
>
>
> From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
> Sent: Saturday, June 30, 2012 4:33 AM
> To: user@hive.apache.org
> Subject: Thrift Server
>
> Hi hive folks,
> Does hive thrift server support multiple requests from clients at the
> same time?
> It looks like the server serves the request sequentially, which means it
> processes each request one by one. Am I wrong here?
> I make two clients, which make two requests (select data) to two
> different in hive; judging by the terminal screen of the hive server, it
> processes one request, finishes it, and process the other.
>
> Van
>
RE: Thrift Server
Posted by "Hezhiqiang (Ransom)" <ra...@huawei.com>.
Hi Van
In my test, JDBC supported about 25 connections in the same time without delay.
If more connections , it will line up and timeout exception will happen.
Regards
Ransom
-----Original Message-----
From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
Sent: Saturday, June 30, 2012 8:59 AM
To: user@hive.apache.org
Subject: Re: Thrift Server
Thanks for the response.
I see. Would JDBC then be a better option for concurrent connections?
I am not aware of the implementation of hive-JDBC so wonder if it
support multiple connections?
Any idea?
On 6/29/12, Hezhiqiang (Ransom) <ra...@huawei.com> wrote:
> Hi Van
> Hive doesn’t supported multiple connections now.
> it's impossible for HiveServer to support concurrent connections
> using the current Thrift API
> you can see:
> https://issues.apache.org/jira/browse/HIVE-2935
> https://cwiki.apache.org/confluence/download/attachments/27362054/HiveServer2HadoopSummit2012BoF.pdf?version=1&modificationDate=1339790767000
>
>
> From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
> Sent: Saturday, June 30, 2012 4:33 AM
> To: user@hive.apache.org
> Subject: Thrift Server
>
> Hi hive folks,
> Does hive thrift server support multiple requests from clients at the
> same time?
> It looks like the server serves the request sequentially, which means it
> processes each request one by one. Am I wrong here?
> I make two clients, which make two requests (select data) to two
> different in hive; judging by the terminal screen of the hive server, it
> processes one request, finishes it, and process the other.
>
> Van
>
Re: Thrift Server
Posted by VanHuy Pham <hu...@gmail.com>.
Thanks for the response.
I see. Would JDBC then be a better option for concurrent connections?
I am not aware of the implementation of hive-JDBC so wonder if it
support multiple connections?
Any idea?
On 6/29/12, Hezhiqiang (Ransom) <ra...@huawei.com> wrote:
> Hi Van
> Hive doesn’t supported multiple connections now.
> it's impossible for HiveServer to support concurrent connections
> using the current Thrift API
> you can see:
> https://issues.apache.org/jira/browse/HIVE-2935
> https://cwiki.apache.org/confluence/download/attachments/27362054/HiveServer2HadoopSummit2012BoF.pdf?version=1&modificationDate=1339790767000
>
>
> From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
> Sent: Saturday, June 30, 2012 4:33 AM
> To: user@hive.apache.org
> Subject: Thrift Server
>
> Hi hive folks,
> Does hive thrift server support multiple requests from clients at the
> same time?
> It looks like the server serves the request sequentially, which means it
> processes each request one by one. Am I wrong here?
> I make two clients, which make two requests (select data) to two
> different in hive; judging by the terminal screen of the hive server, it
> processes one request, finishes it, and process the other.
>
> Van
>
RE: Thrift Server
Posted by "Hezhiqiang (Ransom)" <ra...@huawei.com>.
Hi Van
Hive doesn’t supported multiple connections now.
it's impossible for HiveServer to support concurrent connections using the current Thrift API
you can see:
https://issues.apache.org/jira/browse/HIVE-2935
https://cwiki.apache.org/confluence/download/attachments/27362054/HiveServer2HadoopSummit2012BoF.pdf?version=1&modificationDate=1339790767000
From: VanHuy Pham [mailto:huy.pham.sc@gmail.com]
Sent: Saturday, June 30, 2012 4:33 AM
To: user@hive.apache.org
Subject: Thrift Server
Hi hive folks,
Does hive thrift server support multiple requests from clients at the same time?
It looks like the server serves the request sequentially, which means it processes each request one by one. Am I wrong here?
I make two clients, which make two requests (select data) to two different in hive; judging by the terminal screen of the hive server, it processes one request, finishes it, and process the other.
Van