GetTables is very slow when the table number is large

[葱子 <fx...@gmail.com>]

Hi All

    Recently I try to use Olap4j driver to connect a Hive warehouse. The
Olap4j will try to get all tables when establish the connection( there are
2000-3000 tables in this DW) it will get the connect hang and never return.

    I am wonder if there max limited size of tables for a GetTables API, if
not, how to fast up the API?  Thanks in advance.

-Lucas

Re: GetTables is very slow when the table number is large

[Ashu Pachauri <as...@rocketfuelinc.com>]

There is a max limit size for the number of tables (maxRows) but it does
not help because the call internally fetches all the table objects and then
truncates the result set based on the maxRows argument. So, it is dependent
only on the total number of tables your database has.

I have also been experiencing this issue. It is very very slow, basically
it is unusable.


On Sun, Jul 6, 2014 at 9:42 PM, 葱子 <fx...@gmail.com> wrote:

> Hi All
>
>     Recently I try to use Olap4j driver to connect a Hive warehouse. The
> Olap4j will try to get all tables when establish the connection( there are
> 2000-3000 tables in this DW) it will get the connect hang and never return.
>
>     I am wonder if there max limited size of tables for a GetTables API,
> if not, how to fast up the API?  Thanks in advance.
>
> -Lucas
>



-- 
Thanks and Regards,
Ashu Pachauri
Rocket Scientist,
Rocket Fuel Inc.
1- 650 - 200- 5390