You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Ryan LeCompte <le...@gmail.com> on 2010/02/04 15:51:32 UTC

Concurrently load data into Hive tables?

Hey guys,

Is it possible to concurrently load data into Hive tables (same table,
different partition)? I'd like to concurrently execute the LOAD DATA command
by two separate processes.

Is Hive thread-safe in this regard? Or is it best to run the LOAD DATA
commands serially? How about running two Hive queries concurrently that both
output their results into different partitions of another Hive table?

Thanks!

Ryan

Re: Concurrently load data into Hive tables?

Posted by Ryan LeCompte <le...@gmail.com>.

Thanks boss!!


On Thu, Feb 4, 2010 at 12:42 PM, Zheng Shao <zs...@gmail.com> wrote:

> We can load data/insert overwrite data concurrently as long as they
> are different partitions.
>
> On Thu, Feb 4, 2010 at 6:51 AM, Ryan LeCompte <le...@gmail.com> wrote:
> > Hey guys,
> >
> > Is it possible to concurrently load data into Hive tables (same table,
> > different partition)? I'd like to concurrently execute the LOAD DATA
> command
> > by two separate processes.
> >
> > Is Hive thread-safe in this regard? Or is it best to run the LOAD DATA
> > commands serially? How about running two Hive queries concurrently that
> both
> > output their results into different partitions of another Hive table?
> >
> > Thanks!
> >
> > Ryan
> >
> >
>
>
>
> --
> Yours,
> Zheng
>

Re: Concurrently load data into Hive tables?

Posted by Zheng Shao <zs...@gmail.com>.

We can load data/insert overwrite data concurrently as long as they
are different partitions.

On Thu, Feb 4, 2010 at 6:51 AM, Ryan LeCompte <le...@gmail.com> wrote:
> Hey guys,
>
> Is it possible to concurrently load data into Hive tables (same table,
> different partition)? I'd like to concurrently execute the LOAD DATA command
> by two separate processes.
>
> Is Hive thread-safe in this regard? Or is it best to run the LOAD DATA
> commands serially? How about running two Hive queries concurrently that both
> output their results into different partitions of another Hive table?
>
> Thanks!
>
> Ryan
>
>



-- 
Yours,
Zheng