You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Siva <sb...@gmail.com> on 2015/03/06 00:03:31 UTC
Hbase ImportTSV runs in parallel?
Hi All,
I’m loading data to Hbase by using Hbase ImportTsv utility. When I kick off
this process simultaneously for different tables in different sessions,
both the process starts in parallel till it reaches the map reduce program.
Once one of the process kicks off map reduce job for one table, other
process waits till the first one finishes.
Both the processes executes in parallel till it reaches MR phase, from
there onwards they becomes sequential. Is there any limitation in Hbase
that only one table should load through bulk loader at a time or is there a
property in hbase that controls this feature?
I want to load the different tables at same time by using bulk loader. Any
help in this regard is appreciated.
Thanks in advance.
Thanks,
Siva.
Re: Hbase ImportTSV runs in parallel?
Posted by Siva <sb...@gmail.com>.
Thanks Vlad for your input, I m working with our admin to resolve.
Thanks,
Siva.
On Thu, Mar 5, 2015 at 3:57 PM, Vladimir Rodionov <vl...@gmail.com>
wrote:
> Search google "how to run jobs in parallel in Hadoop"
>
> Your mapreduce configuration allows you to run one job at a time. This
> usually happens
> when number of job's tasks exceeds capacity of a cluster.
>
> -Vlad
>
> On Thu, Mar 5, 2015 at 3:03 PM, Siva <sb...@gmail.com> wrote:
>
> > Hi All,
> >
> >
> >
> > I’m loading data to Hbase by using Hbase ImportTsv utility. When I kick
> off
> > this process simultaneously for different tables in different sessions,
> > both the process starts in parallel till it reaches the map reduce
> program.
> > Once one of the process kicks off map reduce job for one table, other
> > process waits till the first one finishes.
> >
> >
> >
> > Both the processes executes in parallel till it reaches MR phase, from
> > there onwards they becomes sequential. Is there any limitation in Hbase
> > that only one table should load through bulk loader at a time or is
> there a
> > property in hbase that controls this feature?
> >
> >
> >
> > I want to load the different tables at same time by using bulk loader.
> Any
> > help in this regard is appreciated.
> >
> >
> >
> > Thanks in advance.
> >
> >
> >
> > Thanks,
> >
> > Siva.
> >
>
Re: Hbase ImportTSV runs in parallel?
Posted by Siva <sb...@gmail.com>.
Thanks Vlad for your input, I m working with our admin to resolve.
Thanks,
Siva.
On Thu, Mar 5, 2015 at 3:57 PM, Vladimir Rodionov <vl...@gmail.com>
wrote:
> Search google "how to run jobs in parallel in Hadoop"
>
> Your mapreduce configuration allows you to run one job at a time. This
> usually happens
> when number of job's tasks exceeds capacity of a cluster.
>
> -Vlad
>
> On Thu, Mar 5, 2015 at 3:03 PM, Siva <sb...@gmail.com> wrote:
>
> > Hi All,
> >
> >
> >
> > I’m loading data to Hbase by using Hbase ImportTsv utility. When I kick
> off
> > this process simultaneously for different tables in different sessions,
> > both the process starts in parallel till it reaches the map reduce
> program.
> > Once one of the process kicks off map reduce job for one table, other
> > process waits till the first one finishes.
> >
> >
> >
> > Both the processes executes in parallel till it reaches MR phase, from
> > there onwards they becomes sequential. Is there any limitation in Hbase
> > that only one table should load through bulk loader at a time or is
> there a
> > property in hbase that controls this feature?
> >
> >
> >
> > I want to load the different tables at same time by using bulk loader.
> Any
> > help in this regard is appreciated.
> >
> >
> >
> > Thanks in advance.
> >
> >
> >
> > Thanks,
> >
> > Siva.
> >
>
Re: Hbase ImportTSV runs in parallel?
Posted by Vladimir Rodionov <vl...@gmail.com>.
Search google "how to run jobs in parallel in Hadoop"
Your mapreduce configuration allows you to run one job at a time. This
usually happens
when number of job's tasks exceeds capacity of a cluster.
-Vlad
On Thu, Mar 5, 2015 at 3:03 PM, Siva <sb...@gmail.com> wrote:
> Hi All,
>
>
>
> I’m loading data to Hbase by using Hbase ImportTsv utility. When I kick off
> this process simultaneously for different tables in different sessions,
> both the process starts in parallel till it reaches the map reduce program.
> Once one of the process kicks off map reduce job for one table, other
> process waits till the first one finishes.
>
>
>
> Both the processes executes in parallel till it reaches MR phase, from
> there onwards they becomes sequential. Is there any limitation in Hbase
> that only one table should load through bulk loader at a time or is there a
> property in hbase that controls this feature?
>
>
>
> I want to load the different tables at same time by using bulk loader. Any
> help in this regard is appreciated.
>
>
>
> Thanks in advance.
>
>
>
> Thanks,
>
> Siva.
>
Re: Hbase ImportTSV runs in parallel?
Posted by Vladimir Rodionov <vl...@gmail.com>.
Search google "how to run jobs in parallel in Hadoop"
Your mapreduce configuration allows you to run one job at a time. This
usually happens
when number of job's tasks exceeds capacity of a cluster.
-Vlad
On Thu, Mar 5, 2015 at 3:03 PM, Siva <sb...@gmail.com> wrote:
> Hi All,
>
>
>
> I’m loading data to Hbase by using Hbase ImportTsv utility. When I kick off
> this process simultaneously for different tables in different sessions,
> both the process starts in parallel till it reaches the map reduce program.
> Once one of the process kicks off map reduce job for one table, other
> process waits till the first one finishes.
>
>
>
> Both the processes executes in parallel till it reaches MR phase, from
> there onwards they becomes sequential. Is there any limitation in Hbase
> that only one table should load through bulk loader at a time or is there a
> property in hbase that controls this feature?
>
>
>
> I want to load the different tables at same time by using bulk loader. Any
> help in this regard is appreciated.
>
>
>
> Thanks in advance.
>
>
>
> Thanks,
>
> Siva.
>