You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Nitin Pawar <ni...@gmail.com> on 2013/05/30 14:10:45 UTC
Re:
set mapred.job.queue.name=<queue-name>;
above property will set the queue for that particular hive session. This
property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
> Hi All,
> I amin a team developing hadoop with hive.
> we are using fair schedeuler.
> but all hive jobs are going to same pool whose name is same as username of
> where hive server installed.
>
> this is all about,
>
> my hive server is in user named 'hadoop'.
> my hive client program in user named 'abc'.
> but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive
> server location)
>
> Becouse of this i am not getiing equal resource sharing.
>
> can we submit job to hive by specify pool name?
>
> The same in the case if i used capacity scheduler.. All jobs from hive
> client are going to the 'dfault' queue.
>
> Thanks in advance.
> **
> *Job M Thomas*
>
--
Nitin Pawar
Re:
Posted by be...@gmail.com.
Job,
You need to set in on every hive session/CLI client.
This property is a job level one and it is used to indicate which pool/queue a job should be submitted on to.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: "Job Thomas" <jo...@suntecgroup.com>
Date: Thu, 30 May 2013 18:03:53
To: <us...@hadoop.apache.org>; Nitin Pawar<ni...@gmail.com>
Reply-To: user@hadoop.apache.org
Subject: RE:
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar
Re:
Posted by be...@gmail.com.
Job,
You need to set in on every hive session/CLI client.
This property is a job level one and it is used to indicate which pool/queue a job should be submitted on to.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: "Job Thomas" <jo...@suntecgroup.com>
Date: Thu, 30 May 2013 18:03:53
To: <us...@hadoop.apache.org>; Nitin Pawar<ni...@gmail.com>
Reply-To: user@hadoop.apache.org
Subject: RE:
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar
Re:
Posted by be...@gmail.com.
Job,
You need to set in on every hive session/CLI client.
This property is a job level one and it is used to indicate which pool/queue a job should be submitted on to.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: "Job Thomas" <jo...@suntecgroup.com>
Date: Thu, 30 May 2013 18:03:53
To: <us...@hadoop.apache.org>; Nitin Pawar<ni...@gmail.com>
Reply-To: user@hadoop.apache.org
Subject: RE:
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar
Re:
Posted by be...@gmail.com.
Job,
You need to set in on every hive session/CLI client.
This property is a job level one and it is used to indicate which pool/queue a job should be submitted on to.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: "Job Thomas" <jo...@suntecgroup.com>
Date: Thu, 30 May 2013 18:03:53
To: <us...@hadoop.apache.org>; Nitin Pawar<ni...@gmail.com>
Reply-To: user@hadoop.apache.org
Subject: RE:
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar
RE:
Posted by Job Thomas <jo...@suntecgroup.com>.
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar
RE:
Posted by Job Thomas <jo...@suntecgroup.com>.
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar
RE:
Posted by Job Thomas <jo...@suntecgroup.com>.
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar
RE:
Posted by Job Thomas <jo...@suntecgroup.com>.
Hi brother ,
May I know where Should I set the property set mapred.job.queue.name <https://webmail.suntecsbs.com/exchweb/bin/redir.asp?URL=http://mapred.job.queue.name> =<queue-name>;
In hive client or Hive server ( here thrift server is up) or in hadoop ?
Best Regards,
Job M Thomas
________________________________
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Thu 5/30/2013 5:40 PM
To: user@hadoop.apache.org
Subject: Re:
set mapred.job.queue.name <http://mapred.job.queue.name/> =<queue-name>;
above property will set the queue for that particular hive session. This property needs to be set by all users using.
On Thu, May 30, 2013 at 5:18 PM, Job Thomas <jo...@suntecgroup.com> wrote:
Hi All,
I amin a team developing hadoop with hive.
we are using fair schedeuler.
but all hive jobs are going to same pool whose name is same as username of where hive server installed.
this is all about,
my hive server is in user named 'hadoop'.
my hive client program in user named 'abc'.
but all jobs in hadoop are in the pool named 'hadoop'. (user name of hive server location)
Becouse of this i am not getiing equal resource sharing.
can we submit job to hive by specify pool name?
The same in the case if i used capacity scheduler.. All jobs from hive client are going to the 'dfault' queue.
Thanks in advance.
Job M Thomas
--
Nitin Pawar