You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Tim Bittersohl <ti...@innoplexia.com> on 2013/02/27 18:36:09 UTC
Get the job id for a hive query
Hi,
has the Hive client the possibility to give back the job id of the job
created when running a query? I need that for tracking.
Greetings
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033
Fax: +49 (0) 6221 7198034
Web: <http://www.innoplexia.com/> www.innoplexia.com
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
RE: Get the job id for a hive query
Posted by Todd Wilson <to...@coffingdw.com>.
Hello everyone:
Im confused on how to alias a column. Using Hive .9.
Im running the below sql to try to query an index table and Im getting the
following error.
SELECT
customer_number
, _bucketname
, _offsets
FROM
default.default__customer_table_idx_customer_table__
;
ERROR [HY000] [MapR][Hardy] (22) Error from ThriftHiveClient: Query returned
non-zero code: 40000, cause: FAILED: ParseException line 4:3 mismatched
input ',' expecting \' near '_bucketname' in character string literal
SELECT Command Failed.
A SELECT * on the table will bring back column _bucketname and _offsets.
This is what I want because those are the columns names.
How can I alias these columns _bucketname and _offesets to bring back their
names without running in to this error? Im assuming you need to use \ to
escape the underscore, but so far Ive not figured out how to do it. :/
Best Regards,
Todd Wilson
Senior Technical Consultant
Coffing Data Warehousing
(513) 292-3158
<http://www.coffingdw.com/> www.CoffingDW.com
********************************
The information contained in this communication is confidential, private,
proprietary, or otherwise privileged and is intended only for the use of the
addressee. Unauthorized use, disclosure, distribution or copying is strictly
prohibited and may be unlawful. If you have received this communication in
error, please notify the sender immediately at
<ma...@coffingdw.com> general@coffingdw.com.
*********************************
From: Tim Bittersohl [mailto:tim@innoplexia.com]
Sent: Wednesday, February 27, 2013 11:36 AM
To: user@hive.apache.org
Subject: Get the job id for a hive query
Hi,
has the Hive client the possibility to give back the job id of the job
created when running a query? I need that for tracking.
Greetings
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033
Fax: +49 (0) 6221 7198034
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Re: Get the job id for a hive query
Posted by Nitin Pawar <ni...@gmail.com>.
select statement without where clause is just a hdfs cat command. It will
not run mapreduce for that.
On Tue, Mar 5, 2013 at 5:48 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
> Ok, it works.****
>
> For testing, I fired a create table command and a select without a where
> clause. Both don’t result in MapReduce jobs... with a where clause, there
> is a job created now.****
>
> ** **
>
> Thanks****
>
> ** **
>
> ** **
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Dienstag, 5. März 2013 12:48
>
> *An:* user@hive.apache.org
> *Betreff:* Re: Get the job id for a hive query****
>
> ** **
>
> if the job is submitted to hadoop, it will come up on jobtracker. ****
>
> Unless you are slow on tracking and your job history retaining is 0, each
> hive query submitted to jobtracker will be there on jobhistory ****
>
> ** **
>
> On Tue, Mar 5, 2013 at 4:58 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
> ****
>
> Hi,****
>
> ****
>
> I do have the following problem monitoring my Hive queries in Hadoop.****
>
> ****
>
> I create a Sever using the Hive library which connects to an Hadoop
> cluster (file system, job tracker and Hive metastore are set up on this
> cluster). The needed parameters for the Hive server I've set in the
> configuration.****
>
> Commands sent to this server are executed, that works.****
>
> The problem now is that the MapReduce jobs created by Hive don't appear in
> the job tracker's job list. The list itself works, showing me other
> commands I executed not using Hive. (I use the JobClient Java class to get
> the list)****
>
> ****
>
> Why are the Hive query jobs not in the list? How can I track them in
> Hadoop?****
>
> ****
>
> ****
>
> Thanks****
>
> ****
>
> ****
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 16:13****
>
>
> *An:* user@hive.apache.org
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> you can set this property mapred.job.name and this should set the name
> for the job ****
>
> ****
>
> On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> Thanks for the response,****
>
> ****
>
> I also found no way to access the job id via java thrift client, all I can
> get is a query ID by the query planner.****
>
> ****
>
> How to set the name of a job where a Hive query is fired with, so I can
> find it in the job tracker later?****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 15:46****
>
>
> *An:* user@hive.apache.org
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> With thrift Client I don't think you can get the jobID from hadoop (I may
> very well be wrong in this)****
>
> ****
>
> the other way around this was to have a separate name for each job you
> fire through hive and then directly query jobtracker for the same ****
>
> ****
>
> On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> I use java and there HiveClient of the hive library (Version 0.10.0).****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 12:43
> *An:* user@hive.apache.org****
>
>
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> how are you running your hive queries? using hive cli or hive jdbc client?
> ****
>
> ****
>
> if you are using hive cli then whenever you fire a query and assuming it
> is syntactically correct and its not select * from table operation ****
>
> hive cli shows the job ID and an URL which points to the job tracker url
> for the job it submitted ****
>
> ****
>
> On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> I’m trying to get the job id of the job created with a Hive query.****
>
> At the moment I can get the cluster status from the HiveClient, but I don’
> find any job id in there... ****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Harsh J [mailto:harsh@cloudera.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 09:08
> *An:* hive request
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> The client logs print the Job ID of the spawned job and a tracking URL. Is
> that what you're looking for? Its printed for each stage.****
>
> ****
>
> On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> Hi,****
>
> ****
>
> has the Hive client the possibility to give back the job id of the job
> created when running a query? I need that for tracking.****
>
> ****
>
> ****
>
> Greetings****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
>
>
> ****
>
> ****
>
> --
> Harsh J ****
>
>
>
> ****
>
> ****
>
> --
> Nitin Pawar****
>
>
>
> ****
>
> ****
>
> --
> Nitin Pawar****
>
>
>
> ****
>
> ****
>
> --
> Nitin Pawar****
>
>
>
> ****
>
> ** **
>
> --
> Nitin Pawar****
>
--
Nitin Pawar
AW: Get the job id for a hive query
Posted by Tim Bittersohl <ti...@innoplexia.com>.
Ok, it works.
For testing, I fired a create table command and a select without a where
clause. Both dont result in MapReduce jobs... with a where clause, there is
a job created now.
Thanks
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Dienstag, 5. März 2013 12:48
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
if the job is submitted to hadoop, it will come up on jobtracker.
Unless you are slow on tracking and your job history retaining is 0, each
hive query submitted to jobtracker will be there on jobhistory
On Tue, Mar 5, 2013 at 4:58 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Hi,
I do have the following problem monitoring my Hive queries in Hadoop.
I create a Sever using the Hive library which connects to an Hadoop cluster
(file system, job tracker and Hive metastore are set up on this cluster).
The needed parameters for the Hive server I've set in the configuration.
Commands sent to this server are executed, that works.
The problem now is that the MapReduce jobs created by Hive don't appear in
the job tracker's job list. The list itself works, showing me other commands
I executed not using Hive. (I use the JobClient Java class to get the list)
Why are the Hive query jobs not in the list? How can I track them in Hadoop?
Thanks
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 16:13
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
you can set this property mapred.job.name and this should set the name for
the job
On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Thanks for the response,
I also found no way to access the job id via java thrift client, all I can
get is a query ID by the query planner.
How to set the name of a job where a Hive query is fired with, so I can find
it in the job tracker later?
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 15:46
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
With thrift Client I don't think you can get the jobID from hadoop (I may
very well be wrong in this)
the other way around this was to have a separate name for each job you fire
through hive and then directly query jobtracker for the same
On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
I use java and there HiveClient of the hive library (Version 0.10.0).
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 12:43
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
how are you running your hive queries? using hive cli or hive jdbc client?
if you are using hive cli then whenever you fire a query and assuming it is
syntactically correct and its not select * from table operation
hive cli shows the job ID and an URL which points to the job tracker url
for the job it submitted
On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Im trying to get the job id of the job created with a Hive query.
At the moment I can get the cluster status from the HiveClient, but I don
find any job id in there...
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Harsh J [mailto:harsh@cloudera.com]
Gesendet: Donnerstag, 28. Februar 2013 09:08
An: hive request
Betreff: Re: Get the job id for a hive query
The client logs print the Job ID of the spawned job and a tracking URL. Is
that what you're looking for? Its printed for each stage.
On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Hi,
has the Hive client the possibility to give back the job id of the job
created when running a query? I need that for tracking.
Greetings
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606
<tel:32494%2F62606> - USt. IdNr.: DE 272 871 728 - Geschäftsführer:
Christian Schneider, Walery Strauch, Prof. Dr. Herbert Schuster
--
Harsh J
--
Nitin Pawar
--
Nitin Pawar
--
Nitin Pawar
--
Nitin Pawar
Re: Get the job id for a hive query
Posted by Nitin Pawar <ni...@gmail.com>.
if the job is submitted to hadoop, it will come up on jobtracker.
Unless you are slow on tracking and your job history retaining is 0, each
hive query submitted to jobtracker will be there on jobhistory
On Tue, Mar 5, 2013 at 4:58 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
> Hi,****
>
> ** **
>
> I do have the following problem monitoring my Hive queries in Hadoop.****
>
> ** **
>
> I create a Sever using the Hive library which connects to an Hadoop
> cluster (file system, job tracker and Hive metastore are set up on this
> cluster). The needed parameters for the Hive server I've set in the
> configuration.****
>
> Commands sent to this server are executed, that works.****
>
> The problem now is that the MapReduce jobs created by Hive don't appear in
> the job tracker's job list. The list itself works, showing me other
> commands I executed not using Hive. (I use the JobClient Java class to get
> the list)****
>
> ** **
>
> Why are the Hive query jobs not in the list? How can I track them in
> Hadoop?****
>
> ** **
>
> ** **
>
> Thanks****
>
> ** **
>
> ** **
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 16:13
>
> *An:* user@hive.apache.org
> *Betreff:* Re: Get the job id for a hive query****
>
> ** **
>
> you can set this property mapred.job.name and this should set the name
> for the job ****
>
> ** **
>
> On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> Thanks for the response,****
>
> ****
>
> I also found no way to access the job id via java thrift client, all I can
> get is a query ID by the query planner.****
>
> ****
>
> How to set the name of a job where a Hive query is fired with, so I can
> find it in the job tracker later?****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 15:46****
>
>
> *An:* user@hive.apache.org
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> With thrift Client I don't think you can get the jobID from hadoop (I may
> very well be wrong in this)****
>
> ****
>
> the other way around this was to have a separate name for each job you
> fire through hive and then directly query jobtracker for the same ****
>
> ****
>
> On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> I use java and there HiveClient of the hive library (Version 0.10.0).****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 12:43
> *An:* user@hive.apache.org****
>
>
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> how are you running your hive queries? using hive cli or hive jdbc client?
> ****
>
> ****
>
> if you are using hive cli then whenever you fire a query and assuming it
> is syntactically correct and its not select * from table operation ****
>
> hive cli shows the job ID and an URL which points to the job tracker url
> for the job it submitted ****
>
> ****
>
> On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> I’m trying to get the job id of the job created with a Hive query.****
>
> At the moment I can get the cluster status from the HiveClient, but I don’
> find any job id in there... ****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Harsh J [mailto:harsh@cloudera.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 09:08
> *An:* hive request
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> The client logs print the Job ID of the spawned job and a tracking URL. Is
> that what you're looking for? Its printed for each stage.****
>
> ****
>
> On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> Hi,****
>
> ****
>
> has the Hive client the possibility to give back the job id of the job
> created when running a query? I need that for tracking.****
>
> ****
>
> ****
>
> Greetings****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
>
>
> ****
>
> ****
>
> --
> Harsh J ****
>
>
>
> ****
>
> ****
>
> --
> Nitin Pawar****
>
>
>
> ****
>
> ****
>
> --
> Nitin Pawar****
>
>
>
> ****
>
> ** **
>
> --
> Nitin Pawar****
>
--
Nitin Pawar
AW: Get the job id for a hive query
Posted by Tim Bittersohl <ti...@innoplexia.com>.
Hi,
I do have the following problem monitoring my Hive queries in Hadoop.
I create a Sever using the Hive library which connects to an Hadoop cluster
(file system, job tracker and Hive metastore are set up on this cluster).
The needed parameters for the Hive server I've set in the configuration.
Commands sent to this server are executed, that works.
The problem now is that the MapReduce jobs created by Hive don't appear in
the job tracker's job list. The list itself works, showing me other commands
I executed not using Hive. (I use the JobClient Java class to get the list)
Why are the Hive query jobs not in the list? How can I track them in Hadoop?
Thanks
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 16:13
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
you can set this property mapred.job.name and this should set the name for
the job
On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Thanks for the response,
I also found no way to access the job id via java thrift client, all I can
get is a query ID by the query planner.
How to set the name of a job where a Hive query is fired with, so I can find
it in the job tracker later?
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 15:46
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
With thrift Client I don't think you can get the jobID from hadoop (I may
very well be wrong in this)
the other way around this was to have a separate name for each job you fire
through hive and then directly query jobtracker for the same
On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
I use java and there HiveClient of the hive library (Version 0.10.0).
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 12:43
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
how are you running your hive queries? using hive cli or hive jdbc client?
if you are using hive cli then whenever you fire a query and assuming it is
syntactically correct and its not select * from table operation
hive cli shows the job ID and an URL which points to the job tracker url
for the job it submitted
On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Im trying to get the job id of the job created with a Hive query.
At the moment I can get the cluster status from the HiveClient, but I don
find any job id in there...
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Harsh J [mailto:harsh@cloudera.com]
Gesendet: Donnerstag, 28. Februar 2013 09:08
An: hive request
Betreff: Re: Get the job id for a hive query
The client logs print the Job ID of the spawned job and a tracking URL. Is
that what you're looking for? Its printed for each stage.
On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Hi,
has the Hive client the possibility to give back the job id of the job
created when running a query? I need that for tracking.
Greetings
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606
<tel:32494%2F62606> - USt. IdNr.: DE 272 871 728 - Geschäftsführer:
Christian Schneider, Walery Strauch, Prof. Dr. Herbert Schuster
--
Harsh J
--
Nitin Pawar
--
Nitin Pawar
--
Nitin Pawar
Re: Get the job id for a hive query
Posted by Navis류승우 <na...@nexr.com>.
https://issues.apache.org/jira/browse/HIVE-3235 could be what you are
searching for.
2013/3/1 Nitin Pawar <ni...@gmail.com>
> you can set this property mapred.job.name and this should set the name
> for the job
>
>
> On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <ti...@innoplexia.com>wrote:
>
>> Thanks for the response,****
>>
>> ** **
>>
>> I also found no way to access the job id via java thrift client, all I
>> can get is a query ID by the query planner.****
>>
>> ** **
>>
>> How to set the name of a job where a Hive query is fired with, so I can
>> find it in the job tracker later?****
>>
>> ** **
>>
>> Tim Bittersohl ****
>>
>> Software Engineer ****
>>
>>
>> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>>
>> Innoplexia GmbH
>> Mannheimer Str. 175 ****
>>
>> 69123 Heidelberg
>>
>> Tel.: +49 (0) 6221 7198033
>> Fax: +49 (0) 6221 7198034
>> Web: www.innoplexia.com
>>
>> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
>> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
>> Strauch, Prof. Dr. Herbert Schuster ****
>>
>> ** **
>>
>> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
>> *Gesendet:* Donnerstag, 28. Februar 2013 15:46
>>
>> *An:* user@hive.apache.org
>> *Betreff:* Re: Get the job id for a hive query****
>>
>> ** **
>>
>> With thrift Client I don't think you can get the jobID from hadoop (I may
>> very well be wrong in this)****
>>
>> ** **
>>
>> the other way around this was to have a separate name for each job you
>> fire through hive and then directly query jobtracker for the same ****
>>
>> ** **
>>
>> On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com>
>> wrote:****
>>
>> I use java and there HiveClient of the hive library (Version 0.10.0).****
>>
>> ****
>>
>> Tim Bittersohl ****
>>
>> Software Engineer ****
>>
>>
>> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>>
>> Innoplexia GmbH
>> Mannheimer Str. 175 ****
>>
>> 69123 Heidelberg
>>
>> Tel.: +49 (0) 6221 7198033
>> Fax: +49 (0) 6221 7198034
>> Web: www.innoplexia.com
>>
>> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
>> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
>> Strauch, Prof. Dr. Herbert Schuster ****
>>
>> ****
>>
>> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
>> *Gesendet:* Donnerstag, 28. Februar 2013 12:43
>> *An:* user@hive.apache.org****
>>
>>
>> *Betreff:* Re: Get the job id for a hive query****
>>
>> ****
>>
>> how are you running your hive queries? using hive cli or hive jdbc
>> client? ****
>>
>> ****
>>
>> if you are using hive cli then whenever you fire a query and assuming it
>> is syntactically correct and its not select * from table operation ****
>>
>> hive cli shows the job ID and an URL which points to the job tracker url
>> for the job it submitted ****
>>
>> ****
>>
>> On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com>
>> wrote:****
>>
>> I’m trying to get the job id of the job created with a Hive query.****
>>
>> At the moment I can get the cluster status from the HiveClient, but I
>> don’ find any job id in there... ****
>>
>> ****
>>
>> Tim Bittersohl ****
>>
>> Software Engineer ****
>>
>>
>> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>>
>> Innoplexia GmbH
>> Mannheimer Str. 175 ****
>>
>> 69123 Heidelberg
>>
>> Tel.: +49 (0) 6221 7198033
>> Fax: +49 (0) 6221 7198034
>> Web: www.innoplexia.com
>>
>> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
>> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
>> Strauch, Prof. Dr. Herbert Schuster ****
>>
>> ****
>>
>> *Von:* Harsh J [mailto:harsh@cloudera.com]
>> *Gesendet:* Donnerstag, 28. Februar 2013 09:08
>> *An:* hive request
>> *Betreff:* Re: Get the job id for a hive query****
>>
>> ****
>>
>> The client logs print the Job ID of the spawned job and a tracking URL.
>> Is that what you're looking for? Its printed for each stage.****
>>
>> ****
>>
>> On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com>
>> wrote:****
>>
>> Hi,****
>>
>> ****
>>
>> has the Hive client the possibility to give back the job id of the job
>> created when running a query? I need that for tracking.****
>>
>> ****
>>
>> ****
>>
>> Greetings****
>>
>> Tim Bittersohl ****
>>
>> Software Engineer ****
>>
>>
>> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>>
>> Innoplexia GmbH
>> Mannheimer Str. 175 ****
>>
>> 69123 Heidelberg
>>
>> Tel.: +49 (0) 6221 7198033
>> Fax: +49 (0) 6221 7198034
>> Web: www.innoplexia.com
>>
>> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
>> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
>> Strauch, Prof. Dr. Herbert Schuster ****
>>
>> ****
>>
>>
>>
>> ****
>>
>> ****
>>
>> --
>> Harsh J ****
>>
>>
>>
>> ****
>>
>> ****
>>
>> --
>> Nitin Pawar****
>>
>>
>>
>> ****
>>
>> ** **
>>
>> --
>> Nitin Pawar****
>>
>
>
>
> --
> Nitin Pawar
>
Re: Get the job id for a hive query
Posted by Nitin Pawar <ni...@gmail.com>.
you can set this property mapred.job.name and this should set the name for
the job
On Thu, Feb 28, 2013 at 8:26 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
> Thanks for the response,****
>
> ** **
>
> I also found no way to access the job id via java thrift client, all I can
> get is a query ID by the query planner.****
>
> ** **
>
> How to set the name of a job where a Hive query is fired with, so I can
> find it in the job tracker later?****
>
> ** **
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ** **
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 15:46
>
> *An:* user@hive.apache.org
> *Betreff:* Re: Get the job id for a hive query****
>
> ** **
>
> With thrift Client I don't think you can get the jobID from hadoop (I may
> very well be wrong in this)****
>
> ** **
>
> the other way around this was to have a separate name for each job you
> fire through hive and then directly query jobtracker for the same ****
>
> ** **
>
> On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> I use java and there HiveClient of the hive library (Version 0.10.0).****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 12:43
> *An:* user@hive.apache.org****
>
>
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> how are you running your hive queries? using hive cli or hive jdbc client?
> ****
>
> ****
>
> if you are using hive cli then whenever you fire a query and assuming it
> is syntactically correct and its not select * from table operation ****
>
> hive cli shows the job ID and an URL which points to the job tracker url
> for the job it submitted ****
>
> ****
>
> On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> I’m trying to get the job id of the job created with a Hive query.****
>
> At the moment I can get the cluster status from the HiveClient, but I don’
> find any job id in there... ****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Harsh J [mailto:harsh@cloudera.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 09:08
> *An:* hive request
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> The client logs print the Job ID of the spawned job and a tracking URL. Is
> that what you're looking for? Its printed for each stage.****
>
> ****
>
> On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> Hi,****
>
> ****
>
> has the Hive client the possibility to give back the job id of the job
> created when running a query? I need that for tracking.****
>
> ****
>
> ****
>
> Greetings****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
>
>
> ****
>
> ****
>
> --
> Harsh J ****
>
>
>
> ****
>
> ****
>
> --
> Nitin Pawar****
>
>
>
> ****
>
> ** **
>
> --
> Nitin Pawar****
>
--
Nitin Pawar
AW: Get the job id for a hive query
Posted by Tim Bittersohl <ti...@innoplexia.com>.
Thanks for the response,
I also found no way to access the job id via java thrift client, all I can
get is a query ID by the query planner.
How to set the name of a job where a Hive query is fired with, so I can find
it in the job tracker later?
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033
Fax: +49 (0) 6221 7198034
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 15:46
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
With thrift Client I don't think you can get the jobID from hadoop (I may
very well be wrong in this)
the other way around this was to have a separate name for each job you fire
through hive and then directly query jobtracker for the same
On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
I use java and there HiveClient of the hive library (Version 0.10.0).
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 12:43
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
how are you running your hive queries? using hive cli or hive jdbc client?
if you are using hive cli then whenever you fire a query and assuming it is
syntactically correct and its not select * from table operation
hive cli shows the job ID and an URL which points to the job tracker url
for the job it submitted
On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Im trying to get the job id of the job created with a Hive query.
At the moment I can get the cluster status from the HiveClient, but I don
find any job id in there...
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Harsh J [mailto:harsh@cloudera.com]
Gesendet: Donnerstag, 28. Februar 2013 09:08
An: hive request
Betreff: Re: Get the job id for a hive query
The client logs print the Job ID of the spawned job and a tracking URL. Is
that what you're looking for? Its printed for each stage.
On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Hi,
has the Hive client the possibility to give back the job id of the job
created when running a query? I need that for tracking.
Greetings
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606
<tel:32494%2F62606> - USt. IdNr.: DE 272 871 728 - Geschäftsführer:
Christian Schneider, Walery Strauch, Prof. Dr. Herbert Schuster
--
Harsh J
--
Nitin Pawar
--
Nitin Pawar
Re: Get the job id for a hive query
Posted by Nitin Pawar <ni...@gmail.com>.
With thrift Client I don't think you can get the jobID from hadoop (I may
very well be wrong in this)
the other way around this was to have a separate name for each job you fire
through hive and then directly query jobtracker for the same
On Thu, Feb 28, 2013 at 5:18 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
> I use java and there HiveClient of the hive library (Version 0.10.0).****
>
> ** **
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ** **
>
> *Von:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 12:43
> *An:* user@hive.apache.org
>
> *Betreff:* Re: Get the job id for a hive query****
>
> ** **
>
> how are you running your hive queries? using hive cli or hive jdbc client?
> ****
>
> ** **
>
> if you are using hive cli then whenever you fire a query and assuming it
> is syntactically correct and its not select * from table operation ****
>
> hive cli shows the job ID and an URL which points to the job tracker url
> for the job it submitted ****
>
> ** **
>
> On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> I’m trying to get the job id of the job created with a Hive query.****
>
> At the moment I can get the cluster status from the HiveClient, but I don’
> find any job id in there... ****
>
> ****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
> *Von:* Harsh J [mailto:harsh@cloudera.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 09:08
> *An:* hive request
> *Betreff:* Re: Get the job id for a hive query****
>
> ****
>
> The client logs print the Job ID of the spawned job and a tracking URL. Is
> that what you're looking for? Its printed for each stage.****
>
> ****
>
> On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> Hi,****
>
> ****
>
> has the Hive client the possibility to give back the job id of the job
> created when running a query? I need that for tracking.****
>
> ****
>
> ****
>
> Greetings****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
>
>
> ****
>
> ****
>
> --
> Harsh J ****
>
>
>
> ****
>
> ** **
>
> --
> Nitin Pawar****
>
--
Nitin Pawar
AW: Get the job id for a hive query
Posted by Tim Bittersohl <ti...@innoplexia.com>.
I use java and there HiveClient of the hive library (Version 0.10.0).
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033
Fax: +49 (0) 6221 7198034
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Gesendet: Donnerstag, 28. Februar 2013 12:43
An: user@hive.apache.org
Betreff: Re: Get the job id for a hive query
how are you running your hive queries? using hive cli or hive jdbc client?
if you are using hive cli then whenever you fire a query and assuming it is
syntactically correct and its not select * from table operation
hive cli shows the job ID and an URL which points to the job tracker url
for the job it submitted
On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Im trying to get the job id of the job created with a Hive query.
At the moment I can get the cluster status from the HiveClient, but I don
find any job id in there...
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Harsh J [mailto:harsh@cloudera.com]
Gesendet: Donnerstag, 28. Februar 2013 09:08
An: hive request
Betreff: Re: Get the job id for a hive query
The client logs print the Job ID of the spawned job and a tracking URL. Is
that what you're looking for? Its printed for each stage.
On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Hi,
has the Hive client the possibility to give back the job id of the job
created when running a query? I need that for tracking.
Greetings
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606
<tel:32494%2F62606> - USt. IdNr.: DE 272 871 728 - Geschäftsführer:
Christian Schneider, Walery Strauch, Prof. Dr. Herbert Schuster
--
Harsh J
--
Nitin Pawar
Re: Get the job id for a hive query
Posted by Nitin Pawar <ni...@gmail.com>.
how are you running your hive queries? using hive cli or hive jdbc client?
if you are using hive cli then whenever you fire a query and assuming it
is syntactically correct and its not select * from table operation
hive cli shows the job ID and an URL which points to the job tracker url
for the job it submitted
On Thu, Feb 28, 2013 at 5:09 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
> I’m trying to get the job id of the job created with a Hive query.****
>
> At the moment I can get the cluster status from the HiveClient, but I don’
> find any job id in there... ****
>
> ** **
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ** **
>
> *Von:* Harsh J [mailto:harsh@cloudera.com]
> *Gesendet:* Donnerstag, 28. Februar 2013 09:08
> *An:* hive request
> *Betreff:* Re: Get the job id for a hive query****
>
> ** **
>
> The client logs print the Job ID of the spawned job and a tracking URL. Is
> that what you're looking for? Its printed for each stage.****
>
> ** **
>
> On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com>
> wrote:****
>
> Hi,****
>
> ****
>
> has the Hive client the possibility to give back the job id of the job
> created when running a query? I need that for tracking.****
>
> ****
>
> ****
>
> Greetings****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ****
>
>
>
> ****
>
> ** **
>
> --
> Harsh J ****
>
--
Nitin Pawar
AW: Get the job id for a hive query
Posted by Tim Bittersohl <ti...@innoplexia.com>.
Im trying to get the job id of the job created with a Hive query.
At the moment I can get the cluster status from the HiveClient, but I don
find any job id in there...
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033
Fax: +49 (0) 6221 7198034
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
Strauch, Prof. Dr. Herbert Schuster
Von: Harsh J [mailto:harsh@cloudera.com]
Gesendet: Donnerstag, 28. Februar 2013 09:08
An: hive request
Betreff: Re: Get the job id for a hive query
The client logs print the Job ID of the spawned job and a tracking URL. Is
that what you're looking for? Its printed for each stage.
On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
Hi,
has the Hive client the possibility to give back the job id of the job
created when running a query? I need that for tracking.
Greetings
Tim Bittersohl
Software Engineer
http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png
Innoplexia GmbH
Mannheimer Str. 175
69123 Heidelberg
Tel.: +49 (0) 6221 7198033 <tel:%2B49%20%280%29%206221%207198033>
Fax: +49 (0) 6221 7198034 <tel:%2B49%20%280%29%206221%207198034>
Web: www.innoplexia.com <http://www.innoplexia.com/>
Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606
<tel:32494%2F62606> - USt. IdNr.: DE 272 871 728 - Geschäftsführer:
Christian Schneider, Walery Strauch, Prof. Dr. Herbert Schuster
--
Harsh J
Re: Get the job id for a hive query
Posted by Harsh J <ha...@cloudera.com>.
The client logs print the Job ID of the spawned job and a tracking URL. Is
that what you're looking for? Its printed for each stage.
On Wed, Feb 27, 2013 at 11:06 PM, Tim Bittersohl <ti...@innoplexia.com> wrote:
> Hi,****
>
> ** **
>
> has the Hive client the possibility to give back the job id of the job
> created when running a query? I need that for tracking.****
>
> ** **
>
> ** **
>
> Greetings****
>
> Tim Bittersohl ****
>
> Software Engineer ****
>
>
> [image: http://www.innoplexia.de/ci/logo/inno_logo_links%20200x80.png]
>
> Innoplexia GmbH
> Mannheimer Str. 175 ****
>
> 69123 Heidelberg
>
> Tel.: +49 (0) 6221 7198033
> Fax: +49 (0) 6221 7198034
> Web: www.innoplexia.com
>
> Sitz: 69123 Heidelberg, Mannheimer Str. 175 - Steuernummer 32494/62606 -
> USt. IdNr.: DE 272 871 728 - Geschäftsführer: Christian Schneider, Walery
> Strauch, Prof. Dr. Herbert Schuster ****
>
> ** **
>
--
Harsh J