(Unknown)

[469564481 <46...@qq.com>]

I do not want to receive email .Thaks! 


------------------ Original ------------------
From:  "Jörn Franke";<jo...@gmail.com>;
Date:  Sat, Apr 16, 2016 03:10 PM
To:  "user"<us...@hive.apache.org>; 

Subject:  Re: Mappers spawning Hive queries



Just out of curiosity, what is the use case behind this?

How do you call the shell script?

> On 16 Apr 2016, at 00:24, Shirish Tatikonda <sh...@gmail.com> wrote:
> 
> Hello,
> 
> I am trying to run multiple hive queries in parallel by submitting them through a map-reduce job. 
> More specifically, I have a map-only hadoop streaming job where each mapper runs a shell script that does two things -- 1) parses input lines obtained via streaming; and 2) submits a very simple hive query (via hive -e ...) with parameters computed from step-1. 
> 
> Now, when I run the streaming job, the mappers seem to be stuck and I don't know what is going on. When I looked on resource manager web UI, I don't see any new MR Jobs (triggered from the hive query). I am trying to understand this behavior. 
> 
> This may be a bad idea to begin with, and there may be better ways to accomplish the same task. However, I would like to understand the behavior of such a MR job.
> 
> Any thoughts?
> 
> Thank you,
> Shirish
>

Re:

[Lefty Leverenz <le...@gmail.com>]

To unsubscribe, please send a message to user-unsubscribe@hive.apache.org as
described here:  Mailing Lists <http://hive.apache.org/mailing_lists.html>.
Thanks.

-- Lefty


On Sat, Apr 16, 2016 at 12:12 AM, 469564481 <46...@qq.com> wrote:

>
> I do not want to receive email .Thaks!
>
> ------------------ Original ------------------
> *From: * "Jörn Franke";<jo...@gmail.com>;
> *Date: * Sat, Apr 16, 2016 03:10 PM
> *To: * "user"<us...@hive.apache.org>;
> *Subject: * Re: Mappers spawning Hive queries
>
> Just out of curiosity, what is the use case behind this?
>
> How do you call the shell script?
>
> > On 16 Apr 2016, at 00:24, Shirish Tatikonda <sh...@gmail.com>
> wrote:
> >
> > Hello,
> >
> > I am trying to run multiple hive queries in parallel by submitting them
> through a map-reduce job.
> > More specifically, I have a map-only hadoop streaming job where each
> mapper runs a shell script that does two things -- 1) parses input lines
> obtained via streaming; and 2) submits a very simple hive query (via hive
> -e ...) with parameters computed from step-1.
> >
> > Now, when I run the streaming job, the mappers seem to be stuck and I
> don't know what is going on. When I looked on resource manager web UI, I
> don't see any new MR Jobs (triggered from the hive query). I am trying to
> understand this behavior.
> >
> > This may be a bad idea to begin with, and there may be better ways to
> accomplish the same task. However, I would like to understand the behavior
> of such a MR job.
> >
> > Any thoughts?
> >
> > Thank you,
> > Shirish
> >
>