You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Lefty Leverenz <le...@gmail.com> on 2016/04/16 10:07:23 UTC

Re:

To unsubscribe, please send a message to user-unsubscribe@hive.apache.org as
described here:  Mailing Lists <http://hive.apache.org/mailing_lists.html>.
Thanks.

-- Lefty


On Sat, Apr 16, 2016 at 12:12 AM, 469564481 <46...@qq.com> wrote:

>
> I do not want to receive email .Thaks!
>
> ------------------ Original ------------------
> *From: * "Jörn Franke";<jo...@gmail.com>;
> *Date: * Sat, Apr 16, 2016 03:10 PM
> *To: * "user"<us...@hive.apache.org>;
> *Subject: * Re: Mappers spawning Hive queries
>
> Just out of curiosity, what is the use case behind this?
>
> How do you call the shell script?
>
> > On 16 Apr 2016, at 00:24, Shirish Tatikonda <sh...@gmail.com>
> wrote:
> >
> > Hello,
> >
> > I am trying to run multiple hive queries in parallel by submitting them
> through a map-reduce job.
> > More specifically, I have a map-only hadoop streaming job where each
> mapper runs a shell script that does two things -- 1) parses input lines
> obtained via streaming; and 2) submits a very simple hive query (via hive
> -e ...) with parameters computed from step-1.
> >
> > Now, when I run the streaming job, the mappers seem to be stuck and I
> don't know what is going on. When I looked on resource manager web UI, I
> don't see any new MR Jobs (triggered from the hive query). I am trying to
> understand this behavior.
> >
> > This may be a bad idea to begin with, and there may be better ways to
> accomplish the same task. However, I would like to understand the behavior
> of such a MR job.
> >
> > Any thoughts?
> >
> > Thank you,
> > Shirish
> >
>