You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Daniel Yehdego <dt...@miners.utep.edu> on 2012/01/19 20:19:23 UTC

input file order

Hi, 
I have 100 .txt input files and I want my mapper output to be in an orderly manner. I am not using any reducer.Any idea? 

Regards,

Re: input file order

Posted by madhu phatak <ph...@gmail.com>.

Hi,
 Mappers run in parallel. So without reducer it is not possible ensure the
sequence.

On Fri, Jan 20, 2012 at 2:32 AM, Mapred Learn <ma...@gmail.com>wrote:

> This is my question too.
> What if I want output to be in same order as input without using reducers.
>
> Thanks,
> JJ
>
> Sent from my iPhone
>
> On Jan 19, 2012, at 12:19 PM, Ronald Petty <ro...@gmail.com> wrote:
>
> > Daniel,
> >
> > Can you provide a concrete example of what you mean by "output to be in
> an
> > orderly manner"?
> >
> > Also, what are the file sizes and types?
> >
> > Ron
> >
> > On Thu, Jan 19, 2012 at 11:19 AM, Daniel Yehdego
> > <dt...@miners.utep.edu>wrote:
> >
> >>
> >> Hi,
> >> I have 100 .txt input files and I want my mapper output to be in an
> >> orderly manner. I am not using any reducer.Any idea?
> >>
> >> Regards,
> >>
> >>
> >>
>



-- 
https://github.com/zinnia-phatak-dev/Nectar

Re: input file order

Posted by Mapred Learn <ma...@gmail.com>.

This is my question too.
What if I want output to be in same order as input without using reducers.

Thanks,
JJ

Sent from my iPhone

On Jan 19, 2012, at 12:19 PM, Ronald Petty <ro...@gmail.com> wrote:

> Daniel,
> 
> Can you provide a concrete example of what you mean by "output to be in an
> orderly manner"?
> 
> Also, what are the file sizes and types?
> 
> Ron
> 
> On Thu, Jan 19, 2012 at 11:19 AM, Daniel Yehdego
> <dt...@miners.utep.edu>wrote:
> 
>> 
>> Hi,
>> I have 100 .txt input files and I want my mapper output to be in an
>> orderly manner. I am not using any reducer.Any idea?
>> 
>> Regards,
>> 
>> 
>>

Re: input file order

Posted by Ronald Petty <ro...@gmail.com>.

Daniel,

Can you provide a concrete example of what you mean by "output to be in an
orderly manner"?

Also, what are the file sizes and types?

Ron

On Thu, Jan 19, 2012 at 11:19 AM, Daniel Yehdego
<dt...@miners.utep.edu>wrote:

>
> Hi,
> I have 100 .txt input files and I want my mapper output to be in an
> orderly manner. I am not using any reducer.Any idea?
>
> Regards,
>
>
>