You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Khaled BEN BAHRI <Kh...@it-sudparis.eu> on 2010/07/16 17:38:15 UTC
how to specify inputs for mapreduce
Hello to all
I wonder how to specify inputs of mapreduce
it's necessary that inputs be in hdfs ???
or it's possible to process mapreduce with inputs located in the local
system??
if it's possible how can i make it?
thanks in advance for help
Khaled
best regards
Re: how to specify inputs for mapreduce
Posted by James Hammerton <ja...@mendeley.com>.
Oops. I should add the example uses the old API.
James
On Fri, Jul 16, 2010 at 4:45 PM, James Hammerton <
james.hammerton@mendeley.com> wrote:
> Essentially you specify the type of your inputs in the Mapper and in the
> job set up. You need to upload data to HDFS from your local filesystem.
>
> This tutorial should help you:
>
> http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html
>
> James
>
>
> On Fri, Jul 16, 2010 at 4:38 PM, Khaled BEN BAHRI <
> Khaled.Ben_bahri@it-sudparis.eu> wrote:
>
>> Hello to all
>>
>> I wonder how to specify inputs of mapreduce
>> it's necessary that inputs be in hdfs ???
>>
>> or it's possible to process mapreduce with inputs located in the local
>> system??
>> if it's possible how can i make it?
>>
>> thanks in advance for help
>>
>> Khaled
>>
>> best regards
>>
>>
>
>
> --
> James Hammerton | Senior Data Mining Engineer
> www.mendeley.com/profiles/james-hammerton
>
> Mendeley Limited | London, UK | www.mendeley.com
> Registered in England and Wales | Company Number 6419015
>
>
>
>
--
James Hammerton | Senior Data Mining Engineer
www.mendeley.com/profiles/james-hammerton
Mendeley Limited | London, UK | www.mendeley.com
Registered in England and Wales | Company Number 6419015
Re: how to specify inputs for mapreduce
Posted by James Hammerton <ja...@mendeley.com>.
Essentially you specify the type of your inputs in the Mapper and in the job
set up. You need to upload data to HDFS from your local filesystem.
This tutorial should help you:
http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html
James
On Fri, Jul 16, 2010 at 4:38 PM, Khaled BEN BAHRI <
Khaled.Ben_bahri@it-sudparis.eu> wrote:
> Hello to all
>
> I wonder how to specify inputs of mapreduce
> it's necessary that inputs be in hdfs ???
>
> or it's possible to process mapreduce with inputs located in the local
> system??
> if it's possible how can i make it?
>
> thanks in advance for help
>
> Khaled
>
> best regards
>
>
--
James Hammerton | Senior Data Mining Engineer
www.mendeley.com/profiles/james-hammerton
Mendeley Limited | London, UK | www.mendeley.com
Registered in England and Wales | Company Number 6419015