You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Siddharth Tiwari <si...@live.com> on 2012/08/19 20:16:09 UTC
FW: Streaming Issue
Hi Friends,
Can you please suggest me how can I pass 3 files as parameters to the mapper written in python in hadoop streaming API, which will process data from this three different files . Please help.
*------------------------*
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”
"Maybe other people will try to limit me but I don't limit myself"
RE: Streaming Issue
Posted by Siddharth Tiwari <si...@live.com>.
Hi mohit,
The script normally runs like this locally,
Python mapper.py file1 file2 file3.
How can I achieve this.
Also how can I use paste command in mapper.
Ex, paste file1 file2 file3 > file4
This is in normal shell,
How to achieve it over streaming.
Thanks in advance please help
Date: Sun, 19 Aug 2012 13:42:20 -0700
Subject: Re: FW: Streaming Issue
From: mohitanchlia@gmail.com
To: user@hadoop.apache.org
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <si...@live.com> wrote:
Hi Friends,
Can you please suggest me how can I pass 3 files as parameters to the mapper written in python in hadoop streaming API, which will process data from this three different files . Please help.
*------------------------*
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”
"Maybe other people will try to limit me but I don't limit myself"
RE: Streaming Issue
Posted by Siddharth Tiwari <si...@live.com>.
Hi mohit,
The script normally runs like this locally,
Python mapper.py file1 file2 file3.
How can I achieve this.
Also how can I use paste command in mapper.
Ex, paste file1 file2 file3 > file4
This is in normal shell,
How to achieve it over streaming.
Thanks in advance please help
Date: Sun, 19 Aug 2012 13:42:20 -0700
Subject: Re: FW: Streaming Issue
From: mohitanchlia@gmail.com
To: user@hadoop.apache.org
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <si...@live.com> wrote:
Hi Friends,
Can you please suggest me how can I pass 3 files as parameters to the mapper written in python in hadoop streaming API, which will process data from this three different files . Please help.
*------------------------*
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”
"Maybe other people will try to limit me but I don't limit myself"
RE: Streaming Issue
Posted by Siddharth Tiwari <si...@live.com>.
Hi mohit,
The script normally runs like this locally,
Python mapper.py file1 file2 file3.
How can I achieve this.
Also how can I use paste command in mapper.
Ex, paste file1 file2 file3 > file4
This is in normal shell,
How to achieve it over streaming.
Thanks in advance please help
Date: Sun, 19 Aug 2012 13:42:20 -0700
Subject: Re: FW: Streaming Issue
From: mohitanchlia@gmail.com
To: user@hadoop.apache.org
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <si...@live.com> wrote:
Hi Friends,
Can you please suggest me how can I pass 3 files as parameters to the mapper written in python in hadoop streaming API, which will process data from this three different files . Please help.
*------------------------*
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”
"Maybe other people will try to limit me but I don't limit myself"
RE: Streaming Issue
Posted by Siddharth Tiwari <si...@live.com>.
Hi mohit,
The script normally runs like this locally,
Python mapper.py file1 file2 file3.
How can I achieve this.
Also how can I use paste command in mapper.
Ex, paste file1 file2 file3 > file4
This is in normal shell,
How to achieve it over streaming.
Thanks in advance please help
Date: Sun, 19 Aug 2012 13:42:20 -0700
Subject: Re: FW: Streaming Issue
From: mohitanchlia@gmail.com
To: user@hadoop.apache.org
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <si...@live.com> wrote:
Hi Friends,
Can you please suggest me how can I pass 3 files as parameters to the mapper written in python in hadoop streaming API, which will process data from this three different files . Please help.
*------------------------*
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”
"Maybe other people will try to limit me but I don't limit myself"
Re: FW: Streaming Issue
Posted by Mohit Anchlia <mo...@gmail.com>.
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <
siddharth.tiwari@live.com> wrote:
>
>
> **
> Hi Friends,
>
> Can you please suggest me how can I pass 3 files as parameters to the
> mapper written in python in hadoop streaming API, which will process data
> from this three different files . Please help.
>
>
>
> **------------------------**
> *Cheers !!!*
> *Siddharth Tiwari*
> Have a refreshing day !!!
> *"Every duty is holy, and devotion to duty is the highest form of worship
> of God.” *
> *"Maybe other people will try to limit me but I don't limit myself"*
>
Re: FW: Streaming Issue
Posted by Mohit Anchlia <mo...@gmail.com>.
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <
siddharth.tiwari@live.com> wrote:
>
>
> **
> Hi Friends,
>
> Can you please suggest me how can I pass 3 files as parameters to the
> mapper written in python in hadoop streaming API, which will process data
> from this three different files . Please help.
>
>
>
> **------------------------**
> *Cheers !!!*
> *Siddharth Tiwari*
> Have a refreshing day !!!
> *"Every duty is holy, and devotion to duty is the highest form of worship
> of God.” *
> *"Maybe other people will try to limit me but I don't limit myself"*
>
Re: FW: Streaming Issue
Posted by Mohit Anchlia <mo...@gmail.com>.
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <
siddharth.tiwari@live.com> wrote:
>
>
> **
> Hi Friends,
>
> Can you please suggest me how can I pass 3 files as parameters to the
> mapper written in python in hadoop streaming API, which will process data
> from this three different files . Please help.
>
>
>
> **------------------------**
> *Cheers !!!*
> *Siddharth Tiwari*
> Have a refreshing day !!!
> *"Every duty is holy, and devotion to duty is the highest form of worship
> of God.” *
> *"Maybe other people will try to limit me but I don't limit myself"*
>
Re: FW: Streaming Issue
Posted by Mohit Anchlia <mo...@gmail.com>.
Are you looking for something like this?
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <
siddharth.tiwari@live.com> wrote:
>
>
> **
> Hi Friends,
>
> Can you please suggest me how can I pass 3 files as parameters to the
> mapper written in python in hadoop streaming API, which will process data
> from this three different files . Please help.
>
>
>
> **------------------------**
> *Cheers !!!*
> *Siddharth Tiwari*
> Have a refreshing day !!!
> *"Every duty is holy, and devotion to duty is the highest form of worship
> of God.” *
> *"Maybe other people will try to limit me but I don't limit myself"*
>