You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by jamal sasha <ja...@gmail.com> on 2013/09/19 00:01:44 UTC
Using combiners in python hadoop streaming
Hi,
How do I implement (say ) in wordcount a combiner functionality if i am
using python hadoop streaming?
Thanks
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Oops.. wrong email thread :D Please ignore the previous email
On Fri, Sep 20, 2013 at 1:49 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> So in native hadoop streaming, is there no way to send a helper file.. ?
> Like in core hadoop, you can write your code in multiple files and then
> jar it out...
> But if i am using hadoop streaming, all my code should be in single file??
> Is that so?
>
>
> On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
>
>> LMGTFY:
>> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>>
>>
>> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>>
>>> Hi,
>>> How do I implement (say ) in wordcount a combiner functionality if i am
>>> using python hadoop streaming?
>>> Thanks
>>>
>>
>>
>
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Oops.. wrong email thread :D Please ignore the previous email
On Fri, Sep 20, 2013 at 1:49 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> So in native hadoop streaming, is there no way to send a helper file.. ?
> Like in core hadoop, you can write your code in multiple files and then
> jar it out...
> But if i am using hadoop streaming, all my code should be in single file??
> Is that so?
>
>
> On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
>
>> LMGTFY:
>> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>>
>>
>> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>>
>>> Hi,
>>> How do I implement (say ) in wordcount a combiner functionality if i am
>>> using python hadoop streaming?
>>> Thanks
>>>
>>
>>
>
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Oops.. wrong email thread :D Please ignore the previous email
On Fri, Sep 20, 2013 at 1:49 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> So in native hadoop streaming, is there no way to send a helper file.. ?
> Like in core hadoop, you can write your code in multiple files and then
> jar it out...
> But if i am using hadoop streaming, all my code should be in single file??
> Is that so?
>
>
> On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
>
>> LMGTFY:
>> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>>
>>
>> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>>
>>> Hi,
>>> How do I implement (say ) in wordcount a combiner functionality if i am
>>> using python hadoop streaming?
>>> Thanks
>>>
>>
>>
>
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Oops.. wrong email thread :D Please ignore the previous email
On Fri, Sep 20, 2013 at 1:49 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> So in native hadoop streaming, is there no way to send a helper file.. ?
> Like in core hadoop, you can write your code in multiple files and then
> jar it out...
> But if i am using hadoop streaming, all my code should be in single file??
> Is that so?
>
>
> On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
>
>> LMGTFY:
>> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>>
>>
>> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>>
>>> Hi,
>>> How do I implement (say ) in wordcount a combiner functionality if i am
>>> using python hadoop streaming?
>>> Thanks
>>>
>>
>>
>
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Hi,
So in native hadoop streaming, is there no way to send a helper file.. ?
Like in core hadoop, you can write your code in multiple files and then jar
it out...
But if i am using hadoop streaming, all my code should be in single file??
Is that so?
On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
> LMGTFY:
> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>
>
> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>
>> Hi,
>> How do I implement (say ) in wordcount a combiner functionality if i am
>> using python hadoop streaming?
>> Thanks
>>
>
>
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Hi,
So in native hadoop streaming, is there no way to send a helper file.. ?
Like in core hadoop, you can write your code in multiple files and then jar
it out...
But if i am using hadoop streaming, all my code should be in single file??
Is that so?
On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
> LMGTFY:
> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>
>
> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>
>> Hi,
>> How do I implement (say ) in wordcount a combiner functionality if i am
>> using python hadoop streaming?
>> Thanks
>>
>
>
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Hi,
So in native hadoop streaming, is there no way to send a helper file.. ?
Like in core hadoop, you can write your code in multiple files and then jar
it out...
But if i am using hadoop streaming, all my code should be in single file??
Is that so?
On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
> LMGTFY:
> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>
>
> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>
>> Hi,
>> How do I implement (say ) in wordcount a combiner functionality if i am
>> using python hadoop streaming?
>> Thanks
>>
>
>
Re: Using combiners in python hadoop streaming
Posted by jamal sasha <ja...@gmail.com>.
Hi,
So in native hadoop streaming, is there no way to send a helper file.. ?
Like in core hadoop, you can write your code in multiple files and then jar
it out...
But if i am using hadoop streaming, all my code should be in single file??
Is that so?
On Wed, Sep 18, 2013 at 3:10 PM, Chris Embree <ce...@gmail.com> wrote:
> LMGTFY:
> http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
>
>
> On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com>wrote:
>
>> Hi,
>> How do I implement (say ) in wordcount a combiner functionality if i am
>> using python hadoop streaming?
>> Thanks
>>
>
>
Re: Using combiners in python hadoop streaming
Posted by Chris Embree <ce...@gmail.com>.
LMGTFY:
http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> How do I implement (say ) in wordcount a combiner functionality if i am
> using python hadoop streaming?
> Thanks
>
Re: Using combiners in python hadoop streaming
Posted by Chris Embree <ce...@gmail.com>.
LMGTFY:
http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> How do I implement (say ) in wordcount a combiner functionality if i am
> using python hadoop streaming?
> Thanks
>
Re: Using combiners in python hadoop streaming
Posted by Chris Embree <ce...@gmail.com>.
LMGTFY:
http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> How do I implement (say ) in wordcount a combiner functionality if i am
> using python hadoop streaming?
> Thanks
>
Re: Using combiners in python hadoop streaming
Posted by Chris Embree <ce...@gmail.com>.
LMGTFY:
http://pydoop.sourceforge.net/docs/pydoop_script.html#pydoop-script-guide
On Wed, Sep 18, 2013 at 6:01 PM, jamal sasha <ja...@gmail.com> wrote:
> Hi,
> How do I implement (say ) in wordcount a combiner functionality if i am
> using python hadoop streaming?
> Thanks
>