You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Deepak Diwakar <dd...@gmail.com> on 2008/09/18 14:09:30 UTC
custom writable class
Hi,
I am new to hadoop. For my map/reduce task I want to write my on custom
writable class. Could anyone please let me know where exactly to place the
customwritable.java file?
I found that in {hadoop-home}
/hadoop-{version}/src/java/org/apache/hadoop/io/ all type of writable class
files are there.
Then in the main task, we just include "import
org.apache.hadoop.io.{X}Writable;" But this is not working for me. Basically
at the time of compilation compiler doesn't find my customwritable class
which i have placed in the mentioned folder.
plz help me in this endevor.
Thanks
deepak
Re: custom writable class
Posted by Shengkai Zhu <ge...@gmail.com>.
Here is the link
http://hadoop.apache.org/core/docs/current/mapred_tutorial.html
On Thu, Sep 18, 2008 at 9:16 PM, chanel <cm...@gmail.com> wrote:
> Where can you find the "Hadoop Map-Reduce Tutorial"?
>
>
> Shengkai Zhu wrote:
>
>> You can refer to the Hadoop Map-Reduce Tutorial
>>
>> On Thu, Sep 18, 2008 at 8:40 PM, Shengkai Zhu <ge...@gmail.com>
>> wrote:
>>
>>
>>
>>> Your custom implementation of any interface from hadoop-core should be
>>> archived together with the application (i.e. in the same jar).
>>> Andt he jar will be added to CLASSPATH of the task runner, then your
>>> "customwritable.java" could be found.
>>>
>>>
>>> On Thu, Sep 18, 2008 at 8:09 PM, Deepak Diwakar <ddeepak4u@gmail.com
>>> >wrote:
>>>
>>>
>>>
>>>> Hi,
>>>>
>>>> I am new to hadoop. For my map/reduce task I want to write my on custom
>>>> writable class. Could anyone please let me know where exactly to place
>>>> the
>>>> customwritable.java file?
>>>>
>>>> I found that in {hadoop-home}
>>>> /hadoop-{version}/src/java/org/apache/hadoop/io/ all type of writable
>>>> class
>>>> files are there.
>>>>
>>>> Then in the main task, we just include "import
>>>> org.apache.hadoop.io.{X}Writable;" But this is not working for me.
>>>> Basically
>>>> at the time of compilation compiler doesn't find my customwritable class
>>>> which i have placed in the mentioned folder.
>>>>
>>>> plz help me in this endevor.
>>>>
>>>> Thanks
>>>> deepak
>>>>
>>>>
>>>>
>>>
>>> --
>>>
>>> 朱盛凯
>>>
>>> Jash Zhu
>>>
>>> 复旦大学软件学院
>>>
>>> Software School, Fudan University
>>>
>>>
>>>
>>
>>
>>
>>
>
>
>
> No virus found in this outgoing message.
> Checked by AVG - http://www.avg.com
> Version: 8.0.169 / Virus Database: 270.6.21/1678 - Release Date: 9/18/2008
> 9:01 AM
>
>
--
朱盛凯
Jash Zhu
复旦大学软件学院
Software School, Fudan University
Re: custom writable class
Posted by chanel <cm...@gmail.com>.
Where can you find the "Hadoop Map-Reduce Tutorial"?
Shengkai Zhu wrote:
> You can refer to the Hadoop Map-Reduce Tutorial
>
> On Thu, Sep 18, 2008 at 8:40 PM, Shengkai Zhu <ge...@gmail.com> wrote:
>
>
>> Your custom implementation of any interface from hadoop-core should be
>> archived together with the application (i.e. in the same jar).
>> Andt he jar will be added to CLASSPATH of the task runner, then your
>> "customwritable.java" could be found.
>>
>>
>> On Thu, Sep 18, 2008 at 8:09 PM, Deepak Diwakar <dd...@gmail.com>wrote:
>>
>>
>>> Hi,
>>>
>>> I am new to hadoop. For my map/reduce task I want to write my on custom
>>> writable class. Could anyone please let me know where exactly to place the
>>> customwritable.java file?
>>>
>>> I found that in {hadoop-home}
>>> /hadoop-{version}/src/java/org/apache/hadoop/io/ all type of writable
>>> class
>>> files are there.
>>>
>>> Then in the main task, we just include "import
>>> org.apache.hadoop.io.{X}Writable;" But this is not working for me.
>>> Basically
>>> at the time of compilation compiler doesn't find my customwritable class
>>> which i have placed in the mentioned folder.
>>>
>>> plz help me in this endevor.
>>>
>>> Thanks
>>> deepak
>>>
>>>
>>
>> --
>>
>> 朱盛凯
>>
>> Jash Zhu
>>
>> 复旦大学软件学院
>>
>> Software School, Fudan University
>>
>>
>
>
>
>
Re: custom writable class
Posted by Shengkai Zhu <ge...@gmail.com>.
You can refer to the Hadoop Map-Reduce Tutorial
On Thu, Sep 18, 2008 at 8:40 PM, Shengkai Zhu <ge...@gmail.com> wrote:
>
> Your custom implementation of any interface from hadoop-core should be
> archived together with the application (i.e. in the same jar).
> Andt he jar will be added to CLASSPATH of the task runner, then your
> "customwritable.java" could be found.
>
>
> On Thu, Sep 18, 2008 at 8:09 PM, Deepak Diwakar <dd...@gmail.com>wrote:
>
>> Hi,
>>
>> I am new to hadoop. For my map/reduce task I want to write my on custom
>> writable class. Could anyone please let me know where exactly to place the
>> customwritable.java file?
>>
>> I found that in {hadoop-home}
>> /hadoop-{version}/src/java/org/apache/hadoop/io/ all type of writable
>> class
>> files are there.
>>
>> Then in the main task, we just include "import
>> org.apache.hadoop.io.{X}Writable;" But this is not working for me.
>> Basically
>> at the time of compilation compiler doesn't find my customwritable class
>> which i have placed in the mentioned folder.
>>
>> plz help me in this endevor.
>>
>> Thanks
>> deepak
>>
>
>
>
> --
>
> 朱盛凯
>
> Jash Zhu
>
> 复旦大学软件学院
>
> Software School, Fudan University
>
--
朱盛凯
Jash Zhu
复旦大学软件学院
Software School, Fudan University
Re: custom writable class
Posted by Shengkai Zhu <ge...@gmail.com>.
Your custom implementation of any interface from hadoop-core should be
archived together with the application (i.e. in the same jar).
Andt he jar will be added to CLASSPATH of the task runner, then your
"customwritable.java" could be found.
On Thu, Sep 18, 2008 at 8:09 PM, Deepak Diwakar <dd...@gmail.com> wrote:
> Hi,
>
> I am new to hadoop. For my map/reduce task I want to write my on custom
> writable class. Could anyone please let me know where exactly to place the
> customwritable.java file?
>
> I found that in {hadoop-home}
> /hadoop-{version}/src/java/org/apache/hadoop/io/ all type of writable
> class
> files are there.
>
> Then in the main task, we just include "import
> org.apache.hadoop.io.{X}Writable;" But this is not working for me.
> Basically
> at the time of compilation compiler doesn't find my customwritable class
> which i have placed in the mentioned folder.
>
> plz help me in this endevor.
>
> Thanks
> deepak
>
--
朱盛凯
Jash Zhu
复旦大学软件学院
Software School, Fudan University