You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by aonewa <ao...@hotmail.com> on 2007/12/12 08:54:11 UTC
Re: Error Nutchwax Search
hadoop use gcj java but St.Ack said to try SUN's JDK that means modify code
in hadoop, yes or no?
stack-3 wrote:
>
> Try SUN's JDK. You are using the default gcj java on your, I presume,
> red hat 7 linux install. It looks like it might have encoding issues.
>
> St.Ack
>
> P.S. IIRC, this question has been answered already on this list. Also,
> nutchwax has its own list that would be more appropriate to questions of
> this sort. See
> http://archive-access.sourceforge.net/projects/nutch/mail-lists.html
>
>
--
View this message in context: http://www.nabble.com/Error-Nutchwax-Search-tp13967873p14290462.html
Sent from the Hadoop Users mailing list archive at Nabble.com.
Re: Error Nutchwax Search
Posted by aonewa <ao...@hotmail.com>.
now my machine have sun java jdk1.6.0_01 and set $JAVA_HOME already, i search
by tomcat which i install with command "yum install tomcat" that use jvm
java it is not match with index time, i want to know how i config it
Stefan Groschupf-2 wrote:
>
> Just install sun jdk on your machine and update the $JAVA_HOME
> environment variable.
> That should be all you need to do.
> No hadoop modification necessary.
>
> On Dec 11, 2007, at 11:54 PM, aonewa wrote:
>
>>
>> hadoop use gcj java but St.Ack said to try SUN's JDK that means
>> modify code
>> in hadoop, yes or no?
>>
>>
>> stack-3 wrote:
>>>
>>> Try SUN's JDK. You are using the default gcj java on your, I
>>> presume,
>>> red hat 7 linux install. It looks like it might have encoding
>>> issues.
>>>
>>> St.Ack
>>>
>>> P.S. IIRC, this question has been answered already on this list.
>>> Also,
>>> nutchwax has its own list that would be more appropriate to
>>> questions of
>>> this sort. See
>>> http://archive-access.sourceforge.net/projects/nutch/mail-lists.html
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Error-Nutchwax-Search-tp13967873p14290462.html
>> Sent from the Hadoop Users mailing list archive at Nabble.com.
>>
>>
>
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> 101tec Inc.
> Menlo Park, California, USA
> http://www.101tec.com
>
>
>
>
--
View this message in context: http://www.nabble.com/Error-Nutchwax-Search-tp13967873p14291021.html
Sent from the Hadoop Users mailing list archive at Nabble.com.
Re: Error Nutchwax Search
Posted by Stefan Groschupf <sg...@101tec.com>.
Just install sun jdk on your machine and update the $JAVA_HOME
environment variable.
That should be all you need to do.
No hadoop modification necessary.
On Dec 11, 2007, at 11:54 PM, aonewa wrote:
>
> hadoop use gcj java but St.Ack said to try SUN's JDK that means
> modify code
> in hadoop, yes or no?
>
>
> stack-3 wrote:
>>
>> Try SUN's JDK. You are using the default gcj java on your, I
>> presume,
>> red hat 7 linux install. It looks like it might have encoding
>> issues.
>>
>> St.Ack
>>
>> P.S. IIRC, this question has been answered already on this list.
>> Also,
>> nutchwax has its own list that would be more appropriate to
>> questions of
>> this sort. See
>> http://archive-access.sourceforge.net/projects/nutch/mail-lists.html
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Error-Nutchwax-Search-tp13967873p14290462.html
> Sent from the Hadoop Users mailing list archive at Nabble.com.
>
>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
101tec Inc.
Menlo Park, California, USA
http://www.101tec.com
Re: Error Nutchwax Search
Posted by Andrzej Bialecki <ab...@getopt.org>.
Owen O'Malley wrote:
>
> On Dec 12, 2007, at 1:36 PM, Andrzej Bialecki wrote:
>
>> Ted Dunning wrote:
>>> Hadoop *normally* uses the Sun JDK. Using gcj successfully would be
>>> a bit
>>> of a surprise.
>>
>> GCJ 4.2 does NOT work. With minor tweaks it's possible to compile all
>> Hadoop classes, including contrib, but it doesn't run properly. The
>> offending class is org.apache.hadoop.io.Text (CharacterEncoder works
>> differently from the Sun implementation, perhaps it's broken). This
>> class (Text) is widely used throughout Hadoop, so it won't work with
>> GCJ for now ...
>
> If anyone knows of specific problems or workarounds, it would be great
> to share them. I thought that gcj was still missing a lot of the the
> java 1.5 libraries...
AFAIK few GUI applications run successfully - AWT / Swing support is
still shaky, but most other APIs are in good shape.
>
> Actually, the piece I'd love to see working under gcj is the hdfs
> client. I bet gcj would perform better that using jni in libhdfs.
I tried to find some info about this bug in GCJ 4.3, perhaps it's fixed
(I don't know what input caused this error, but there was some work done
on CharacterEncoder since 4.2 release).
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
Re: Error Nutchwax Search
Posted by Owen O'Malley <oo...@yahoo-inc.com>.
On Dec 12, 2007, at 1:36 PM, Andrzej Bialecki wrote:
> Ted Dunning wrote:
>> Hadoop *normally* uses the Sun JDK. Using gcj successfully would
>> be a bit
>> of a surprise.
>
> GCJ 4.2 does NOT work. With minor tweaks it's possible to compile
> all Hadoop classes, including contrib, but it doesn't run properly.
> The offending class is org.apache.hadoop.io.Text (CharacterEncoder
> works differently from the Sun implementation, perhaps it's
> broken). This class (Text) is widely used throughout Hadoop, so it
> won't work with GCJ for now ...
If anyone knows of specific problems or workarounds, it would be
great to share them. I thought that gcj was still missing a lot of
the the java 1.5 libraries...
Actually, the piece I'd love to see working under gcj is the hdfs
client. I bet gcj would perform better that using jni in libhdfs.
-- Owen
Re: Error Nutchwax Search
Posted by Ted Dunning <td...@veoh.com>.
I guess it would be even more of a surprise, then.
:-)
On 12/12/07 1:36 PM, "Andrzej Bialecki" <ab...@getopt.org> wrote:
>> Using gcj successfully would be a bit of a surprise.
>
> GCJ 4.2 does NOT work.
Re: Error Nutchwax Search
Posted by Andrzej Bialecki <ab...@getopt.org>.
Ted Dunning wrote:
> Hadoop *normally* uses the Sun JDK. Using gcj successfully would be a bit
> of a surprise.
GCJ 4.2 does NOT work. With minor tweaks it's possible to compile all
Hadoop classes, including contrib, but it doesn't run properly. The
offending class is org.apache.hadoop.io.Text (CharacterEncoder works
differently from the Sun implementation, perhaps it's broken). This
class (Text) is widely used throughout Hadoop, so it won't work with GCJ
for now ...
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
Re: Error Nutchwax Search
Posted by Ted Dunning <td...@veoh.com>.
Hadoop *normally* uses the Sun JDK. Using gcj successfully would be a bit
of a surprise.
On 12/11/07 11:54 PM, "aonewa" <ao...@hotmail.com> wrote:
>
> hadoop use gcj java but St.Ack said to try SUN's JDK that means modify code
> in hadoop, yes or no?
>
>
> stack-3 wrote:
>>
>> Try SUN's JDK. You are using the default gcj java on your, I presume,
>> red hat 7 linux install. It looks like it might have encoding issues.
>>
>> St.Ack
>>
>> P.S. IIRC, this question has been answered already on this list. Also,
>> nutchwax has its own list that would be more appropriate to questions of
>> this sort. See
>> http://archive-access.sourceforge.net/projects/nutch/mail-lists.html
>>
>>