You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by ramires <uy...@beriltech.com> on 2007/09/10 15:20:01 UTC
hadoop upgrade version mismatch
hii
I use nutch 9.0 with hadoop 0.13.1. I upgrade hadoop 0.14.1 this morning (
i installed it diffrent directory) than I try to crawl some site with nutch
but i get this error message every try??
07/09/10 16:13:53 FATAL crawl.Injector: Injector:
java.lang.RuntimeException: org.apache.hadoop.ipc.RPC$VersionMismatch:
Protocol org.apache.hadoop.dfs.ClientProtocol version mismatch. (client = 9,
server = 14)
at
org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:252)
at org.apache.hadoop.mapred.JobConf.setInputPath(JobConf.java:155)
at org.apache.nutch.crawl.Injector.inject(Injector.java:154)
at org.apache.nutch.crawl.Injector.run(Injector.java:192)
at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:189)
at org.apache.nutch.crawl.Injector.main(Injector.java:182)
--
View this message in context: http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12592578
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: hadoop upgrade version mismatch
Posted by Doğacan Güney <do...@gmail.com>.
Hi,
On 9/12/07, Uygar BAYAR <uy...@beriltech.com> wrote:
>
> hi
> Version mismatch problem solved . I forgot to change
> hadoop-0.12.2-core.jar in lib directory with hadoop-0.14.1-core.jar. But i
> get diffrent error message now. Like that :
>
> 07/09/12 14:00:58 INFO crawl.Injector: Injector: starting
> 07/09/12 14:00:58 INFO crawl.Injector: Injector: crawlDb:
> sirketce/crawled/crawldb
> 07/09/12 14:00:58 INFO crawl.Injector: Injector: urlDir: sirketce/urls
> 07/09/12 14:00:58 INFO crawl.Injector: Injector: Converting injected urls to
> crawl db entries.
> Exception in thread "main" java.lang.NoSuchMethodError:
NoSuchMethodError indicates that you are a) haven't cleanup old build
dir (do ant clean first) b) there is still some sort of hadoop version
mismatch (somehow, nutch compiles against a different hadoop version
but uses another at runtime).
So, your best choice is to try doing an "ant clean;ant" (across all
your machines) and making sure that there is only one hadoop jar in
lib.
> org.apache.hadoop.mapred.JobClient.runJob(Lorg/apache/hadoop/mapred/JobConf;)V
> at org.apache.nutch.crawl.Injector.inject(Injector.java:162)
> at org.apache.nutch.crawl.Injector.run(Injector.java:192)
> at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
> at org.apache.nutch.crawl.Injector.main(Injector.java:182)
>
>
>
> Doğacan Güney-3 wrote:
> >
> > Hi,
> >
> > On 9/10/07, ramires <uy...@beriltech.com> wrote:
> >>
> >> hii
> >> I use nutch 9.0 with hadoop 0.13.1. I upgrade hadoop 0.14.1 this morning
> >> (
> >> i installed it diffrent directory) than I try to crawl some site with
> >> nutch
> >> but i get this error message every try??
> >
> > It seems you have updated hadoop at client side, but not at server
> > side, which causes two different hadoop version try to (and fail to)
> > communicate with each other. Try updating JobTracker and TaskTracker
> > hadoop jars followed by an "ant clean;ant"
> >
> >>
> >> 07/09/10 16:13:53 FATAL crawl.Injector: Injector:
> >> java.lang.RuntimeException: org.apache.hadoop.ipc.RPC$VersionMismatch:
> >> Protocol org.apache.hadoop.dfs.ClientProtocol version mismatch. (client =
> >> 9,
> >> server = 14)
> >> at
> >> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:252)
> >> at
> >> org.apache.hadoop.mapred.JobConf.setInputPath(JobConf.java:155)
> >> at org.apache.nutch.crawl.Injector.inject(Injector.java:154)
> >> at org.apache.nutch.crawl.Injector.run(Injector.java:192)
> >> at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:189)
> >> at org.apache.nutch.crawl.Injector.main(Injector.java:182)
> >>
> >> --
> >> View this message in context:
> >> http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12592578
> >> Sent from the Nutch - User mailing list archive at Nabble.com.
> >>
> >>
> >
> >
> > --
> > Doğacan Güney
> >
> >
>
> --
> View this message in context: http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12631125
> Sent from the Nutch - User mailing list archive at Nabble.com.
>
>
--
Doğacan Güney
Re: hadoop upgrade version mismatch
Posted by Uygar BAYAR <uy...@beriltech.com>.
hi
i installed hadoop 0.14.1 with ant and copy all builded files in orjinal
nutch directory. I also check JobTracker and TaskTracker clasess they
changed with new ones. It still same..
Doğacan Güney-3 wrote:
>
> Hi,
>
> On 9/10/07, ramires <uy...@beriltech.com> wrote:
>>
>> hii
>> I use nutch 9.0 with hadoop 0.13.1. I upgrade hadoop 0.14.1 this morning
>> (
>> i installed it diffrent directory) than I try to crawl some site with
>> nutch
>> but i get this error message every try??
>
> It seems you have updated hadoop at client side, but not at server
> side, which causes two different hadoop version try to (and fail to)
> communicate with each other. Try updating JobTracker and TaskTracker
> hadoop jars followed by an "ant clean;ant"
>
>>
>> 07/09/10 16:13:53 FATAL crawl.Injector: Injector:
>> java.lang.RuntimeException: org.apache.hadoop.ipc.RPC$VersionMismatch:
>> Protocol org.apache.hadoop.dfs.ClientProtocol version mismatch. (client =
>> 9,
>> server = 14)
>> at
>> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:252)
>> at
>> org.apache.hadoop.mapred.JobConf.setInputPath(JobConf.java:155)
>> at org.apache.nutch.crawl.Injector.inject(Injector.java:154)
>> at org.apache.nutch.crawl.Injector.run(Injector.java:192)
>> at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:189)
>> at org.apache.nutch.crawl.Injector.main(Injector.java:182)
>>
>> --
>> View this message in context:
>> http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12592578
>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>
>>
>
>
> --
> Doğacan Güney
>
>
--
View this message in context: http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12631125
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: hadoop upgrade version mismatch
Posted by Uygar BAYAR <uy...@beriltech.com>.
hi
Version mismatch problem solved . I forgot to change
hadoop-0.12.2-core.jar in lib directory with hadoop-0.14.1-core.jar. But i
get diffrent error message now. Like that :
07/09/12 14:00:58 INFO crawl.Injector: Injector: starting
07/09/12 14:00:58 INFO crawl.Injector: Injector: crawlDb:
sirketce/crawled/crawldb
07/09/12 14:00:58 INFO crawl.Injector: Injector: urlDir: sirketce/urls
07/09/12 14:00:58 INFO crawl.Injector: Injector: Converting injected urls to
crawl db entries.
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.mapred.JobClient.runJob(Lorg/apache/hadoop/mapred/JobConf;)V
at org.apache.nutch.crawl.Injector.inject(Injector.java:162)
at org.apache.nutch.crawl.Injector.run(Injector.java:192)
at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
at org.apache.nutch.crawl.Injector.main(Injector.java:182)
Doğacan Güney-3 wrote:
>
> Hi,
>
> On 9/10/07, ramires <uy...@beriltech.com> wrote:
>>
>> hii
>> I use nutch 9.0 with hadoop 0.13.1. I upgrade hadoop 0.14.1 this morning
>> (
>> i installed it diffrent directory) than I try to crawl some site with
>> nutch
>> but i get this error message every try??
>
> It seems you have updated hadoop at client side, but not at server
> side, which causes two different hadoop version try to (and fail to)
> communicate with each other. Try updating JobTracker and TaskTracker
> hadoop jars followed by an "ant clean;ant"
>
>>
>> 07/09/10 16:13:53 FATAL crawl.Injector: Injector:
>> java.lang.RuntimeException: org.apache.hadoop.ipc.RPC$VersionMismatch:
>> Protocol org.apache.hadoop.dfs.ClientProtocol version mismatch. (client =
>> 9,
>> server = 14)
>> at
>> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:252)
>> at
>> org.apache.hadoop.mapred.JobConf.setInputPath(JobConf.java:155)
>> at org.apache.nutch.crawl.Injector.inject(Injector.java:154)
>> at org.apache.nutch.crawl.Injector.run(Injector.java:192)
>> at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:189)
>> at org.apache.nutch.crawl.Injector.main(Injector.java:182)
>>
>> --
>> View this message in context:
>> http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12592578
>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>
>>
>
>
> --
> Doğacan Güney
>
>
--
View this message in context: http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12631125
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: hadoop upgrade version mismatch
Posted by Doğacan Güney <do...@gmail.com>.
Hi,
On 9/10/07, ramires <uy...@beriltech.com> wrote:
>
> hii
> I use nutch 9.0 with hadoop 0.13.1. I upgrade hadoop 0.14.1 this morning (
> i installed it diffrent directory) than I try to crawl some site with nutch
> but i get this error message every try??
It seems you have updated hadoop at client side, but not at server
side, which causes two different hadoop version try to (and fail to)
communicate with each other. Try updating JobTracker and TaskTracker
hadoop jars followed by an "ant clean;ant"
>
> 07/09/10 16:13:53 FATAL crawl.Injector: Injector:
> java.lang.RuntimeException: org.apache.hadoop.ipc.RPC$VersionMismatch:
> Protocol org.apache.hadoop.dfs.ClientProtocol version mismatch. (client = 9,
> server = 14)
> at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:252)
> at org.apache.hadoop.mapred.JobConf.setInputPath(JobConf.java:155)
> at org.apache.nutch.crawl.Injector.inject(Injector.java:154)
> at org.apache.nutch.crawl.Injector.run(Injector.java:192)
> at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:189)
> at org.apache.nutch.crawl.Injector.main(Injector.java:182)
>
> --
> View this message in context: http://www.nabble.com/hadoop-upgrade-version-mismatch-tf4414598.html#a12592578
> Sent from the Nutch - User mailing list archive at Nabble.com.
>
>
--
Doğacan Güney