You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2013/01/12 19:44:12 UTC
[jira] [Updated] (NUTCH-1447) Nutch 2.x with Cloudera CDH 4 get
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but
class was expected
[ https://issues.apache.org/jira/browse/NUTCH-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lewis John McGibbney updated NUTCH-1447:
----------------------------------------
Fix Version/s: 2.2
> Nutch 2.x with Cloudera CDH 4 get Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: NUTCH-1447
> URL: https://issues.apache.org/jira/browse/NUTCH-1447
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.1
> Environment: Cloudera CDH4
> Reporter: Trần Anh Tuấn
> Fix For: 2.2
>
>
> I'm trying to crawl using Nutch 2.
> I check out source from
> http://svn.apache.org/repos/asf/nutch/branches/2.x/ and config with
> mysql.
> I get error but when run nutch 1.5 everything okie :(
> mkdir urls
> echo nutch.apache.org > urls/seed.txt
> runtime/deploy/bin/nutch inject urls
> 12/08/07 11:25:38 INFO crawl.InjectorJob: InjectorJob: starting
> 12/08/07 11:25:38 INFO crawl.InjectorJob: InjectorJob: urlDir: urls
> 12/08/07 11:25:41 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the
> same.
> 12/08/07 11:25:44 INFO input.FileInputFormat: Total input paths to process : 1
> 12/08/07 11:25:45 INFO util.NativeCodeLoader: Loaded the native-hadoop library
> 12/08/07 11:25:45 WARN snappy.LoadSnappy: Snappy native library is available
> 12/08/07 11:25:45 INFO snappy.LoadSnappy: Snappy native
> 12/08/07 11:25:47 INFO mapred.JobClient: map 0% reduce 0%
> 12/08/07 11:26:01 INFO mapred.JobClient: Task Id :
> attempt_201208071123_0001_m_000000_0, Status : FAILED
> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext,
> but class was expected
> attempt_201208071123_0001_m_000000_0: SLF4J: Class path contains
> multiple SLF4J bindings.
> attempt_201208071123_0001_m_000000_0: SLF4J: Found binding in
> [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> attempt_201208071123_0001_m_000000_0: SLF4J: Found binding in
> [jar:file:/var/lib/hadoop-hdfs/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201208071123_0001/jars/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> attempt_201208071123_0001_m_000000_0: SLF4J: See
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 12/08/07 11:26:05 INFO mapred.JobClient: Task Id :
> attempt_201208071123_0001_m_000000_1, Status : FAILED
> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext,
> but class was expected
> attempt_201208071123_0001_m_000000_1: SLF4J: Class path contains
> multiple SLF4J bindings.
> attempt_201208071123_0001_m_000000_1: SLF4J: Found binding in
> [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> attempt_201208071123_0001_m_000000_1: SLF4J: Found binding in
> [jar:file:/var/lib/hadoop-hdfs/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201208071123_0001/jars/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> attempt_201208071123_0001_m_000000_1: SLF4J: See
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 12/08/07 11:26:10 INFO mapred.JobClient: Task Id :
> attempt_201208071123_0001_m_000000_2, Status : FAILED
> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext,
> but class was expected
> attempt_201208071123_0001_m_000000_2: SLF4J: Class path contains
> multiple SLF4J bindings.
> attempt_201208071123_0001_m_000000_2: SLF4J: Found binding in
> [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> attempt_201208071123_0001_m_000000_2: SLF4J: Found binding in
> [jar:file:/var/lib/hadoop-hdfs/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201208071123_0001/jars/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> attempt_201208071123_0001_m_000000_2: SLF4J: See
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 12/08/07 11:26:19 INFO mapred.JobClient: Job complete: job_201208071123_0001
> 12/08/07 11:26:19 INFO mapred.JobClient: Counters: 7
> 12/08/07 11:26:19 INFO mapred.JobClient: Job Counters
> 12/08/07 11:26:19 INFO mapred.JobClient: Failed map tasks=1
> 12/08/07 11:26:19 INFO mapred.JobClient: Launched map tasks=4
> 12/08/07 11:26:19 INFO mapred.JobClient: Data-local map tasks=4
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> maps in occupied slots (ms)=18003
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> reduces in occupied slots (ms)=0
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> maps waiting after reserving slots (ms)=0
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> reduces waiting after reserving slots (ms)=0
> 12/08/07 11:26:19 ERROR crawl.InjectorJob: InjectorJob:
> java.lang.RuntimeException: job failed: name=inject-p1 urls,
> jobid=job_201208071123_0001
> at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:47)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:248)
> at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:288)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:298)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
> And log
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.CounterGroup, but class was expected
> at org.apache.nutch.util.ToolUtil.recordJobStatus(ToolUtil.java:59)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:249)
> at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:288)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:298)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
> Thanks
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira