You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/07/03 17:57:00 UTC
[jira] [Commented] (NUTCH-2375) Upgrade the code base from
org.apache.hadoop.mapred to org.apache.hadoop.mapreduce
[ https://issues.apache.org/jira/browse/NUTCH-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16072776#comment-16072776 ]
ASF GitHub Bot commented on NUTCH-2375:
---------------------------------------
Omkar20895 commented on issue #188: NUTCH-2375 Upgrade the code base from org.apache.hadoop.mapred to org.apache.hadoop.mapreduce
URL: https://github.com/apache/nutch/pull/188#issuecomment-312704405
Hi,
These are the warnings and errors that I am getting right now and unable to solve.
```
compile-core-test:
[javac] Compiling 54 source files to /Users/omkar/Documents/Git/nutch/build/test/classes
[javac] /Users/omkar/Documents/Git/nutch/src/test/org/apache/nutch/crawl/CrawlDbUpdateTestDriver.java:95: warning: [deprecation] setConfiguration(Configuration) in TestDriver has been deprecated
[javac] reduceDriver.setConfiguration(configuration);
[javac] ^
[javac] /Users/omkar/Documents/Git/nutch/src/test/org/apache/nutch/crawl/CrawlDbUpdateUtil.java:58: error: cannot find symbol
[javac] reducer.configure(Job.getInstance(conf));
[javac] ^
[javac] symbol: method configure(Job)
[javac] location: variable reducer of type T
[javac] where T is a type-variable:
[javac] T extends Reducer<Text,CrawlDatum,Text,CrawlDatum> declared in class CrawlDbUpdateUtil
```
The reducer we are referring to here is [CrawlDbReducer](https://github.com/apache/nutch/blob/3e2d3d456489bf52bc586dae0e2e71fb7aad8fe7/src/java/org/apache/nutch/crawl/CrawlDbReducer.java) and even though it has a configure method in it I am getting the error.
```
[javac] /Users/omkar/Documents/Git/nutch/src/test/org/apache/nutch/crawl/CrawlDbUpdateUtil.java:62: error: CrawlDbUpdateUtil.DummyContext is not abstract and does not override abstract method write(Object,Object) in TaskInputOutputContext
[javac] private class DummyContext extends Context {
[javac] ^
[javac]
```
Here I have already overrided the write method but still I am getting this error.
```
/Users/omkar/Documents/Git/nutch/src/test/org/apache/nutch/crawl/CrawlDbUpdateUtil.java:124: error: reduce(KEYIN,Iterable<VALUEIN>,Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT>.Context) has protected access in Reducer
[javac] reducer.reduce(dummyURL, (Iterable)values, context);
[javac] ^
[javac] where KEYIN,VALUEIN,KEYOUT,VALUEOUT are type-variables:
[javac] KEYIN extends Object declared in class Reducer
[javac] VALUEIN extends Object declared in class Reducer
[javac] KEYOUT extends Object declared in class Reducer
[javac] VALUEOUT extends Object declared in class Reducer
[javac] /Users/omkar/Documents/Git/nutch/src/test/org/apache/nutch/indexer/TestIndexerMapReduce.java:172: warning: [deprecation] setConfiguration(Configuration) in TestDriver has been deprecated
[javac] reduceDriver.setConfiguration(configuration);
[javac] ^
[javac] Note: /Users/omkar/Documents/Git/nutch/src/test/org/apache/nutch/crawl/CrawlDbUpdateUtil.java uses unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 3 errors
[javac] 2 warnings
```
Please pull and try out the latest commit to reproduce the errors and use the command "ant clean runtime test". The runtime build is successful but the test will give errors. Thanks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> Upgrade the code base from org.apache.hadoop.mapred to org.apache.hadoop.mapreduce
> ----------------------------------------------------------------------------------
>
> Key: NUTCH-2375
> URL: https://issues.apache.org/jira/browse/NUTCH-2375
> Project: Nutch
> Issue Type: Improvement
> Components: deployment
> Reporter: Omkar Reddy
>
> Nutch is still using the deprecated org.apache.hadoop.mapred dependency which has been deprecated. It need to be updated to org.apache.hadoop.mapreduce dependency.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)