You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Tolga <to...@ozses.net> on 2012/08/27 08:50:33 UTC

bin/nutch

Hi,

I can find only src/bin/nutch in 2.0-src.zip. There's no bin/nutch. Does 
that mean I have to compile it?

Regards,

RE: bin/nutch

Posted by Markus Jelsma <ma...@openindex.io>.
It should be in runtime/(local|deploy)/bin/ after the build.

Cheers

 
 
-----Original message-----
> From:Tolga <to...@ozses.net>
> Sent: Mon 27-Aug-2012 08:53
> To: user@nutch.apache.org
> Subject: bin/nutch
> 
> Hi,
> 
> I can find only src/bin/nutch in 2.0-src.zip. There's no bin/nutch. Does 
> that mean I have to compile it?
> 
> Regards,
> 

Re: bin/nutch

Posted by peterbarretto <pe...@gmail.com>.
i get a similar error for nutch 2.1 ,how do i fix it? :

Buildfile: C:\apache-nutch-2.1\build.xml
  [taskdef] Could not load definitions from resource
org/sonar/ant/antlib.xml. It could not be found.

ivy-probe-antlib:

ivy-download:
  [taskdef] Could not load definitions from resource
org/sonar/ant/antlib.xml. It could not be found.

ivy-download-unchecked:

ivy-init-antlib:

ivy-init:

init:

clean-lib:
   [delete] Deleting directory C:\apache-nutch-2.1\build\lib

resolve-default:
[ivy:resolve] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ ::
[ivy:resolve] :: loading settings :: file =
C:\apache-nutch-2.1\ivy\ivysettings.xml
  [taskdef] Could not load definitions from resource
org/sonar/ant/antlib.xml. It could not be found.

copy-libs:

compile-core:
    [javac] C:\apache-nutch-2.1\build.xml:97: warning: 'includeantruntime'
was not set, defaulting to build.sysclasspath=last; set to false for
repeatable builds
    [javac] Compiling 181 source files to C:\apache-nutch-2.1\build\classes
    [javac] warning: [path] bad path element
"C:\apache-nutch-2.1\build\lib\activation.jar": no such file or directory
    [javac] warning: [options] bootstrap class path not set in conjunction
with -source 1.6
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\APIInfoResource.java:23:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.Get;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\APIInfoResource.java:24:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.ServerResource;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\APIInfoResource.java:26:
error: cannot find symbol
    [javac] public class APIInfoResource extends ServerResource {
    [javac]                                      ^
    [javac]   symbol: class ServerResource
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\AdminResource.java:23:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.Get;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\AdminResource.java:24:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.ServerResource;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\AdminResource.java:28:
error: cannot find symbol
    [javac] public class AdminResource extends ServerResource {
    [javac]                                    ^
    [javac]   symbol: class ServerResource
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:22:
error: package org.restlet.data does not exist
    [javac] import org.restlet.data.Form;
    [javac]                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:23:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.Delete;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:24:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.Get;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:25:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.Post;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:26:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.Put;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:27:
error: package org.restlet.resource does not exist
    [javac] import org.restlet.resource.ServerResource;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:29:
error: cannot find symbol
    [javac] public class ConfResource extends ServerResource {
    [javac]                                   ^
    [javac]   symbol: class ServerResource
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:29: error:
package org.apache.avro.util does not exist
    [javac] import org.apache.avro.util.Utf8;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:30: error:
package org.apache.gora.query does not exist
    [javac] import org.apache.gora.query.Query;
    [javac]                             ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:31: error:
package org.apache.gora.query does not exist
    [javac] import org.apache.gora.query.Result;
    [javac]                             ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:32: error:
package org.apache.gora.store does not exist
    [javac] import org.apache.gora.store.DataStore;
    [javac]                             ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:52: error:
cannot find symbol
    [javac]   DataStore<String,WebPage> store;
    [javac]   ^
    [javac]   symbol:   class DataStore
    [javac]   location: class DbReader
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:22:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Protocol;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:23:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Schema;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:24:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.AvroRuntimeException;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:25:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Protocol;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:26:
error: package org.apache.avro.util does not exist
    [javac] import org.apache.avro.util.Utf8;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:27:
error: package org.apache.avro.ipc does not exist
    [javac] import org.apache.avro.ipc.AvroRemoteException;
    [javac]                           ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:28:
error: package org.apache.avro.generic does not exist
    [javac] import org.apache.avro.generic.GenericArray;
    [javac]                               ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:29:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificExceptionBase;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:30:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificRecordBase;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:31:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificRecord;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:32:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificFixed;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:33:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.StateManager;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:34:
error: package org.apache.gora.persistency.impl does not exist
    [javac] import org.apache.gora.persistency.impl.PersistentBase;
    [javac]                                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:35:
error: package org.apache.gora.persistency.impl does not exist
    [javac] import org.apache.gora.persistency.impl.StateManagerImpl;
    [javac]                                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:36:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.StatefulHashMap;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:37:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.ListGenericArray;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:40:
error: cannot find symbol
    [javac] public class WebPage extends PersistentBase {
    [javac]                              ^
    [javac]   symbol: class PersistentBase
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:41:
error: cannot find symbol
    [javac]   public static final Schema _SCHEMA =
Schema.parse("{\"type\":\"record\",\"name\":\"WebPage\",\"namespace\":\"org.apache.nutch.storage\",\"fields\":[{\"name\":\"baseUrl\",\"type\":\"string\"},{\"name\":\"status\",\"type\":\"int\"},{\"name\":\"fetchTime\",\"type\":\"long\"},{\"name\":\"prevFetchTime\",\"type\":\"long\"},{\"name\":\"fetchInterval\",\"type\":\"int\"},{\"name\":\"retriesSinceFetch\",\"type\":\"int\"},{\"name\":\"modifiedTime\",\"type\":\"long\"},{\"name\":\"protocolStatus\",\"type\":{\"type\":\"record\",\"name\":\"ProtocolStatus\",\"fields\":[{\"name\":\"code\",\"type\":\"int\"},{\"name\":\"args\",\"type\":{\"type\":\"array\",\"items\":\"string\"}},{\"name\":\"lastModified\",\"type\":\"long\"}]}},{\"name\":\"content\",\"type\":\"bytes\"},{\"name\":\"contentType\",\"type\":\"string\"},{\"name\":\"prevSignature\",\"type\":\"bytes\"},{\"name\":\"signature\",\"type\":\"bytes\"},{\"name\":\"title\",\"type\":\"string\"},{\"name\":\"text\",\"type\":\"string\"},{\"name\":\"parseStatus\",\"type\":{\"type\":\"record\",\"name\":\"ParseStatus\",\"fields\":[{\"name\":\"majorCode\",\"type\":\"int\"},{\"name\":\"minorCode\",\"type\":\"int\"},{\"name\":\"args\",\"type\":{\"type\":\"array\",\"items\":\"string\"}}]}},{\"name\":\"score\",\"type\":\"float\"},{\"name\":\"reprUrl\",\"type\":\"string\"},{\"name\":\"headers\",\"type\":{\"type\":\"map\",\"values\":\"string\"}},{\"name\":\"outlinks\",\"type\":{\"type\":\"map\",\"values\":\"string\"}},{\"name\":\"inlinks\",\"type\":{\"type\":\"map\",\"values\":\"string\"}},{\"name\":\"markers\",\"type\":{\"type\":\"map\",\"values\":\"string\"}},{\"name\":\"metadata\",\"type\":{\"type\":\"map\",\"values\":\"bytes\"}}]}");
    [javac]                       ^
    [javac]   symbol:   class Schema
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:77:
error: cannot find symbol
    [javac]   private Utf8 baseUrl;
    [javac]           ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:22:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Protocol;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:23:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Schema;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:24:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.AvroRuntimeException;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:25:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Protocol;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:26:
error: package org.apache.avro.util does not exist
    [javac] import org.apache.avro.util.Utf8;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:27:
error: package org.apache.avro.ipc does not exist
    [javac] import org.apache.avro.ipc.AvroRemoteException;
    [javac]                           ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:28:
error: package org.apache.avro.generic does not exist
    [javac] import org.apache.avro.generic.GenericArray;
    [javac]                               ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:29:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificExceptionBase;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:30:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificRecordBase;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:31:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificRecord;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:32:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificFixed;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:33:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.StateManager;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:34:
error: package org.apache.gora.persistency.impl does not exist
    [javac] import org.apache.gora.persistency.impl.PersistentBase;
    [javac]                                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:35:
error: package org.apache.gora.persistency.impl does not exist
    [javac] import org.apache.gora.persistency.impl.StateManagerImpl;
    [javac]                                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:36:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.StatefulHashMap;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:37:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.ListGenericArray;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ProtocolStatus.java:40:
error: cannot find symbol
    [javac] public class ProtocolStatus extends PersistentBase {
    [javac]                                     ^
    [javac]   symbol: class PersistentBase
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:86:
error: cannot find symbol
    [javac]   private Utf8 contentType;
    [javac]           ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:89:
error: cannot find symbol
    [javac]   private Utf8 title;
    [javac]           ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:90:
error: cannot find symbol
    [javac]   private Utf8 text;
    [javac]           ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:22:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Protocol;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:23:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Schema;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:24:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.AvroRuntimeException;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:25:
error: package org.apache.avro does not exist
    [javac] import org.apache.avro.Protocol;
    [javac]                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:26:
error: package org.apache.avro.util does not exist
    [javac] import org.apache.avro.util.Utf8;
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:27:
error: package org.apache.avro.ipc does not exist
    [javac] import org.apache.avro.ipc.AvroRemoteException;
    [javac]                           ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:28:
error: package org.apache.avro.generic does not exist
    [javac] import org.apache.avro.generic.GenericArray;
    [javac]                               ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:29:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificExceptionBase;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:30:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificRecordBase;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:31:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificRecord;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:32:
error: package org.apache.avro.specific does not exist
    [javac] import org.apache.avro.specific.SpecificFixed;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:33:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.StateManager;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:34:
error: package org.apache.gora.persistency.impl does not exist
    [javac] import org.apache.gora.persistency.impl.PersistentBase;
    [javac]                                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:35:
error: package org.apache.gora.persistency.impl does not exist
    [javac] import org.apache.gora.persistency.impl.StateManagerImpl;
    [javac]                                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:36:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.StatefulHashMap;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:37:
error: package org.apache.gora.persistency does not exist
    [javac] import org.apache.gora.persistency.ListGenericArray;
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\ParseStatus.java:40:
error: cannot find symbol
    [javac] public class ParseStatus extends PersistentBase {
    [javac]                                  ^
    [javac]   symbol: class PersistentBase
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:93:
error: cannot find symbol
    [javac]   private Utf8 reprUrl;
    [javac]           ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:94:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> headers;
    [javac]               ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:94:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> headers;
    [javac]                    ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:95:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> outlinks;
    [javac]               ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:95:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> outlinks;
    [javac]                    ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:96:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> inlinks;
    [javac]               ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:96:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> inlinks;
    [javac]                    ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:97:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> markers;
    [javac]               ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:97:
error: cannot find symbol
    [javac]   private Map<Utf8,Utf8> markers;
    [javac]                    ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:98:
error: cannot find symbol
    [javac]   private Map<Utf8,ByteBuffer> metadata;
    [javac]               ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:102:
error: cannot find symbol
    [javac]   public WebPage(StateManager stateManager) {
    [javac]                  ^
    [javac]   symbol:   class StateManager
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:110:
error: cannot find symbol
    [javac]   public WebPage newInstance(StateManager stateManager) {
    [javac]                              ^
    [javac]   symbol:   class StateManager
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:113:
error: cannot find symbol
    [javac]   public Schema getSchema() { return _SCHEMA; }
    [javac]          ^
    [javac]   symbol:   class Schema
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:171:
error: cannot find symbol
    [javac]   public Utf8 getBaseUrl() {
    [javac]          ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:174:
error: cannot find symbol
    [javac]   public void setBaseUrl(Utf8 value) {
    [javac]                          ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:225:
error: cannot find symbol
    [javac]   public Utf8 getContentType() {
    [javac]          ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:228:
error: cannot find symbol
    [javac]   public void setContentType(Utf8 value) {
    [javac]                              ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:243:
error: cannot find symbol
    [javac]   public Utf8 getTitle() {
    [javac]          ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:246:
error: cannot find symbol
    [javac]   public void setTitle(Utf8 value) {
    [javac]                        ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:249:
error: cannot find symbol
    [javac]   public Utf8 getText() {
    [javac]          ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:252:
error: cannot find symbol
    [javac]   public void setText(Utf8 value) {
    [javac]                       ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:267:
error: cannot find symbol
    [javac]   public Utf8 getReprUrl() {
    [javac]          ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:270:
error: cannot find symbol
    [javac]   public void setReprUrl(Utf8 value) {
    [javac]                          ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:273:
error: cannot find symbol
    [javac]   public Map<Utf8, Utf8> getHeaders() {
    [javac]              ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:273:
error: cannot find symbol
    [javac]   public Map<Utf8, Utf8> getHeaders() {
    [javac]                    ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:276:
error: cannot find symbol
    [javac]   public Utf8 getFromHeaders(Utf8 key) {
    [javac]                              ^
    [javac]   symbol:   class Utf8
    [javac]   location: class WebPage
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\indexer\mongodb\MongodbIndexer.java:18:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.JobConf;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\indexer\mongodb\MongodbWriter.java:7:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.JobConf;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:23:
warning: [deprecation] FileInputFormat in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.FileInputFormat;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:24:
warning: [deprecation] FileSplit in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.FileSplit;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:25:
warning: [deprecation] InputSplit in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.InputSplit;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:26:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.JobConf;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:34:
warning: [deprecation] FileInputFormat in org.apache.hadoop.mapred has been
deprecated
    [javac]   extends FileInputFormat<Text, BytesWritable> {
    [javac]           ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcRecordReader.java:31:
warning: [deprecation] FileSplit in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.FileSplit;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\NutchJobConf.java:21:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac] import org.apache.hadoop.mapred.JobConf;
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\NutchJobConf.java:24:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac] public class NutchJobConf extends JobConf {
    [javac]                                   ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\ConfResource.java:64:
warning: [unchecked] unchecked cast
    [javac]     Map<String,String> props =
(Map<String,String>)args.get(Params.PROPS);
    [javac]                                                            ^
    [javac]   required: Map<String,String>
    [javac]   found:    Object
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:166:
warning: [unchecked] unchecked cast
    [javac]         flds = (TreeSet<String>)fields.clone();
    [javac]                                             ^
    [javac]   required: TreeSet<String>
    [javac]   found:    Object
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:223:
warning: [rawtypes] found raw type: Map
    [javac]     private Map<String,String> convertMap(Map map) {
    [javac]                                           ^
    [javac]   missing type arguments for generic class Map<K,V>
    [javac]   where K,V are type-variables:
    [javac]     K extends Object declared in interface Map
    [javac]     V extends Object declared in interface Map
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\DbReader.java:226:
warning: [rawtypes] found raw type: Entry
    [javac]         Entry e = (Entry)o;
    [javac]         ^
    [javac]   missing type arguments for generic class Entry<K,V>
    [javac]   where K,V are type-variables:
    [javac]     K extends Object declared in interface Entry
    [javac]     V extends Object declared in interface Entry
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\WebPage.java:338:
warning: [unchecked] unchecked cast
    [javac]     return (Map<Utf8, ByteBuffer>) get(21);
    [javac]                                       ^
    [javac]   required: Map<Utf8,ByteBuffer>
    [javac]   found:    Object
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\JobResource.java:81:
warning: [unchecked] unchecked cast
    [javac]     Map<String,Object> cmdArgs =
(Map<String,Object>)args.get(Params.ARGS);
    [javac]                                                              ^
    [javac]   required: Map<String,Object>
    [javac]   found:    Object
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\api\impl\RAMJobManager.java:211:
warning: [unchecked] unchecked cast
    [javac]         clz = (Class<? extends
NutchTool>)Class.forName((String)args.get(Nutch.ARG_CLASS));
    [javac]                                                        ^
    [javac]   required: Class<? extends NutchTool>
    [javac]   found:    Class<CAP#1>
    [javac]   where CAP#1 is a fresh type-variable:
    [javac]     CAP#1 extends Object from capture of ?
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\GenericWritableConfigurable.java:44:
warning: [rawtypes] found raw type: Class
    [javac]     Class clazz = getTypes()[type];
    [javac]     ^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\crawl\NutchWritable.java:27:
warning: [rawtypes] found raw type: Class
    [javac]     CLASSES = new Class[] {
    [javac]                   ^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\crawl\NutchWritable.java:27:
warning: [unchecked] unchecked conversion
    [javac]     CLASSES = new Class[] {
    [javac]               ^
    [javac]   required: Class<? extends Writable>[]
    [javac]   found:    Class[]
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\metadata\Metadata.java:131:
warning: [rawtypes] found raw type: Enumeration
    [javac]     Enumeration names = properties.propertyNames();
    [javac]     ^
    [javac]   missing type arguments for generic class Enumeration<E>
    [javac]   where E is a type-variable:
    [javac]     E extends Object declared in interface Enumeration
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\net\URLNormalizers.java:103:
warning: [unchecked] unchecked conversion
    [javac]   private final List<Extension> EMPTY_EXTENSION_LIST =
Collections.EMPTY_LIST;
    [javac]                                                                  
^
    [javac]   required: List<Extension>
    [javac]   found:    List
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\net\URLNormalizers.java:199:
warning: [unchecked] unchecked cast
    [javac]       (List<Extension>)
objectCache.getObject(URLNormalizer.X_POINT_ID + "_x_"
    [javac]                                              ^
    [javac]   required: List<Extension>
    [javac]   found:    Object
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\Extension.java:156:
warning: [rawtypes] found raw type: Class
    [javac]         Class extensionClazz = loader.loadClass(getClazz());
    [javac]         ^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginDescriptor.java:49:
warning: [rawtypes] found raw type: HashMap
    [javac]   private HashMap fMessages = new HashMap();
    [javac]           ^
    [javac]   missing type arguments for generic class HashMap<K,V>
    [javac]   where K,V are type-variables:
    [javac]     K extends Object declared in class HashMap
    [javac]     V extends Object declared in class HashMap
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginDescriptor.java:49:
warning: [rawtypes] found raw type: HashMap
    [javac]   private HashMap fMessages = new HashMap();
    [javac]                                   ^
    [javac]   missing type arguments for generic class HashMap<K,V>
    [javac]   where K,V are type-variables:
    [javac]     K extends Object declared in class HashMap
    [javac]     V extends Object declared in class HashMap
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginDescriptor.java:222:
warning: [deprecation] toURL() in File has been deprecated
    [javac]     URL url = new File(getPluginPath() + File.separator +
pLibPath).toURL();
    [javac]                                                                   
^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginDescriptor.java:251:
warning: [deprecation] toURL() in File has been deprecated
    [javac]     URL url = new File(getPluginPath() + File.separator +
pLibPath).toURL();
    [javac]                                                                   
^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginDescriptor.java:282:
warning: [deprecation] toURL() in File has been deprecated
    [javac]           arrayList.add(file2.getParentFile().toURL());
    [javac]                                              ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginRepository.java:270:
warning: [rawtypes] found raw type: Class
    [javac]         Class pluginClass =
loader.loadClass(pDescriptor.getPluginClass());
    [javac]         ^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginRepository.java:271:
warning: [rawtypes] found raw type: Constructor
    [javac]         Constructor constructor = pluginClass.getConstructor(new
Class[] {
    [javac]         ^
    [javac]   missing type arguments for generic class Constructor<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Constructor
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginRepository.java:271:
warning: [rawtypes] found raw type: Class
    [javac]         Constructor constructor = pluginClass.getConstructor(new
Class[] {
    [javac]                                                                 
^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginRepository.java:271:
warning: [unchecked] unchecked call to getConstructor(Class<?>...) as a
member of the raw type Class
    [javac]         Constructor constructor = pluginClass.getConstructor(new
Class[] {
    [javac]                                                             ^
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginRepository.java:403:
warning: [rawtypes] found raw type: Class
    [javac]     Class clazz = null;
    [javac]     ^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginRepository.java:413:
warning: [rawtypes] found raw type: Class
    [javac]       m = clazz.getMethod("main", new Class[] { args.getClass()
});
    [javac]                                       ^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginRepository.java:413:
warning: [unchecked] unchecked call to getMethod(String,Class<?>...) as a
member of the raw type Class
    [javac]       m = clazz.getMethod("main", new Class[] { args.getClass()
});
    [javac]                          ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\crawl\WebTableReader.java:539:
warning: [deprecation] SequenceFileOutputFormat in org.apache.hadoop.mapred
has been deprecated
    [javac]     SequenceFile.Reader[] readers =
org.apache.hadoop.mapred.SequenceFileOutputFormat
    [javac]                                                             ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\fetcher\FetcherReducer.java:29:
warning: [deprecation] UTF8 in org.apache.hadoop.io has been deprecated
    [javac] import java.util.Iterator;
    [javac]                      ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\protocol\Content.java:116:
warning: [deprecation] UTF8 in org.apache.hadoop.io has been deprecated
    [javac]       url = UTF8.readString(in); // read url
    [javac]             ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\protocol\Content.java:117:
warning: [deprecation] UTF8 in org.apache.hadoop.io has been deprecated
    [javac]       base = UTF8.readString(in); // read base
    [javac]              ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\protocol\Content.java:122:
warning: [deprecation] UTF8 in org.apache.hadoop.io has been deprecated
    [javac]       contentType = UTF8.readString(in); // read contentType
    [javac]                     ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\protocol\Content.java:127:
warning: [deprecation] UTF8 in org.apache.hadoop.io has been deprecated
    [javac]         key = UTF8.readString(in);
    [javac]               ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\protocol\Content.java:130:
warning: [deprecation] UTF8 in org.apache.hadoop.io has been deprecated
    [javac]           metadata.add(key, UTF8.readString(in));
    [javac]                             ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\MimeUtil.java:172:
warning: [deprecation] getMimeType(String) in MimeTypes has been deprecated
    [javac]       type = this.mimeTypes.getMimeType(url) != null ?
this.mimeTypes
    [javac]                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\MimeUtil.java:173:
warning: [deprecation] getMimeType(String) in MimeTypes has been deprecated
    [javac]           .getMimeType(url) : type;
    [javac]           ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\storage\Host.java:98: warning:
[unchecked] unchecked cast
    [javac]     return (Map<Utf8, ByteBuffer>) get(0);
    [javac]                                       ^
    [javac]   required: Map<Utf8,ByteBuffer>
    [javac]   found:    Object
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\indexer\mongodb\MongodbIndexer.java:47:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac] 		    final JobConf job = new NutchJob(getConf());
    [javac] 		          ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\indexer\mongodb\MongodbWriter.java:23:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac] 	public void open(JobConf job, String name) throws IOException {
    [javac] 	                 ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\metadata\SpellCheckedMetadata.java:57:
warning: [rawtypes] found raw type: Class
    [javac]     for (Class spellCheckedNames : spellthese) {
    [javac]          ^
    [javac]   missing type arguments for generic class Class<T>
    [javac]   where T is a type-variable:
    [javac]     T extends Object declared in class Class
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\plugin\PluginManifestParser.java:150:
warning: [deprecation] toURL() in File has been deprecated
    [javac]     Document document = parseXML(new
File(pManifestPath).toURL());
    [javac]                                                         ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:164:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]     Option helpOpts =
OptionBuilder.withArgName("help").withDescription(
    [javac]                                                        ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:165:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]       "show this help message").create("help");
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:166:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]     Option urlOpts =
OptionBuilder.withArgName("urls").hasArg().withDescription(
    [javac]                                                       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:166:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]     Option urlOpts =
OptionBuilder.withArgName("urls").hasArg().withDescription(
    [javac]                                                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:167:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]       "the urls file to check").create("urls");
    [javac]                                ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:168:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]     Option numThreadOpts =
OptionBuilder.withArgName("numThreads").hasArgs().withDescription(
    [javac]                                                                  
^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:168:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]     Option numThreadOpts =
OptionBuilder.withArgName("numThreads").hasArgs().withDescription(
    [javac]                                                                            
^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\ResolveUrls.java:169:
warning: [static] static method should be qualified by type name,
OptionBuilder, instead of by an expression
    [javac]       "the number of threads to use").create("numThreads");
    [javac]                                      ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:43:
warning: [deprecation] InputSplit in org.apache.hadoop.mapred has been
deprecated
    [javac]   public RecordReader<Text, BytesWritable>
getRecordReader(InputSplit split,
    [javac]                                                            ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:44:
warning: [deprecation] JobConf in org.apache.hadoop.mapred has been
deprecated
    [javac]       JobConf job, Reporter reporter)
    [javac]       ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcInputFormat.java:47:
warning: [deprecation] FileSplit in org.apache.hadoop.mapred has been
deprecated
    [javac]     return new ArcRecordReader(job, (FileSplit)split);
    [javac]                                      ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\tools\arc\ArcRecordReader.java:99:
warning: [deprecation] FileSplit in org.apache.hadoop.mapred has been
deprecated
    [javac]   public ArcRecordReader(Configuration conf, FileSplit split)
    [javac]                                              ^
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\PrefixStringMatcher.java:48:
warning: [rawtypes] found raw type: Collection
    [javac]   public PrefixStringMatcher(Collection prefixes) {
    [javac]                              ^
    [javac]   missing type arguments for generic class Collection<E>
    [javac]   where E is a type-variable:
    [javac]     E extends Object declared in interface Collection
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\PrefixStringMatcher.java:50:
warning: [rawtypes] found raw type: Iterator
    [javac]     Iterator iter= prefixes.iterator();
    [javac]     ^
    [javac]   missing type arguments for generic class Iterator<E>
    [javac]   where E is a type-variable:
    [javac]     E extends Object declared in interface Iterator
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\SuffixStringMatcher.java:44:
warning: [rawtypes] found raw type: Collection
    [javac]   public SuffixStringMatcher(Collection suffixes) {
    [javac]                              ^
    [javac]   missing type arguments for generic class Collection<E>
    [javac]   where E is a type-variable:
    [javac]     E extends Object declared in interface Collection
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\SuffixStringMatcher.java:46:
warning: [rawtypes] found raw type: Iterator
    [javac]     Iterator iter= suffixes.iterator();
    [javac]     ^
    [javac]   missing type arguments for generic class Iterator<E>
    [javac]   where E is a type-variable:
    [javac]     E extends Object declared in interface Iterator
    [javac]
C:\apache-nutch-2.1\src\java\org\apache\nutch\util\ToolUtil.java:48:
warning: [unchecked] unchecked cast
    [javac]     Map<String,Object> jobs =
(Map<String,Object>)results.get(Nutch.STAT_JOBS);
    [javac]                                                              ^
    [javac]   required: Map<String,Object>
    [javac]   found:    Object
    [javac] 100 errors
    [javac] 69 warnings


lewis john mcgibbney wrote
> sorry speech marks
> 
> just run
> 
> any runtime
> 
> It most certainly works, if it does not then there is something wrong
> with your local copy.
> 
> On Wed, Aug 29, 2012 at 7:18 AM, Tolga &lt;

> tolga@

> &gt; wrote:
>> What brackets? I don't see brackets.
>>
>> On 08/28/2012 03:39 PM, Lewis John Mcgibbney wrote:
>>>
>>> I assume you are not using the brackets?
>>>
>>> This command should most certainly work.
>>>
>>> Lewis
>>>
>>> On Tue, Aug 28, 2012 at 7:48 AM, Tolga &lt;

> tolga@

> &gt; wrote:
>>>>
>>>> "ant runtime" gives me:
>>>>
>>>> Buildfile: build.xml
>>>>    [taskdef] Could not load definitions from resource
>>>> org/sonar/ant/antlib.xml. It could not be found.
>>>>
>>>> ivy-probe-antlib:
>>>>
>>>> BUILD FAILED
>>>> /usr/local/solr/NUTCH/build.xml:472: Class
>>>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>>>> "typefound" element.
>>>>
>>>> Total time: 0 seconds
>>>>
>>>> Regards,
>>>>
>>>> On 08/27/2012 03:00 PM, Lewis John Mcgibbney wrote:
>>>>>
>>>>> try "ant runtime"
>>>>>
>>>>> This will generate the runtime deployment(s) you require to get going,
>>>>> however it _does_not_ give you a ready to rock deployment.
>>>>>
>>>>> You should check out the following tutorials below
>>>>>
>>>>> http://wiki.apache.org/nutch/Nutch2Tutorial
>>>>> http://nlp.solutions.asia/?p=180
>>>>>
>>>>> Lewis
>>>>>
>>>>> On Mon, Aug 27, 2012 at 12:34 PM, Tolga &lt;

> tolga@

> &gt; wrote:
>>>>>>
>>>>>> Hi, and thanks for your fast reply.
>>>>>>
>>>>>> I found a tutorial on the interwebz, and it said to use ant in
>>>>>> $NUTCH.
>>>>>> However, when I used it, I got:
>>>>>>
>>>>>>
>>>>>> [mtozses@atlas NUTCH]$ time ant
>>>>>> Buildfile: build.xml
>>>>>>     [taskdef] Could not load definitions from resource
>>>>>> org/sonar/ant/antlib.xml. It could not be found.
>>>>>>
>>>>>> ivy-probe-antlib:
>>>>>>
>>>>>> BUILD FAILED
>>>>>> /usr/local/solr/NUTCH/build.xml:472: Class
>>>>>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the
>>>>>> nested
>>>>>> "typefound" element. What to do now?
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>>
>>>>>> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>>>>>>
>>>>>>> yes you need to compile nutch 2.0
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> View this message in context:
>>>>>>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>>>>>>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>>>>>
>>>>>>
>>>>>
>>>
>>>
>>
> 
> 
> 
> -- 
> Lewis





--
View this message in context: http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4036422.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: bin/nutch

Posted by Lewis John Mcgibbney <le...@gmail.com>.
sorry speech marks

just run

any runtime

It most certainly works, if it does not then there is something wrong
with your local copy.

On Wed, Aug 29, 2012 at 7:18 AM, Tolga <to...@ozses.net> wrote:
> What brackets? I don't see brackets.
>
> On 08/28/2012 03:39 PM, Lewis John Mcgibbney wrote:
>>
>> I assume you are not using the brackets?
>>
>> This command should most certainly work.
>>
>> Lewis
>>
>> On Tue, Aug 28, 2012 at 7:48 AM, Tolga <to...@ozses.net> wrote:
>>>
>>> "ant runtime" gives me:
>>>
>>> Buildfile: build.xml
>>>    [taskdef] Could not load definitions from resource
>>> org/sonar/ant/antlib.xml. It could not be found.
>>>
>>> ivy-probe-antlib:
>>>
>>> BUILD FAILED
>>> /usr/local/solr/NUTCH/build.xml:472: Class
>>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>>> "typefound" element.
>>>
>>> Total time: 0 seconds
>>>
>>> Regards,
>>>
>>> On 08/27/2012 03:00 PM, Lewis John Mcgibbney wrote:
>>>>
>>>> try "ant runtime"
>>>>
>>>> This will generate the runtime deployment(s) you require to get going,
>>>> however it _does_not_ give you a ready to rock deployment.
>>>>
>>>> You should check out the following tutorials below
>>>>
>>>> http://wiki.apache.org/nutch/Nutch2Tutorial
>>>> http://nlp.solutions.asia/?p=180
>>>>
>>>> Lewis
>>>>
>>>> On Mon, Aug 27, 2012 at 12:34 PM, Tolga <to...@ozses.net> wrote:
>>>>>
>>>>> Hi, and thanks for your fast reply.
>>>>>
>>>>> I found a tutorial on the interwebz, and it said to use ant in $NUTCH.
>>>>> However, when I used it, I got:
>>>>>
>>>>>
>>>>> [mtozses@atlas NUTCH]$ time ant
>>>>> Buildfile: build.xml
>>>>>     [taskdef] Could not load definitions from resource
>>>>> org/sonar/ant/antlib.xml. It could not be found.
>>>>>
>>>>> ivy-probe-antlib:
>>>>>
>>>>> BUILD FAILED
>>>>> /usr/local/solr/NUTCH/build.xml:472: Class
>>>>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>>>>> "typefound" element. What to do now?
>>>>>
>>>>> Regards,
>>>>>
>>>>>
>>>>> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>>>>>
>>>>>> yes you need to compile nutch 2.0
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> View this message in context:
>>>>>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>>>>>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>>>>
>>>>>
>>>>
>>
>>
>



-- 
Lewis

Re: bin/nutch

Posted by Tolga <to...@ozses.net>.
What brackets? I don't see brackets.

On 08/28/2012 03:39 PM, Lewis John Mcgibbney wrote:
> I assume you are not using the brackets?
>
> This command should most certainly work.
>
> Lewis
>
> On Tue, Aug 28, 2012 at 7:48 AM, Tolga <to...@ozses.net> wrote:
>> "ant runtime" gives me:
>>
>> Buildfile: build.xml
>>    [taskdef] Could not load definitions from resource
>> org/sonar/ant/antlib.xml. It could not be found.
>>
>> ivy-probe-antlib:
>>
>> BUILD FAILED
>> /usr/local/solr/NUTCH/build.xml:472: Class
>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>> "typefound" element.
>>
>> Total time: 0 seconds
>>
>> Regards,
>>
>> On 08/27/2012 03:00 PM, Lewis John Mcgibbney wrote:
>>> try "ant runtime"
>>>
>>> This will generate the runtime deployment(s) you require to get going,
>>> however it _does_not_ give you a ready to rock deployment.
>>>
>>> You should check out the following tutorials below
>>>
>>> http://wiki.apache.org/nutch/Nutch2Tutorial
>>> http://nlp.solutions.asia/?p=180
>>>
>>> Lewis
>>>
>>> On Mon, Aug 27, 2012 at 12:34 PM, Tolga <to...@ozses.net> wrote:
>>>> Hi, and thanks for your fast reply.
>>>>
>>>> I found a tutorial on the interwebz, and it said to use ant in $NUTCH.
>>>> However, when I used it, I got:
>>>>
>>>>
>>>> [mtozses@atlas NUTCH]$ time ant
>>>> Buildfile: build.xml
>>>>     [taskdef] Could not load definitions from resource
>>>> org/sonar/ant/antlib.xml. It could not be found.
>>>>
>>>> ivy-probe-antlib:
>>>>
>>>> BUILD FAILED
>>>> /usr/local/solr/NUTCH/build.xml:472: Class
>>>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>>>> "typefound" element. What to do now?
>>>>
>>>> Regards,
>>>>
>>>>
>>>> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>>>> yes you need to compile nutch 2.0
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> View this message in context:
>>>>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>>>>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>>>
>>>
>
>


Re: bin/nutch

Posted by Lewis John Mcgibbney <le...@gmail.com>.
I assume you are not using the brackets?

This command should most certainly work.

Lewis

On Tue, Aug 28, 2012 at 7:48 AM, Tolga <to...@ozses.net> wrote:
> "ant runtime" gives me:
>
> Buildfile: build.xml
>   [taskdef] Could not load definitions from resource
> org/sonar/ant/antlib.xml. It could not be found.
>
> ivy-probe-antlib:
>
> BUILD FAILED
> /usr/local/solr/NUTCH/build.xml:472: Class
> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
> "typefound" element.
>
> Total time: 0 seconds
>
> Regards,
>
> On 08/27/2012 03:00 PM, Lewis John Mcgibbney wrote:
>>
>> try "ant runtime"
>>
>> This will generate the runtime deployment(s) you require to get going,
>> however it _does_not_ give you a ready to rock deployment.
>>
>> You should check out the following tutorials below
>>
>> http://wiki.apache.org/nutch/Nutch2Tutorial
>> http://nlp.solutions.asia/?p=180
>>
>> Lewis
>>
>> On Mon, Aug 27, 2012 at 12:34 PM, Tolga <to...@ozses.net> wrote:
>>>
>>> Hi, and thanks for your fast reply.
>>>
>>> I found a tutorial on the interwebz, and it said to use ant in $NUTCH.
>>> However, when I used it, I got:
>>>
>>>
>>> [mtozses@atlas NUTCH]$ time ant
>>> Buildfile: build.xml
>>>    [taskdef] Could not load definitions from resource
>>> org/sonar/ant/antlib.xml. It could not be found.
>>>
>>> ivy-probe-antlib:
>>>
>>> BUILD FAILED
>>> /usr/local/solr/NUTCH/build.xml:472: Class
>>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>>> "typefound" element. What to do now?
>>>
>>> Regards,
>>>
>>>
>>> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>>>
>>>> yes you need to compile nutch 2.0
>>>>
>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>>>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>



-- 
Lewis

Re: bin/nutch

Posted by Tolga <to...@ozses.net>.
"ant runtime" gives me:

Buildfile: build.xml
   [taskdef] Could not load definitions from resource 
org/sonar/ant/antlib.xml. It could not be found.

ivy-probe-antlib:

BUILD FAILED
/usr/local/solr/NUTCH/build.xml:472: Class 
org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested 
"typefound" element.

Total time: 0 seconds

Regards,

On 08/27/2012 03:00 PM, Lewis John Mcgibbney wrote:
> try "ant runtime"
>
> This will generate the runtime deployment(s) you require to get going,
> however it _does_not_ give you a ready to rock deployment.
>
> You should check out the following tutorials below
>
> http://wiki.apache.org/nutch/Nutch2Tutorial
> http://nlp.solutions.asia/?p=180
>
> Lewis
>
> On Mon, Aug 27, 2012 at 12:34 PM, Tolga <to...@ozses.net> wrote:
>> Hi, and thanks for your fast reply.
>>
>> I found a tutorial on the interwebz, and it said to use ant in $NUTCH.
>> However, when I used it, I got:
>>
>>
>> [mtozses@atlas NUTCH]$ time ant
>> Buildfile: build.xml
>>    [taskdef] Could not load definitions from resource
>> org/sonar/ant/antlib.xml. It could not be found.
>>
>> ivy-probe-antlib:
>>
>> BUILD FAILED
>> /usr/local/solr/NUTCH/build.xml:472: Class
>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>> "typefound" element. What to do now?
>>
>> Regards,
>>
>>
>> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>> yes you need to compile nutch 2.0
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>
>
>


Re: bin/nutch

Posted by Lewis John Mcgibbney <le...@gmail.com>.
If you wish to use HBase to store your crawl data then yes.
Alternatively (currently) you can use Cassandra, Accumulo, MySQL or
HSQLDB and soon Amazon's DynamoDB

Check out the HBase tutorial, it includes absolutely everything you
require to get going with this.

Lewis

On Mon, Aug 27, 2012 at 1:46 PM, Tolga <to...@ozses.net> wrote:
> Do I need HBase as well?
>
> On 08/27/2012 03:00 PM, Lewis John Mcgibbney wrote:
>>
>> try "ant runtime"
>>
>> This will generate the runtime deployment(s) you require to get going,
>> however it _does_not_ give you a ready to rock deployment.
>>
>> You should check out the following tutorials below
>>
>> http://wiki.apache.org/nutch/Nutch2Tutorial
>> http://nlp.solutions.asia/?p=180
>>
>> Lewis
>>
>> On Mon, Aug 27, 2012 at 12:34 PM, Tolga <to...@ozses.net> wrote:
>>>
>>> Hi, and thanks for your fast reply.
>>>
>>> I found a tutorial on the interwebz, and it said to use ant in $NUTCH.
>>> However, when I used it, I got:
>>>
>>>
>>> [mtozses@atlas NUTCH]$ time ant
>>> Buildfile: build.xml
>>>    [taskdef] Could not load definitions from resource
>>> org/sonar/ant/antlib.xml. It could not be found.
>>>
>>> ivy-probe-antlib:
>>>
>>> BUILD FAILED
>>> /usr/local/solr/NUTCH/build.xml:472: Class
>>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>>> "typefound" element. What to do now?
>>>
>>> Regards,
>>>
>>>
>>> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>>>
>>>> yes you need to compile nutch 2.0
>>>>
>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>>>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>



-- 
Lewis

Re: bin/nutch

Posted by Tolga <to...@ozses.net>.
Do I need HBase as well?

On 08/27/2012 03:00 PM, Lewis John Mcgibbney wrote:
> try "ant runtime"
>
> This will generate the runtime deployment(s) you require to get going,
> however it _does_not_ give you a ready to rock deployment.
>
> You should check out the following tutorials below
>
> http://wiki.apache.org/nutch/Nutch2Tutorial
> http://nlp.solutions.asia/?p=180
>
> Lewis
>
> On Mon, Aug 27, 2012 at 12:34 PM, Tolga <to...@ozses.net> wrote:
>> Hi, and thanks for your fast reply.
>>
>> I found a tutorial on the interwebz, and it said to use ant in $NUTCH.
>> However, when I used it, I got:
>>
>>
>> [mtozses@atlas NUTCH]$ time ant
>> Buildfile: build.xml
>>    [taskdef] Could not load definitions from resource
>> org/sonar/ant/antlib.xml. It could not be found.
>>
>> ivy-probe-antlib:
>>
>> BUILD FAILED
>> /usr/local/solr/NUTCH/build.xml:472: Class
>> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
>> "typefound" element. What to do now?
>>
>> Regards,
>>
>>
>> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>> yes you need to compile nutch 2.0
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>>> Sent from the Nutch - User mailing list archive at Nabble.com.
>>
>
>


Re: bin/nutch

Posted by Lewis John Mcgibbney <le...@gmail.com>.
try "ant runtime"

This will generate the runtime deployment(s) you require to get going,
however it _does_not_ give you a ready to rock deployment.

You should check out the following tutorials below

http://wiki.apache.org/nutch/Nutch2Tutorial
http://nlp.solutions.asia/?p=180

Lewis

On Mon, Aug 27, 2012 at 12:34 PM, Tolga <to...@ozses.net> wrote:
> Hi, and thanks for your fast reply.
>
> I found a tutorial on the interwebz, and it said to use ant in $NUTCH.
> However, when I used it, I got:
>
>
> [mtozses@atlas NUTCH]$ time ant
> Buildfile: build.xml
>   [taskdef] Could not load definitions from resource
> org/sonar/ant/antlib.xml. It could not be found.
>
> ivy-probe-antlib:
>
> BUILD FAILED
> /usr/local/solr/NUTCH/build.xml:472: Class
> org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested
> "typefound" element. What to do now?
>
> Regards,
>
>
> On 08/27/2012 11:45 AM, hugo.ma wrote:
>>
>> yes you need to compile nutch 2.0
>>
>>
>>
>> --
>> View this message in context:
>> http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
>> Sent from the Nutch - User mailing list archive at Nabble.com.
>
>



-- 
Lewis

Re: bin/nutch

Posted by Tolga <to...@ozses.net>.
Hi, and thanks for your fast reply.

I found a tutorial on the interwebz, and it said to use ant in $NUTCH. 
However, when I used it, I got:


[mtozses@atlas NUTCH]$ time ant
Buildfile: build.xml
   [taskdef] Could not load definitions from resource 
org/sonar/ant/antlib.xml. It could not be found.

ivy-probe-antlib:

BUILD FAILED
/usr/local/solr/NUTCH/build.xml:472: Class 
org.apache.tools.ant.taskdefs.ConditionTask doesn't support the nested 
"typefound" element. What to do now?

Regards,

On 08/27/2012 11:45 AM, hugo.ma wrote:
> yes you need to compile nutch 2.0
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
> Sent from the Nutch - User mailing list archive at Nabble.com.


Re: bin/nutch

Posted by "hugo.ma" <hu...@gmail.com>.
yes you need to compile nutch 2.0



--
View this message in context: http://lucene.472066.n3.nabble.com/bin-nutch-tp4003408p4003427.html
Sent from the Nutch - User mailing list archive at Nabble.com.