java.lang.NoClassDefFoundError: org/apache/lucene/index/IndexDeletionPolicy in contrib/index

[Samuel Guo <si...@gmail.com>]

Hi all:

when I try contrib/index this package, I find that it can find the
IndexDeletionPolicy in the Lucence jar package, but I am sure that I've
copy the lucene jar lib to the hadoop/lib directory.

What I've done is belowed:

$ bin/hadoop jar contrib/index/hadoop-0.17.0-dev-index.jar -inputPaths
txt -outputPath output1 -indexPath index -conf conf/index-config.xml
08/04/28 09:33:20 INFO main.UpdateIndex: inputPaths = txt
08/04/28 09:33:20 INFO main.UpdateIndex: outputPath = output1
08/04/28 09:33:20 INFO main.UpdateIndex: shards = null
08/04/28 09:33:20 INFO main.UpdateIndex: indexPath = index
08/04/28 09:33:20 INFO main.UpdateIndex: numShards = -1
08/04/28 09:33:20 INFO main.UpdateIndex: numMapTasks= -1
08/04/28 09:33:20 INFO main.UpdateIndex: confPath = conf/index-config.xml
08/04/28 09:33:21 INFO main.UpdateIndex: sea.index.updater =
org.apache.hadoop.contrib.index.mapred.IndexUpdater
08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.input.dir =
hdfs://localhost:54310/user/guosj/txt
08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.output.dir =
hdfs://localhost:54310/user/guosj/output1
08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.map.tasks = 2
08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.reduce.tasks = 1
08/04/28 09:33:21 INFO mapred.IndexUpdater: 1 shards = -1@index/00000@-1
08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.input.format.class =
org.apache.hadoop.contrib.index.example.LineDocInputFormat
08/04/28 09:33:21 WARN fs.FileSystem: "localhost:54310" is a deprecated
filesystem name. Use "hdfs://localhost:54310/" instead.
08/04/28 09:33:21 INFO mapred.FileInputFormat: Total input paths to
process : 4
08/04/28 09:33:21 INFO mapred.JobClient: Running job: job_200804280859_0004
08/04/28 09:33:22 INFO mapred.JobClient: map 0% reduce 0%
08/04/28 09:33:29 INFO mapred.JobClient: Task Id :
task_200804280859_0004_m_000001_0, Status : FAILED
java.lang.NoClassDefFoundError: org/apache/lucene/index/IndexDeletionPolicy
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:551)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:569)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:595)
at org.apache.hadoop.mapred.JobConf.getMapOutputValueClass(JobConf.java:577)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:324)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:177)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2113)


$ ls lib
commons-cli-2.0-SNAPSHOT.jar commons-logging-1.0.4.jar jetty-5.1.4.jar
junit-3.8.1.jar kfs-0.1.LICENSE.txt servlet-api.jar
commons-codec-1.3.jar commons-logging-api-1.0.4.jar
jetty-5.1.4.LICENSE.txt junit-3.8.1.LICENSE.txt log4j-1.2.13.jar
xmlenc-0.52.jar
commons-httpclient-3.0.1.jar jets3t-0.5.0.jar jetty-ext kfs-0.1.jar
lucene-core-2.3.1.jar

what make me failed? Please let me known:) Thanks in advanced!

Best Wishes

Samuel Guo