Re: Generating Index offline and loading into solrcloud

[vchauras <vi...@gmail.com>]

Hey Sameer,

I tried using the tool on hadoop master node (AWS EMR) like:

hadoop jar cloudera-search-1.0.0-cdh5.2.0-jar-with-dependencies.jar \
org.apache.solr.hadoop.MapReduceIndexerTool \
-D 'mapred.child.java.opts=-Xmx500m' \
--log4j ~/log4j.properties \
--morphline-file /home/hadoop/morphlines1.conf \
--output-dir hdfs://172.31.77.5:8020/tmp/outdir \
--input-list hdfs://172.31.77.5:8020/index_files/index_1.txt \
--verbose \
--solr-home-dir /home/hadoop/friending \
--shards 1 \
--dry-run

I have few doubts:
1) does the tool require solr to be installed on the machine? I see error
coming:

Exception in thread "main" org.apache.solr.common.SolrException: Error
loading class 'solr.NoOpRegenerator'
	at
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:449)
	at
org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:471)
	at
org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:467)
	at org.apache.solr.search.CacheConfig.getConfig(CacheConfig.java:100)
	at
org.apache.solr.search.CacheConfig.getMultipleConfigs(CacheConfig.java:73)
	at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:198)
	at
org.kitesdk.morphline.solr.SolrLocator.getIndexSchema(SolrLocator.java:168)
	at
org.apache.solr.hadoop.morphline.MorphlineMapRunner.<init>(MorphlineMapRunner.java:134)
	at
org.apache.solr.hadoop.MapReduceIndexerTool.setupMorphline(MapReduceIndexerTool.java:1154)
	at
org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:794)


My content of friending/conf looks like:

hadoop@ip-172-31-77-5 22:42:18 ~ ls -ltr /home/hadoop/friending/conf/
total 80
-rw-r--r-- 1 hadoop hadoop  1119 Jan 29 20:34 synonyms.txt
-rw-r--r-- 1 hadoop hadoop   781 Jan 29 20:34 stopwords.txt
-rw-r--r-- 1 hadoop hadoop   873 Jan 29 20:34 protwords.txt
-rw-r--r-- 1 hadoop hadoop  1348 Jan 29 20:34 elevate.xml
-rw-r--r-- 1 hadoop hadoop  3974 Jan 29 20:34 currency.xml
-rw-r--r-- 1 hadoop hadoop  2572 Jan 29 20:39 schema.xml
drwxr-xr-x 2 hadoop hadoop  4096 Jan 29 20:42 lang
-rw-r--r-- 1 hadoop hadoop 49806 Jan 29 22:22 solrconfig.xml

I have been struggling to get this tool working. Any help would be
appreciated. 



--
Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html