You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "laigood (JIRA)" <ji...@apache.org> on 2015/06/10 04:52:00 UTC

[jira] [Updated] (SOLR-7657) Mapreduce indexing not work on hadoop2.5.1

     [ https://issues.apache.org/jira/browse/SOLR-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

laigood updated SOLR-7657:
--------------------------
    Description: 
In early solr5,mapreduce indexing work fine,but when i upgrade to solr5+,run the same mr,it throw :
FATAL org.apache.hadoop.mapred.YarnChild  - Error running child : java.lang.VerifyError: Bad return type in method org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(Lorg/apache/solr/common/params/SolrParams;Lorg/apache/http/conn/ClientConnectionManager;)Lorg/apache/http/impl/client/CloseableHttpClient; at offset 62
at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:168)
	at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:49)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:236)
	at org.apache.solr.hadoop.SolrRecordWriter.createEmbeddedSolrServer(SolrRecordWriter.java:163)
	at org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:119)
	at org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(SolrOutputFormat.java:163)
	at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.<init>(ReduceTask.java:540)
	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:614)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

I think is the conflict of jar,I found httpclient4.2.5 in hadoop common lib,and solr5+ use httpclient4.3.1,how can i fix it?

  was:
In early solr5,mapreduce indexing work fine,but when i upgrade to solr5+,run the same mr,it throw :
FATAL org.apache.hadoop.mapred.YarnChild  - Error running child : java.lang.VerifyError: Bad return type in method org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(Lorg/apache/solr/common/params/SolrParams;Lorg/apache/http/conn/ClientConnectionManager;)Lorg/apache/http/impl/client/CloseableHttpClient; at offset 62
at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:168)
	at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:49)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:236)
	at org.apache.solr.hadoop.SolrRecordWriter.createEmbeddedSolrServer(SolrRecordWriter.java:163)
	at org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:119)
	at org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(SolrOutputFormat.java:163)
	at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.<init>(ReduceTask.java:540)
	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:614)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

I think is the conflict of jar,I found httpclient4.2.5 in hadoop common lib,and solr5+ use httpclient4.3.1,how i can fix it?


> Mapreduce indexing not work on hadoop2.5.1
> ------------------------------------------
>
>                 Key: SOLR-7657
>                 URL: https://issues.apache.org/jira/browse/SOLR-7657
>             Project: Solr
>          Issue Type: Bug
>          Components: Hadoop Integration
>    Affects Versions: 5.0, 5.1, 5.2
>         Environment: hadoop2.5.1
>            Reporter: laigood
>
> In early solr5,mapreduce indexing work fine,but when i upgrade to solr5+,run the same mr,it throw :
> FATAL org.apache.hadoop.mapred.YarnChild  - Error running child : java.lang.VerifyError: Bad return type in method org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(Lorg/apache/solr/common/params/SolrParams;Lorg/apache/http/conn/ClientConnectionManager;)Lorg/apache/http/impl/client/CloseableHttpClient; at offset 62
> at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:168)
> 	at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:49)
> 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:236)
> 	at org.apache.solr.hadoop.SolrRecordWriter.createEmbeddedSolrServer(SolrRecordWriter.java:163)
> 	at org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:119)
> 	at org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(SolrOutputFormat.java:163)
> 	at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.<init>(ReduceTask.java:540)
> 	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:614)
> 	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
> I think is the conflict of jar,I found httpclient4.2.5 in hadoop common lib,and solr5+ use httpclient4.3.1,how can i fix it?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org