You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Kevin Risden (JIRA)" <ji...@apache.org> on 2019/02/02 17:42:00 UTC
[jira] [Updated] (SOLR-7301) HdfsDirectoryFactory does not support
maprfs
[ https://issues.apache.org/jira/browse/SOLR-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kevin Risden updated SOLR-7301:
-------------------------------
Component/s: Hadoop Integration
> HdfsDirectoryFactory does not support maprfs
> --------------------------------------------
>
> Key: SOLR-7301
> URL: https://issues.apache.org/jira/browse/SOLR-7301
> Project: Solr
> Issue Type: Bug
> Components: Hadoop Integration
> Reporter: Shenghua Wan
> Priority: Minor
> Attachments: fix_support_maprfs.patch
>
>
> when map-reduce index generator was run, an exception was thrown as
> 2015-03-24 11:06:04,569 WARN org.apache.hadoop.mapred.Child: Error running child
> java.lang.IllegalStateException: Failed to initialize record writer for MapReduceSolrIndex, attempt_201503171620_12558_r_000000_0
> at org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:127)
> at org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(SolrOutputFormat.java:164)
> at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:605)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:456)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
> Caused by: org.apache.solr.common.SolrException: Unable to create core [core1]
> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:507)
> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
> at org.apache.solr.hadoop.SolrRecordWriter.createEmbeddedSolrServer(SolrRecordWriter.java:172)
> at org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:120)
> ... 8 more
> Caused by: org.apache.solr.common.SolrException: You must set the HdfsDirectoryFactory param solr.hdfs.home for relative dataDir paths to work
> at org.apache.solr.core.HdfsDirectoryFactory.getDataHome(HdfsDirectoryFactory.java:271)
> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:699)
> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
> ... 11 more
> after investigation, I found the class HdfsDirectoryFactory hardcoded "hdfs:/".
> a patch is provided in the attachment.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org