Solr 6.1 collection backup into HDFS

[akalfus <am...@intel.com>]

Hello,I'm trying to run a collection backup with the following command -
/solr/admin/collections?action=BACKUP&collection=collection_name&repository=hdfs&location=/tmp/backup/&name=nameafter
trying to run in in local mode and failing due to not having an NFS.(BTW - I
manually created the folder in the other nodes and it seemed to work - every
shard was created in its own node).So I added the repository property set to
'hdfs', and it seems like it is ignored. What am I missing?



--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-6-1-collection-backup-into-HDFS-tp4312876.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 6.1 collection backup into HDFS

[Shawn Heisey <ap...@elyograg.org>]

On 1/7/2017 3:46 AM, akalfus wrote:
> Hello,I'm trying to run a collection backup with the following command -
> /solr/admin/collections?action=BACKUP&collection=collection_name&repository=hdfs&location=/tmp/backup/&name=nameafter
> trying to run in in local mode and failing due to not having an NFS.(BTW - I
> manually created the folder in the other nodes and it seemed to work - every
> shard was created in its own node).So I added the repository property set to
> 'hdfs', and it seems like it is ignored. What am I missing?

I did not reply at the time this message was sent because I had
absolutely no idea.  Now somebody has revived the thread, and I've
looked a little deeper.

It is not at all clear from the documentation exactly what the
'repository' parameter should be set to.  By poking at the code, I was
able to figure out what you need to do.

The repository name that you specify in the URL must be specified in
solr.xml, with a config like the following.  The config I included below
relies on system properties to work properly, but you could specify the
values directly in solr.xml:

  <backup>
    <repository name="hdfs"
class="org.apache.solr.core.backup.repository.HdfsBackupRepository">
      <str name="location">${solr.hdfs.default.backup.path}</str>
      <str name="solr.hdfs.home">${solr.hdfs.home:}</str>
      <str name="solr.hdfs.confdir">${solr.hdfs.confdir:}</str>
      <str
name="solr.hdfs.permissions.umask-mode">${solr.hdfs.permissions.umask-mode:000}</str>
    </repository>
  </backup>

I got that config from the Solr test class named TestHdfsBackupRestoreCore.

Once you have a complete repository config in solr.xml and restart Solr,
it should work.

Thanks,
Shawn

Re: Solr 6.1 collection backup into HDFS

["ankur.gpt28" <an...@gmail.com>]

Hi, were you able to figure out?
I am struggling to use hdfs for backup for solr 6.1 running in local mode.



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html