You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Noble Paul (Jira)" <ji...@apache.org> on 2019/10/02 04:22:00 UTC
[jira] [Comment Edited] (SOLR-13710) DistribFileStore: a
distributed p2p file store
[ https://issues.apache.org/jira/browse/SOLR-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942475#comment-16942475 ]
Noble Paul edited comment on SOLR-13710 at 10/2/19 4:21 AM:
------------------------------------------------------------
{quote}I'm not sure if the SHA256 stuff need to be a fundamental part of this abstraction.
{quote}
Well, it's not. The internal default {{DistribFileStore}} uses {{<sha256>-<filename>}} scheme as the file name. This is to avoid any conflicts.
Alternate implementations should be possible. But I don't not wish it to "replace" this one. Is there a reason why the default impl should not be present at all?
The default should always be available at {{/api/cluster/filestore/package}} and {{/api/node/filestore/package}} and it expects the files to be present at {{<SOLR_HOME>/filestore/package}}. The classloader is designed to look for it there.
Your alternate impl should be able to register at {{/api/filestore/<another-namespace>}} and it should be just fine
was (Author: noble.paul):
{quote}I'm not sure if the SHA256 stuff need to be a fundamental part of this abstraction.
{quote}
Well, it's not. The internal default {{DistribFIleStore}} uses {{<sha256>-<filename>}} scheme as the file name. This is to avoid any conflicts.
Alternate implementations should be possible. But I don't not wish it to "replace" this one. Is there a reason why the default impl should not be present at all?
The default should always be available at {{/api/cluster/filestore/package}} and {{/api/node/filestore/package}} and it expects the files to be present at {{<SOLR_HOME>/filestore/package}}. The classloader is designed to look for it there.
Your alternate impl should be able to register at {{/api/filestore/<another-namespace>}} and it should be just fine
> DistribFileStore: a distributed p2p file store
> ----------------------------------------------
>
> Key: SOLR-13710
> URL: https://issues.apache.org/jira/browse/SOLR-13710
> Project: Solr
> Issue Type: Sub-task
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Noble Paul
> Assignee: Noble Paul
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> * All jars for packages downloaded are stored in a dir SOLR_HOME/filestore/package.
> * The file names will be the sha256_hash-<filename>.
> * Before downloading the a jar from a location, it's first checked in the local directory
> * POST a jar to {{http://localhost://8983/api/cluster/filestore/package?name=<file-name>}} to distibute it in the cluster
> * A new API end point {{http://localhost://8983/api/node/filestore/package}} will list the available files
> * The file will be downloadable at {{http://localhost://8983/api/node/filestore/package/<sha256>}}
> Design: https://docs.google.com/document/d/15b3m3i3NFDKbhkhX_BN0MgvPGZaBj34TKNF2-UNC3U8/edit?ts=5d86a8ad#heading=h.qxgax9a5br5o
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org