[jira] [Commented] (SOLR-13989) Move all hadoop related code to a contrib module

["Ishan Chattopadhyaya (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SOLR-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151217#comment-17151217 ] 

Ishan Chattopadhyaya commented on SOLR-13989:
---------------------------------------------

Thanks for the work, [~rcmuir] and [~krisden].
{quote}So I was looking at some of the new package/plugin management. I think Hadoop/HDFS could be isolated into its own package/plugin. I don't know what is all involved with it yet. I think moving to contrib could be a first step. It would be good to isolate it from dependencies in Solr altogether. It looks like the plugins allow for separate classloader meaning different versions of dependencies potentially. The one area that isn't in the plugin/package framework looks like custom security manager policy - I've worked with ES on the HDFS integration and custom security policy to open up permissions only when the HDFS integration was needed. Since Solr hasn't had a security manager really, I don't think the package/plugin integration thought about the security manager part yet.
{quote}
+1 to try to factor this out as a package. Right now, there doesn't seem to be a way to load a directory factory, backup repository and an update log implementation from a package. It is something we need to build into the package manager before we can fully isolate as a package. Security will be another aspect that we need to look into, and we've not put much thought into letting packages use custom security manager policies.

> Move all hadoop related code to a contrib module
> ------------------------------------------------
>
>                 Key: SOLR-13989
>                 URL: https://issues.apache.org/jira/browse/SOLR-13989
>             Project: Solr
>          Issue Type: Task
>          Components: Hadoop Integration
>            Reporter: Shalin Shekhar Mangar
>            Priority: Major
>             Fix For: master (9.0)
>
>
> Spin off from SOLR-13986:
> {quote}
> It seems really important to move or remove this hadoop shit out of the solr core: It is really unreasonable that solr core depends on hadoop. that's gonna simply block any progress improving its security, because solr code will get dragged down by hadoop's code.
> {quote}
> We should move all hadoop related dependencies to a separate contrib module



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org