[jira] [Created] (METRON-744) Allow Stellar functions to be loaded from HDFS

["Casey Stella (JIRA)" <ji...@apache.org>]

Casey Stella created METRON-744:
-----------------------------------

             Summary: Allow Stellar functions to be loaded from HDFS
                 Key: METRON-744
                 URL: https://issues.apache.org/jira/browse/METRON-744
             Project: Metron
          Issue Type: New Feature
            Reporter: Casey Stella


The benefit of Stellar is that adding new functionality is as simple as providing a Jar.  This enables people who want to integrate with Metron to easy add enrichments or other functionality.  The snag currently with this is that we provide a single jar, so all stellar functions that we have available must be dependencies of the main jar that drives the topology plus what local directories we can configure via the storm configs.  This makes the process of adding 3rd party jars not as easy as it could be.

Adjust the the following to additionally load classes from a location in HDFS /apps/metron/stellar using something like accumulo ( https://accumulo.apache.org/blog/2014/05/03/accumulo-classloader.html)
* Profiler topology
* Parser topology
* Enrichment topology
* Enrichment Flat file loader
* Enrichment MR loader



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)