You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@metron.apache.org by "Ryan Merriman (JIRA)" <ji...@apache.org> on 2016/10/12 17:00:26 UTC

[jira] [Created] (METRON-498) Yaf doesn't pick up updated patterns from the hdfs

Ryan Merriman created METRON-498:
------------------------------------

             Summary: Yaf doesn't pick up updated patterns from the hdfs
                 Key: METRON-498
                 URL: https://issues.apache.org/jira/browse/METRON-498
             Project: Metron
          Issue Type: Bug
            Reporter: Ryan Merriman
            Assignee: Ryan Merriman


Grok patterns are kept in HDFS and referenced by path in a Zookeeper config property.  There is no way to update a pattern and have that change seen in the ParserBolt without restarting the topology.

As discussed on the dev list, a better approach is to instead store the grok patterns directly in zookeeper.  The requirements mentioned in that discussion:
- pattern files removed from HDFS and classpath
- update to grok pattern in zookeeper is immediately applied in bolt
- ability to easily edit the pattern



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)