You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@metron.apache.org by "Casey Stella (JIRA)" <ji...@apache.org> on 2018/03/23 18:57:00 UTC

[jira] [Created] (METRON-1501) Parser messages that fail to validate are dropped silently

Casey Stella created METRON-1501:
------------------------------------

             Summary: Parser messages that fail to validate are dropped silently
                 Key: METRON-1501
                 URL: https://issues.apache.org/jira/browse/METRON-1501
             Project: Metron
          Issue Type: Bug
            Reporter: Casey Stella


Currently we have two concepts of dealing with messages that are not going to be passed through:
 * Messages that fail global validation
 * Messages that fail the parser's validation function
 * Messages that are filtered out

 

Currently in the case of messages that fail global validation, we send them to the error queue.

In the case of messages that fail the parser's validation function, we drop them silently.

In the case of messages that are filtered out, we drop them silently as well.

 

Given the use-cases behind filtering (e.g. a kafka topic with multiple types of messages where we want to pass along only one type), it makes sense to drop them silently.  However, in the case of the messages that fail the parser's validation function, we should like to know that and treat those similarly to those messages that fail global validation.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)