You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@metron.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/03/14 13:39:33 UTC
[jira] [Commented] (METRON-66) Fix Grok parser to load patterns via
HDFS
[ https://issues.apache.org/jira/browse/METRON-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15193195#comment-15193195 ]
ASF GitHub Bot commented on METRON-66:
--------------------------------------
GitHub user cestella opened a pull request:
https://github.com/apache/incubator-metron/pull/44
METRON-66 Fix Grok parser to load patterns via HDFS
This contains the grok parser fix as well as the various issues that were found collectively in integration testing:
* Grok parser is unable to load via Class.getResourceAsStream()
* Yaf and Snort parsers do not emit messages with the correct key structure downstream
* Integration test improvements
* Metron-Topologies now creates a tarball with shell scripts to assist in updating source configs in zookeeper.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cestella/incubator-metron MET-92
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/44.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #44
----
commit 48aa388f4de9c39f66be38e01e28c38bfe535064
Author: cstella <ce...@gmail.com>
Date: 2016-03-09T20:47:52Z
update
commit 7e76f5143b5ee57ad19503e2ba3d2a6bcd6cfbff
Author: cstella <ce...@gmail.com>
Date: 2016-03-09T20:47:57Z
Merge branch 'master' into MET-92
commit 5514078bc4cfcd91a7e85f93f3b777f6ff2ead6c
Author: cstella <ce...@gmail.com>
Date: 2016-03-09T21:07:16Z
Fixing small bug
commit 2f5861db0c89d8cc92ad70a9ad0875b076360e66
Author: cstella <ce...@gmail.com>
Date: 2016-03-09T21:19:02Z
Fixing small bug
commit 2d97be497d1ba4dc0434101f8bb43a69811333f9
Author: cstella <ce...@gmail.com>
Date: 2016-03-09T21:26:15Z
Fixing small bug
commit 7093437862dd0e8d25a388a53c06a3eadf7b960c
Author: cstella <ce...@gmail.com>
Date: 2016-03-09T21:45:34Z
Fixing small bug
commit 123ff72853edac6159e7a0c07d9bb411201bae6d
Author: cstella <ce...@gmail.com>
Date: 2016-03-09T21:56:38Z
Fixing small bug
commit 2aec091277d6afbf8a47d84d4205aa3e0dab9c19
Author: Cloud User <ce...@ip-10-0-0-227.us-west-2.compute.internal>
Date: 2016-03-10T14:50:28Z
Updating yaf patterns
commit bcd5c37816f62147493ade9e210513bbce4cd311
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T15:45:21Z
Trying again to fix the issues with loading resources in grok.
commit bc8b5e2ebc645f6ef0117e66a49437ec2b5b6f19
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T16:48:30Z
Updating yaf to be correct.
commit 2970169865683715a00a47c0e4379bcd455aab47
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T16:52:36Z
Fixing ansible.
commit a476763f1e6d51ebda7817a19e4e99e6a56e6fdd
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T16:58:55Z
fixing snort now.
commit 11bc6749598ca05f92a7a0ccb5d6d1b367564855
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T17:45:00Z
Updating parser to fail more aggressively.
commit bc087f44c50c14355381b7542de79b738adfa86e
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T17:46:59Z
updating parser back to failing with an exception
commit ae27f16e3c76f0eb23c35cf77ceee278c72f38a0
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T17:55:04Z
updating parser back to failing with an exception
commit 287b41fcbf14a39b0a050e276413bac4e810453a
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T18:00:51Z
updating parser back to failing with an exception
commit 409e5aed270d5dd2a71e1a0612060a06178d602c
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T18:19:10Z
updating parser back to failing with an exception
commit 76f19a6a582dd753ac1662c1e2d6d3080440be2e
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T18:21:52Z
updating parser back to failing with an exception
commit 35d3191de104a042e0605869c328e3090cc28e69
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T19:56:21Z
updating parser back to failing with an exception
commit 8ed620a99c2a5e576827726ccc29c831db91f194
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T20:09:05Z
updating parser back to failing with an exception
commit 96c170a178aeacb19a01d7c405a73bd586e59b05
Author: cstella <ce...@gmail.com>
Date: 2016-03-10T21:25:44Z
Changed bro to pull from most recent, rather than start of the stream.
commit d21b6ad72e7428b91f041be9817d873d5c81c312
Author: cstella <ce...@gmail.com>
Date: 2016-03-11T15:19:25Z
Updating ansible to call the right class.
commit 79201b39b3109bdfc072d2289941de5d21ea199c
Author: cstella <ce...@gmail.com>
Date: 2016-03-11T20:46:02Z
Moving configs around and setting up the assembly plugin to bundle resources.
commit 5c642499c96eec9ed1641e8e445c0a17fa531b37
Author: cstella <ce...@gmail.com>
Date: 2016-03-11T22:41:37Z
Updating integration tests and fixed a small bug in the grok parser.
commit d141aaec730447c4d0039ed42444b78b20714289
Author: cstella <ce...@gmail.com>
Date: 2016-03-11T23:34:41Z
Fixing integration test
commit 0514d0c81d268601622e2e807e9e69a90f90d1c1
Author: cstella <ce...@gmail.com>
Date: 2016-03-12T13:56:09Z
fixing vagrant
----
> Fix Grok parser to load patterns via HDFS
> -----------------------------------------
>
> Key: METRON-66
> URL: https://issues.apache.org/jira/browse/METRON-66
> Project: Metron
> Issue Type: Improvement
> Reporter: Casey Stella
> Assignee: Casey Stella
>
> The Grok parser, at the moment, tries to load patterns file from the classpath. This isn't working on an actual cluster. Worse, it's actually swallowing the exception so it looks like it's working, but it really isn't.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)