You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by sirsean <gi...@git.apache.org> on 2016/01/15 17:26:09 UTC
[GitHub] incubator-metron pull request: Storm Flux
GitHub user sirsean opened a pull request:
https://github.com/apache/incubator-metron/pull/10
Storm Flux
This switches from the old `TopologyRunner` model written in Java code, to use Storm Flux to configure the topologies entirely in YAML.
This makes the topologies more flexible and the config files are more apparent. It also reduces the number of config files we need in order to run a topology.
I've verified that all these topologies run in local mode.
The command to run a topology has changed:
```
storm jar metron-streaming/Metron-Topologies/target/Metron-Topologies-0.6BETA.jar org.apache.storm.flux.Flux --local metron-streaming/Metron-Topologies/src/main/resources/Metron_Configs/topologies/bro/local.yaml --filter metron-streaming/Metron-Topologies/src/main/resources/Metron_Configs/etc/env/config.properties
```
Note that the "main class" is _always_ the same now, and you specify which topology to run entirely through the YAML.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sirsean/incubator-metron flux
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/10.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10
----
commit 263c6fd498a1f28846892b6fd9fbcc8c52629fd5
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-06T20:45:08Z
Add Flux to POM.
commit ffe0369925d90f0a261f1ca902b5bd90ce4b3e10
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-08T20:27:03Z
Started local Bro topology with Flux.
commit 971a478024d00e566359758de86ae44e4f36a807
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-12T21:34:46Z
Added remote Bro topology.
commit 0237f17958bef476735f3e87fe862a7ed219ad7b
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-12T21:38:09Z
Added Flux yaml for existing topologies.
commit b92766d48f718510ca8e6af98db29c2e4f139e92
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-13T17:04:57Z
Removed old config files.
commit 5b3a14b750e5e416913c0bb13bfe2fde1675daf5
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-13T17:17:49Z
Removed old topology runner/builder Java code.
commit 367c81edf7cf6d45f7949da314b6007f0663c82a
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-13T20:51:30Z
Merge branch 'master' of github.com:apache/incubator-metron into flux
commit bafa53c918ddd3c8a8f283dd2b32e16c3c60d9e7
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-14T17:35:20Z
Merge branch 'master' of github.com:apache/incubator-metron into flux
(This includes the big rename.)
commit b6db53e933bbae692a03b1e952a5bc89f2a33d7f
Author: Sean Schulte <si...@gmail.com>
Date: 2016-01-14T17:54:24Z
Merge branch 'master' of github.com:apache/incubator-metron into flux
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron pull request: Storm Flux
Posted by james-sirota <gi...@git.apache.org>.
Github user james-sirota commented on the pull request:
https://github.com/apache/incubator-metron/pull/10#issuecomment-173997438
thanks for checking in. we are in the process of converting our scripts to encompass your changes. will be checking in shortly
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron pull request: Storm Flux
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-metron/pull/10
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron pull request: Storm Flux
Posted by sirsean <gi...@git.apache.org>.
Github user sirsean commented on the pull request:
https://github.com/apache/incubator-metron/pull/10#issuecomment-172360797
I expect this will have a substantial effect on the Ansible scripts, which now have to construct entirely different configuration files.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---