You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@eagle.apache.org by r7raul1984 <gi...@git.apache.org> on 2016/08/24 02:05:12 UTC
[GitHub] incubator-eagle pull request #379: EAGLE-348 Alert engine base on spark stre...
GitHub user r7raul1984 opened a pull request:
https://github.com/apache/incubator-eagle/pull/379
EAGLE-348 Alert engine base on spark streaming
- EAGLE-424
- Support kafka add/remove topic without requiring restart of the alert engine
- Read spec metadata by restful web app
- Create UnitSparkTopologyRunner to demo spark streaming usage
- Update eagle-alert/README.md to describe how to start spark streaming alert engine
- EAGLE-425
- Use Spark Accumulator to save and recover state
- Use Spark Accumulator to support Hybird Time Window
https://issues.apache.org/jira/browse/EAGLE-348
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/r7raul1984/incubator-eagle spark-EAGLE425
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-eagle/pull/379.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #379
----
commit 2588eb922f99b28d2df5f7239ca0d54c80f61ff1
Author: r7raul1984 <ta...@yhd.com>
Date: 2016-08-15T07:30:20Z
EAGLE-424 Kafka Integration without requiring restart of the alert engine
- Support kafka add/remove topic without requiring restart of the alert engine
- Read spec metadata by restful web app
- Create UnitSparkTopologyRunner to demo spark streaming usage
- Update eagle-alert/README.md to describe how to start spark streaming alert engine
https://issues.apache.org/jira/browse/EAGLE-424
commit 4458c02153977ea84271720ef9c1a8b7d12eb007
Author: r7raul1984 <ta...@yhd.com>
Date: 2016-08-15T09:17:58Z
Modify TestSiddhiEvaluator to sleep more time to wait the result.
commit 0849e03419946341d9158a4ac27d528cfac305d1
Author: r7raul1984 <ta...@yhd.com>
Date: 2016-08-24T01:38:45Z
EAGLE-425 Supporting Hybird Time Window
- Use Spark Accumulator to support Hybird Time Window
- Use Spark Accumulator to save and recover state
https://issues.apache.org/jira/browse/EAGLE-425
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #379: EAGLE-348 Alert engine base on spark streaming
Posted by haoch <gi...@git.apache.org>.
Github user haoch commented on the issue:
https://github.com/apache/incubator-eagle/pull/379
One of the target is to make sure alert engine could be decoupled to run on both Storm and Spark, while they should share the same metadata, I don't understand why do we need spark specific metadata like: `SpecMetadataResource`?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #379: EAGLE-348 Alert engine base on spark streaming
Posted by r7raul1984 <gi...@git.apache.org>.
Github user r7raul1984 commented on the issue:
https://github.com/apache/incubator-eagle/pull/379
For now , I fetch spec config directly from metadata service, Just skip coordinator service. So I create a simple service just return spec config. In the future , I will consider to refactor coordinator service base on Spark platform.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle pull request #379: EAGLE-348 Alert engine base on spark stre...
Posted by r7raul1984 <gi...@git.apache.org>.
Github user r7raul1984 closed the pull request at:
https://github.com/apache/incubator-eagle/pull/379
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---