[jira] [Commented] (REEF-714) Service to report REEF events

["Markus Weimer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/REEF-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729200#comment-14729200 ] 

Markus Weimer commented on REEF-714:
------------------------------------

Great idea!

One more thing we could have is the ability to create filters on those events and then export the filtered event stream in all the ways described above. That would be useful to create monitoring dashboards.

> Service to report REEF events
> -----------------------------
>
>                 Key: REEF-714
>                 URL: https://issues.apache.org/jira/browse/REEF-714
>             Project: REEF
>          Issue Type: New Feature
>          Components: REEF
>            Reporter: Geon Woo Kim
>            Assignee: Geon Woo Kim
>             Fix For: 0.13
>
>
> Control plane events, such as {{AllocatedEvaluator}} and {{ActivatedContext}},  can easily be tracked by adding {{EventListener}} s to {{DriverConfiguration}} without disturbing the application. It would be good to make a Service that listens to and reports the events. Also, the Service can be enhanced to work as a general profiler by adding more event types for profiling.
> This service 
>  1) should be integrated with existing REEF applications.
>  2) should report events in a well-defined format.
>  3) can print the events to the file system.
>  4) can report the events to an external web server using RESTful API.
> This can be used to implement a realtime observation web UI like [spark-spree|http://www.hammerlab.org/2015/07/25/spree-58-a-live-updating-web-ui-for-spark/].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)