[jira] [Commented] (STORM-902) Simple Log Search

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STORM-902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14987660#comment-14987660 ] 

ASF GitHub Bot commented on STORM-902:
--------------------------------------

GitHub user zhuoliu opened a pull request:

    https://github.com/apache/storm/pull/848

    [STORM-902] Simple Log Search

    This feature is aimed for greatly improving the debugging of Storm.
    Simple Log Search supports following important functionalities:
    
    1. String search:
    In UI, user can search certain string, e.g., "Exception", in for a certain worker log.
    This search can happen for both normal text log or rolled zip log files. In addition, user can specify the number of matches to show in the search result.
    2. Deep search:
    User can search for a string for a certain topology, which means the UI will try to search on all the supervisor nodes in a distributed way to find the matched string in all logs for this topology.
    Then the matched results can be shown on the UI with url links, directing user to the certain logs on each supervisor node. This powerful feature is very helpful for users to find certain problematic supervisor nodes running this topology.
    
    Also, the topology history REST API is added to give hints for the previously launched topology IDs for a certain user. And the html files, images files, js file, test resource files and unit tests are added for log search and its tests.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/zhuoliu/storm 902

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/storm/pull/848.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #848
    
----
commit 20db09cc5da62bd1b13e8c563e55f9e8e5103a4a
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-10-30T19:35:32Z

    [YSTORM-902] log search, init commit

commit ad64c5d94607ebaa696171c2f67cf7d3a621f5a1
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-11-02T02:06:00Z

    Continue on logviewer search

commit 04577758baee3258d2be4401f009e95658a17405
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-11-02T02:14:48Z

    lv compile passed, to do html and then manual test, unit test

commit 13194c612eb55a4d4254860172139878e46dee67
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-11-02T03:03:33Z

    Add html image files

commit dfb5e90852e221af6027df35d61c0951a6973ecc
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-11-02T19:41:21Z

    Now able to search, except the magnifying lens stuff (related to topo history)

commit ca24ea096adc37375e83febb105df5532a720d17
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-11-02T19:58:38Z

    Support TopologyHistory (just a couple of topoId for a user)

commit 4d1acbf7fb60d7a09fbb861fd5ef309638eca864
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-11-02T23:31:37Z

    Debug, thrift, topo history, now working well for deep search.

commit 90ef371aadc14585f6db785fc0058f0790136eb6
Author: zhuol <zh...@yahoo-inc.com>
Date:   2015-11-03T16:52:26Z

    Unit test and add related resurces files

----


> Simple Log Search
> -----------------
>
>                 Key: STORM-902
>                 URL: https://issues.apache.org/jira/browse/STORM-902
>             Project: Apache Storm
>          Issue Type: New Feature
>          Components: storm-core
>            Reporter: Robert Joseph Evans
>            Assignee: Zhuo Liu
>
> In many debugging cases it would be nice to be able to do a simple search of the logs of a topology directly from the UI.
> This is work that Yahoo has already done, but needs to be put back into open source.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)