You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/04/19 20:31:41 UTC

[jira] [Commented] (SAMZA-1174) Profiling State Perfromance

    [ https://issues.apache.org/jira/browse/SAMZA-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975454#comment-15975454 ] 

ASF GitHub Bot commented on SAMZA-1174:
---------------------------------------

GitHub user s-noghabi opened a pull request:

    https://github.com/apache/samza/pull/132

    Profiling State Performance

    This is s commit for [SAMZA-1174](https://issues.apache.org/jira/browse/SAMZA-1174). This commit involves gathering a log of operations (read, write, delete, etc.) happening on the state and publishing them into a kafka topic. It is names as "Access Log" behaving similar to changelog, but gathering log information.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/s-noghabi/samza master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/132.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #132
    
----
commit 9a62a7138cab12941e7becb03cd4016fa7912ee7
Author: jmehar2 <jm...@illinois.edu>
Date:   2017-04-19T20:20:41Z

    AccessLog for measuring storage access patterns and metrics

commit 2efaaaa19f9f878bd56d3152d5c44e860b205254
Author: s-noghabi <ab...@illinois.edu>
Date:   2017-04-19T20:27:58Z

    Merge pull request #1 from jayasi/access-log
    
    AccessLog for measuring storage access patterns and metrics

----


> Profiling State Perfromance
> ---------------------------
>
>                 Key: SAMZA-1174
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1174
>             Project: Samza
>          Issue Type: New Feature
>            Reporter: Shadi A. Noghabi
>            Assignee: Shadi A. Noghabi
>              Labels: features
>             Fix For: 0.13.0
>
>
> Adding profiling capabilities specifically for state access. This would include logging all state accesses and later parsing the log to find metrics such as read/write ratio, locality, object size distribution, etc.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)