You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/08/21 23:21:00 UTC

[jira] [Commented] (SAMZA-1404) Add warning in case of potential process starvation due to longer window method

    [ https://issues.apache.org/jira/browse/SAMZA-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136001#comment-16136001 ] 

ASF GitHub Bot commented on SAMZA-1404:
---------------------------------------

GitHub user bharathkk opened a pull request:

    https://github.com/apache/samza/pull/281

    SAMZA-1404: Add warning in case of potential process starvation due to longer window method

    Currently, we use the average windowNs as the lower bound for window trigger time to determine if user needs to warned. We could potentially make this complicated by also including average commit ns and some delta to be more accurate.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bharathkk/samza master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/281.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #281
    
----

----


> Add warning in case of potential process starvation due to longer window method
> -------------------------------------------------------------------------------
>
>                 Key: SAMZA-1404
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1404
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Bharath Kumarasubramanian
>            Assignee: Bharath Kumarasubramanian
>
> Samza supports two types of run loop - synchronous and asynchronous. Fairness is guaranteed in synchronous run loop where commit, window, process gets called in round robin fashion. The asynchronous run loop has the potential for starvation if we have window trigger interval <<< time taken to execute code within window method.
> We need to warn users about this potential starvation and fix the guarantee between window, process, commit methods in AsyncRunLoop.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)