You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/08/03 21:40:00 UTC
[jira] [Commented] (SAMZA-1378) Introduce and Implement Scheduler Interface for Polling in Azure

    [ https://issues.apache.org/jira/browse/SAMZA-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113541#comment-16113541 ] 

ASF GitHub Bot commented on SAMZA-1378:
---------------------------------------

GitHub user PawasChhokra opened a pull request:

    https://github.com/apache/samza/pull/261

    SAMZA-1378: Introduce and Implement Scheduler Interface for Polling in Azure

    PR 1: AzureClient + AzureConfig
    PR 2: LeaseBlobManager
    PR 3: BlobUtils + JobModelBundle
    PR 4: TableUtils + ProcessorEntity
    PR 5: AzureLeaderElector 
    PR 6: Added all schedulers (current PR)

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/PawasChhokra/samza AzureSchedulers

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/261.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #261
    
----
commit 60eab4ec74f402a63bd76583077c2b6edd8cd1c7
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-02T07:55:05Z

    Update settings.gradle

commit 30a34c8ce9132dd9a81ddec5982b6f25aa092f97
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-02T08:00:21Z

    Update build.gradle

commit 16517858d9a2b6cee4fd537767ceb243f65b2ee1
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-02T08:04:55Z

    Add Azure Storage Client

commit bf88e20205af0dc01b7826eeaa71a8ea96b65fb0
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-02T17:46:17Z

    Add Azure Config

commit fb4835d4ed1eac08e473883c5d4b34ad2dfc51c3
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-02T21:25:15Z

    Update configuration-table

commit a62d9716cc473452c65ded2390440340338b2610
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-02T23:41:54Z

    Add lease utility class

commit 00f5f2c4360c13f2e4fdf7f4aa17c39bdd55eb54
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-03T06:47:03Z

    Add blob utils

commit dbfa26027055c9f465c024a901c72ffe73dcc5b6
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-03T07:06:14Z

    Add table utils

commit 0e84de60d5ebce26869c06d2a9ffacc43872669f
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-03T18:36:11Z

    Address review

commit 316cc4b407fe1d133daa52103abcf79cdef7ceda
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-03T18:50:15Z

    Add leader election functionality

commit f1d54839043efa1f6ddae9948800faf77590cf8d
Author: PawasChhokra <jaimatadi1$>
Date:   2017-08-03T21:37:21Z

    Add schedulers for Azure Job Coordinator

----


> Introduce and Implement Scheduler Interface for Polling in Azure
> ----------------------------------------------------------------
>
>                 Key: SAMZA-1378
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1378
>             Project: Samza
>          Issue Type: New Feature
>            Reporter: Pawas Chhokra
>            Assignee: Pawas Chhokra
>
> Azure does not have a watch/subscribe functionality in Azure storage. Therefore, any change in the list of processors in the system will be detected by monitoring each processor's heartbeats. A change in the job model as well as rebalancing state will also require polling to Azure Storage Services. These classes will implement the basic notification listener implementation required for the same.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)