You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Kathleen Ting (JIRA)" <ji...@apache.org> on 2012/08/16 01:44:37 UTC

[jira] [Created] (FLUME-1488) Load Balancing RPC client should support exponential backoff of failed nodes

Kathleen Ting created FLUME-1488:
------------------------------------

             Summary: Load Balancing RPC client should support exponential backoff of failed nodes
                 Key: FLUME-1488
                 URL: https://issues.apache.org/jira/browse/FLUME-1488
             Project: Flume
          Issue Type: New Feature
    Affects Versions: v1.2.0
            Reporter: Kathleen Ting


The Load Balancing RPC client should be able to support exponential backoff of failed nodes so that we don't get repeated failures on known bad endpoints.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (FLUME-1488) Load Balancing RPC client should support exponential backoff of failed nodes

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hari Shreedharan updated FLUME-1488:
------------------------------------

    Attachment: FLUME-1488-1.patch
    
> Load Balancing RPC client should support exponential backoff of failed nodes
> ----------------------------------------------------------------------------
>
>                 Key: FLUME-1488
>                 URL: https://issues.apache.org/jira/browse/FLUME-1488
>             Project: Flume
>          Issue Type: New Feature
>    Affects Versions: v1.2.0
>            Reporter: Kathleen Ting
>            Assignee: Hari Shreedharan
>         Attachments: FLUME-1488-0.patch, FLUME-1488-1.patch
>
>
> The Load Balancing RPC client should be able to support exponential backoff of failed nodes so that we don't get repeated failures on known bad endpoints.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (FLUME-1488) Load Balancing RPC client should support exponential backoff of failed nodes

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hari Shreedharan reassigned FLUME-1488:
---------------------------------------

    Assignee: Hari Shreedharan
    
> Load Balancing RPC client should support exponential backoff of failed nodes
> ----------------------------------------------------------------------------
>
>                 Key: FLUME-1488
>                 URL: https://issues.apache.org/jira/browse/FLUME-1488
>             Project: Flume
>          Issue Type: New Feature
>    Affects Versions: v1.2.0
>            Reporter: Kathleen Ting
>            Assignee: Hari Shreedharan
>
> The Load Balancing RPC client should be able to support exponential backoff of failed nodes so that we don't get repeated failures on known bad endpoints.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1488) Load Balancing RPC client should support exponential backoff of failed nodes

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450467#comment-13450467 ] 

Hari Shreedharan commented on FLUME-1488:
-----------------------------------------

I have a rough implementation that uses the same code for both Sink selector and rpc client, which as of now uses cut-paste code. Unfortunately, I need to keep the current interfaces as a wrapper to the generic class I implemented because these interfaces were in release 1.2.0 and removing/modifying them or the AbstractSinkSelector class can break custom components. So I am working around this for now.
                
> Load Balancing RPC client should support exponential backoff of failed nodes
> ----------------------------------------------------------------------------
>
>                 Key: FLUME-1488
>                 URL: https://issues.apache.org/jira/browse/FLUME-1488
>             Project: Flume
>          Issue Type: New Feature
>    Affects Versions: v1.2.0
>            Reporter: Kathleen Ting
>            Assignee: Hari Shreedharan
>
> The Load Balancing RPC client should be able to support exponential backoff of failed nodes so that we don't get repeated failures on known bad endpoints.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (FLUME-1488) Load Balancing RPC client should support exponential backoff of failed nodes

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hari Shreedharan updated FLUME-1488:
------------------------------------

    Attachment: FLUME-1488-0.patch
    
> Load Balancing RPC client should support exponential backoff of failed nodes
> ----------------------------------------------------------------------------
>
>                 Key: FLUME-1488
>                 URL: https://issues.apache.org/jira/browse/FLUME-1488
>             Project: Flume
>          Issue Type: New Feature
>    Affects Versions: v1.2.0
>            Reporter: Kathleen Ting
>            Assignee: Hari Shreedharan
>         Attachments: FLUME-1488-0.patch
>
>
> The Load Balancing RPC client should be able to support exponential backoff of failed nodes so that we don't get repeated failures on known bad endpoints.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1488) Load Balancing RPC client should support exponential backoff of failed nodes

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449525#comment-13449525 ] 

Hari Shreedharan commented on FLUME-1488:
-----------------------------------------

I'm planning to implement this. If no one has objections, I am going to pick this up.
                
> Load Balancing RPC client should support exponential backoff of failed nodes
> ----------------------------------------------------------------------------
>
>                 Key: FLUME-1488
>                 URL: https://issues.apache.org/jira/browse/FLUME-1488
>             Project: Flume
>          Issue Type: New Feature
>    Affects Versions: v1.2.0
>            Reporter: Kathleen Ting
>
> The Load Balancing RPC client should be able to support exponential backoff of failed nodes so that we don't get repeated failures on known bad endpoints.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (FLUME-1488) Load Balancing RPC client should support exponential backoff of failed nodes

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454546#comment-13454546 ] 

Hudson commented on FLUME-1488:
-------------------------------

Integrated in flume-trunk #302 (See [https://builds.apache.org/job/flume-trunk/302/])
    FLUME-1488. Load Balancing RPC client should support exponential backoff of failed nodes. (Revision 960d03d8a5d3b56db15dd390435a3b359f3ac4fb)

     Result = SUCCESS
mpercy : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=960d03d8a5d3b56db15dd390435a3b359f3ac4fb
Files : 
* flume-ng-sdk/src/main/java/org/apache/flume/util/OrderSelector.java
* flume-ng-sdk/src/main/java/org/apache/flume/api/LoadBalancingRpcClient.java
* flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java
* flume-ng-sdk/pom.xml
* flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java
* flume-ng-sdk/src/test/java/org/apache/flume/api/TestLoadBalancingRpcClient.java
* flume-ng-sdk/src/main/java/org/apache/flume/util/RandomOrderSelector.java
* flume-ng-sdk/src/main/java/org/apache/flume/util/RoundRobinOrderSelector.java
* flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java
* flume-ng-sdk/src/main/java/org/apache/flume/api/RpcClientConfigurationConstants.java

                
> Load Balancing RPC client should support exponential backoff of failed nodes
> ----------------------------------------------------------------------------
>
>                 Key: FLUME-1488
>                 URL: https://issues.apache.org/jira/browse/FLUME-1488
>             Project: Flume
>          Issue Type: New Feature
>    Affects Versions: v1.2.0
>            Reporter: Kathleen Ting
>            Assignee: Hari Shreedharan
>             Fix For: v1.3.0
>
>         Attachments: FLUME-1488-0.patch, FLUME-1488-1.patch
>
>
> The Load Balancing RPC client should be able to support exponential backoff of failed nodes so that we don't get repeated failures on known bad endpoints.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira