[jira] [Updated] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

["Marcelo Vanzin (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin updated SPARK-11762:
-----------------------------------
    Fix Version/s: 1.6.0

Also merged to 1.6 since SPARK-11140 (even if in a semi-disabled state by default).

> TransportResponseHandler should consider open streams when counting outstanding requests
> ----------------------------------------------------------------------------------------
>
>                 Key: SPARK-11762
>                 URL: https://issues.apache.org/jira/browse/SPARK-11762
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.6.0
>            Reporter: Marcelo Vanzin
>            Assignee: Marcelo Vanzin
>            Priority: Minor
>             Fix For: 1.6.0, 1.7.0
>
>
> This code in TransportResponseHandler:
> {code}
>   public int numOutstandingRequests() {
>     return outstandingFetches.size() + outstandingRpcs.size();
>   }
> {code}
> Is used to determine if the channel is currently in use; if there's a timeout and the channel is in use, then the channel is closed. But it currently does not consider open streams (just block fetches and RPCs), so if a timeout happens during a stream transfer, the channel will remain open.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org