You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Jonathan Eagles (JIRA)" <ji...@apache.org> on 2017/02/21 21:15:44 UTC
[jira] [Created] (TEZ-3633) Implement keep-alive timeout in tez
shuffle handler
Jonathan Eagles created TEZ-3633:
------------------------------------
Summary: Implement keep-alive timeout in tez shuffle handler
Key: TEZ-3633
URL: https://issues.apache.org/jira/browse/TEZ-3633
Project: Apache Tez
Issue Type: Sub-task
Reporter: Jonathan Eagles
Assignee: Jonathan Eagles
MAPREDUCE-5787 which added keep-alive to mapreduce shuffle handler was not fully functional as despite advertising keep-alive option and adding the header to the response, all connections were closed immediately after write. This reduced the performance of certain fetches as now time is spent requesting a second get to the same serve, only for that server to reset the connection forcing the client to reestablish the connection on another port. The details of this is hidden behind HttpURLConnection and doesn't show in any log file at default logging level. However TCP sniffing does show errant behavior.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)