You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2019/06/20 08:44:00 UTC
[jira] [Resolved] (HADOOP-16379) S3AInputStream#unbuffer should
merge input stream stats into fs-wide stats
[ https://issues.apache.org/jira/browse/HADOOP-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-16379.
-------------------------------------
Resolution: Fixed
Fix Version/s: 3.3.0
+1, committed to trunk
> S3AInputStream#unbuffer should merge input stream stats into fs-wide stats
> --------------------------------------------------------------------------
>
> Key: HADOOP-16379
> URL: https://issues.apache.org/jira/browse/HADOOP-16379
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
> Fix For: 3.3.0
>
>
> HADOOP-14747 added support for {{CanUnbuffer}} to S3A. One issue for applications that rely on the {{CanUnbuffer}} functionality, is that the current S3A code only merges input stream stats when the stream is closed. Applications using {{CanUnbuffer}} might not close streams for a long time, so any stats reported by input streams don't get reported in the filesystem-wide metrics.
> This JIRA proposes merging input stream statistics when {{S3AInputStream#unbuffer}} is called.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org