You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/17 21:41:11 UTC

[jira] [Resolved] (HADOOP-2608) Reading sequence file consumes 100% cpu with maximum throughput being about 5MB/sec per process

     [ https://issues.apache.org/jira/browse/HADOOP-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer resolved HADOOP-2608.
--------------------------------------

    Resolution: Fixed

I'm going to close this out as stale.

> Reading sequence file consumes 100% cpu with maximum throughput being about 5MB/sec per process
> -----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-2608
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2608
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>            Reporter: Runping Qi
>
> I did some tests on the throughput of scanning block-compressed sequence files.
> The sustained throughput was bounded at 5MB/sec per process, with the cpu of each process maxed at 100%.
> It seems to me that the cpu consumption is too high and the throughput is too low for just scanning files.



--
This message was sent by Atlassian JIRA
(v6.2#6252)