You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Akira AJISAKA (JIRA)" <ji...@apache.org> on 2016/01/30 02:29:39 UTC
[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after
HDFS-6565
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124587#comment-15124587 ]
Akira AJISAKA commented on HDFS-9724:
-------------------------------------
Eremikhin's benchmark:
* Hadoop 2.7.1
{noformat}
alexxz@hadoop1.mlan:~> time curl 'http://hadoop1:50070/webhdfs/v1/tmp/test?op=LISTSTATUS' | wc
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 2469k 0 2469k 0 0 335k 0 --:--:-- 0:00:07 --:--:-- 338k
10002 10002 2528929
real 0m7.397s
user 0m0.084s
sys 0m0.028s
{noformat}
* Hadoop 2.7.1 with the patch which reverts HDFS-6565
{noformat}
alexxz@hadoop1.mlan:~> time curl 'http://hadoop1:50070/webhdfs/v1/tmp/test?op=LISTSTATUS' | wc
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 2469k 0 2469k 0 0 14.5M 0 --:--:-- --:--:-- --:--:-- 15.0M
10002 10002 2528929
real 0m0.180s
user 0m0.100s
sys 0m0.012s
{noformat}
> WebHDFS listing is too slow after HDFS-6565
> -------------------------------------------
>
> Key: HDFS-9724
> URL: https://issues.apache.org/jira/browse/HDFS-9724
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: performance
> Affects Versions: 2.7.0
> Reporter: Akira AJISAKA
> Priority: Critical
>
> Eremikhin Alexey reported at user ML that WebHDFS listing is too slow because of HDFS-6565.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)