You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Mukul Kumar Singh (Jira)" <ji...@apache.org> on 2020/06/09 10:04:00 UTC
[jira] [Commented] (HDDS-3761) "ozone fs -get" is way to slow than
"ozone sh key get"
[ https://issues.apache.org/jira/browse/HDDS-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129096#comment-17129096 ]
Mukul Kumar Singh commented on HDDS-3761:
-----------------------------------------
Are there lots of file and directories on this bucket? in the filesystem code path, with HDDS-2939, there can be multiple iterations of the RocksDB to do prefix matching.
cc [~rakeshr]
> "ozone fs -get" is way to slow than "ozone sh key get"
> ------------------------------------------------------
>
> Key: HDDS-3761
> URL: https://issues.apache.org/jira/browse/HDDS-3761
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Reporter: Sammi Chen
> Priority: Major
>
> Read time spend to download a 7GB+ object,
> time ozone fs -get o3fs://konajdk-profiler.s325d55ad283aa400af464c76d713c07ad/part-00000 ./part-00000-back
> 2020-06-09 11:19:47,284 [main] INFO impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties
> 2020-06-09 11:19:47,339 [main] INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
> 2020-06-09 11:19:47,339 [main] INFO impl.MetricsSystemImpl: XceiverClientMetrics metrics system started
> real 45m26.152s
> user 0m28.576s
> sys 0m13.488s
> 222
> time bin/hadoop fs -get s3a://konajdk-profiler/part-00000 ./part-00000-back-1
> 20/06/09 11:19:57 INFO security.UserGroupInformation: Hadoop UGI authentication : SIMPLE
> real 3m3.542s
> user 0m7.644s
> sys 0m12.016s
> 222
> time bin/ozone sh key get s325d55ad283aa400af464c76d713c07ad/konajdk-profiler/part-00000 ./part-00000-back
> real 1m26.900s
> user 0m19.604s
> sys 0m10.280s
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org