You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/02/03 15:26:39 UTC
[jira] [Commented] (TAJO-2069) Implement finding the total size of
all objects in a bucket with AWS SDK.
[ https://issues.apache.org/jira/browse/TAJO-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15130458#comment-15130458 ]
ASF GitHub Bot commented on TAJO-2069:
--------------------------------------
Github user blrunner commented on the pull request:
https://github.com/apache/tajo/pull/953#issuecomment-179264732
Here is my benchmark results as follows.
# Configuration
* EC2 instance type : c3.xlarge
* Tajo version : 0.12.0-SNAPSHOT with TAJO-2030 and TAJO-2069
* Cluster: 1 master, 1 worker
# Contents summary time
#of partitions | S3AFileSystem::getContentsSummary | S3FileTableSpace::getTotalSize | Improvement
-------------------|----------------------|--------------------------|-------------------
5 | 1372 ms | 17 ms | 80.7x
365 | 55447 ms | 120 ms | 462.0x
730 | 110245 ms | 101 ms | 1091.5x
1095 | 164812 ms | 222 ms | 742.4x
1460 | 221492 ms | 217 ms | 1020.7x
> Implement finding the total size of all objects in a bucket with AWS SDK.
> -------------------------------------------------------------------------
>
> Key: TAJO-2069
> URL: https://issues.apache.org/jira/browse/TAJO-2069
> Project: Tajo
> Issue Type: Sub-task
> Components: Catalog, QueryMaster, S3, Storage
> Reporter: Jaehwa Jung
> Assignee: Jaehwa Jung
> Fix For: 0.12.0
>
>
> See the title and TAJO-2023.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)