You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Lokesh Jain (JIRA)" <ji...@apache.org> on 2018/01/31 13:35:00 UTC
[jira] [Assigned] (HDFS-12504) Ozone: Improve SQLCLI performance
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lokesh Jain reassigned HDFS-12504:
----------------------------------
Assignee: Weiwei Yang (was: Lokesh Jain)
> Ozone: Improve SQLCLI performance
> ---------------------------------
>
> Key: HDFS-12504
> URL: https://issues.apache.org/jira/browse/HDFS-12504
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone
> Reporter: Weiwei Yang
> Assignee: Weiwei Yang
> Priority: Major
> Labels: performance
> Attachments: HDFS-12504-HDFS-7240.001.patch
>
>
> In my test, my {{ksm.db}} has *3017660* entries with total size of *128mb*, SQLCLI tool runs over *2 hours* but still not finish exporting the DB. This is because it iterates each entry and inserts that to another sqllite DB file, which is not efficient. We need to improve this to be running more efficiently on large DB files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org