You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Weiwei Yang (JIRA)" <ji...@apache.org> on 2017/09/20 06:28:01 UTC

[jira] [Created] (HDFS-12504) Ozone: Improve SQLCLI performance

Weiwei Yang created HDFS-12504:
----------------------------------

             Summary: Ozone: Improve SQLCLI performance
                 Key: HDFS-12504
                 URL: https://issues.apache.org/jira/browse/HDFS-12504
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ozone
            Reporter: Weiwei Yang


In my test, my {{ksm.db}} has *3017660* entries with total size of *128mb*, SQLCLI tool runs over *2 hours* but still not finish exporting the DB. This is because it iterates each entry and inserts that to another sqllite DB file, which is not efficient. We need to improve this to be running more efficiently on large DB files.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org