You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@usergrid.apache.org by "Keyur Karnik (JIRA)" <ji...@apache.org> on 2019/01/29 22:54:00 UTC

[jira] [Created] (USERGRID-1356) Make entity fetcher threads configurable for Export

Keyur Karnik created USERGRID-1356:
--------------------------------------

             Summary: Make entity fetcher threads configurable for Export
                 Key: USERGRID-1356
                 URL: https://issues.apache.org/jira/browse/USERGRID-1356
             Project: Usergrid
          Issue Type: Improvement
          Components: Stack
    Affects Versions: 2.2.0
            Reporter: Keyur Karnik
            Assignee: Keyur Karnik


The new export tool first fetches all Entity ids and as it fetches them, it starts parallel exports in batches of 1000.

Depending on the data in each entity and the number and size of assets and members (connections etc), this process can take a long time. But as we can safely process it in parallel, we can increase the number of threads to make it faster (keeping resource utilization in mind).

To do this, we need to add configs to set and tune fetcher thread counts.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)