You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@usergrid.apache.org by "Keyur Karnik (JIRA)" <ji...@apache.org> on 2019/01/30 00:43:00 UTC

[jira] [Resolved] (USERGRID-1356) Make entity fetcher threads configurable for Export

     [ https://issues.apache.org/jira/browse/USERGRID-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Keyur Karnik resolved USERGRID-1356.
------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.2.0

https://github.com/apache/usergrid/pull/620

> Make entity fetcher threads configurable for Export
> ---------------------------------------------------
>
>                 Key: USERGRID-1356
>                 URL: https://issues.apache.org/jira/browse/USERGRID-1356
>             Project: Usergrid
>          Issue Type: Improvement
>          Components: Stack
>    Affects Versions: 2.2.0
>            Reporter: Keyur Karnik
>            Assignee: Keyur Karnik
>            Priority: Minor
>             Fix For: 2.2.0
>
>
> The new export tool first fetches all Entity ids and as it fetches them, it starts parallel exports in batches of 1000.
> Depending on the data in each entity and the number and size of assets and members (connections etc), this process can take a long time. But as we can safely process it in parallel, we can increase the number of threads to make it faster (keeping resource utilization in mind).
> To do this, we need to add configs to set and tune fetcher thread counts.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)