You are viewing a plain text version of this content. The canonical link for it is here.

Posted to oak-issues@jackrabbit.apache.org by "Thomas Mueller (Jira)" <ji...@apache.org> on 2025/11/06 16:56:00 UTC

[jira] [Resolved] (OAK-12004) Datastore: speedup datastore copy / download

     [ https://issues.apache.org/jira/browse/OAK-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Mueller resolved OAK-12004.
----------------------------------
    Fix Version/s: 1.22.24
       Resolution: Fixed

> Datastore: speedup datastore copy / download
> --------------------------------------------
>
>                 Key: OAK-12004
>                 URL: https://issues.apache.org/jira/browse/OAK-12004
>             Project: Jackrabbit Oak
>          Issue Type: Improvement
>            Reporter: Thomas Mueller
>            Assignee: Thomas Mueller
>            Priority: Major
>             Fix For: 1.22.24
>
>
> I found that using the command line to download binaries (specially Lucene index binaries in my case) from far away (eg. download from Asia, if the datastore is hosted in US east) can take a long time, sometimes 5 minutes for 20 GB.
> I found a way to speed up download, by using more threads. Also, one of the challenges is that some files are really large (sometimes GBs) and some are small. I found that splitting large files into chunks of eg. 16 MB can speed up download.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)