Import of Entities taking very long time for Apache-Atlas

[Minal Pathi <mi...@epsilon.com>]

Hello

I am facing difficulties  in importing enttities from an exported zip file. It is taking more than an hour to import 500 entities. The zip file is of 17.6 MB with around 4000 entities.

These are the options I provided in the import-options.json file: {
    "options": {
        "numWorkers": 6,
        "batchSize": 300,
        "format": "zipDirect",
        "migration": "true"
    }
}
numWorkers=6 as we have 2 shards in Solr

and the curl request is as follows:
curl -g -X POST -u admin:admin -H "Content-Type: multipart/form-data" -H "Cache-Control: no-cache" -F request=import-options.json -F data=@export_new.zip<ma...@export_new.zip> http://localhost:21000/api/atlas/admin/import

Can anyone please point out to me any enhacements which can be done for faster entity imports?

Thanks and Regards
Minal B Pathi




------------------------------------------------------------------------
Disclaimer The information in this email and any attachments may contain proprietary and confidential information that is intended for the addressee(s) only. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, retention or use of the contents of this information is prohibited. When addressed to our clients or vendors, any information contained in this e-mail or any attachments is subject to the terms and conditions in any governing contract. If you have received this e-mail in error, please immediately contact the sender and delete the e-mail.