You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@sdap.apache.org by "Eamon Ford (Jira)" <ji...@apache.org> on 2020/08/11 01:25:00 UTC

[jira] [Created] (SDAP-280) Collection Manager should not block when checking ingestion history

Eamon Ford created SDAP-280:
-------------------------------

             Summary: Collection Manager should not block when checking ingestion history
                 Key: SDAP-280
                 URL: https://issues.apache.org/jira/browse/SDAP-280
             Project: Apache Science Data Analytics Platform
          Issue Type: Bug
          Components: collection-ingester
            Reporter: Eamon Ford
            Assignee: Eamon Ford


The Collection Manager currently makes blocking calls to the filesystem or Solr when comparing files to their ingestion history records. This can significantly impact performance when scanning large directories.

 

The Collection Manager should be changed so that it does not block on IO when checking ingestion history.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)