You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sdap.apache.org by "Eamon Ford (Jira)" <ji...@apache.org> on 2021/01/08 22:18:00 UTC

[jira] [Created] (SDAP-302) Collection Manager crashes when Collections Config is updated while actively scanning S3 dirs

Eamon Ford created SDAP-302:
-------------------------------

             Summary: Collection Manager crashes when Collections Config is updated while actively scanning S3 dirs
                 Key: SDAP-302
                 URL: https://issues.apache.org/jira/browse/SDAP-302
             Project: Apache Science Data Analytics Platform
          Issue Type: Bug
            Reporter: Eamon Ford


If new collections are added to the collections config while the Collection Manager is in the middle of actively scanning S3 directories, then the Collection Manager prints the following error:

 

{{ERROR:asyncio:Task exception was never retrieved}}
{{future: <Task finished name='Task-7319' coro=<S3Observer._run_periodically() done, defined at /usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py:55> exception=RuntimeError('Set changed size during iteration')>}}
{{Traceback (most recent call last):}}
{{ File "/usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py", line 71, in _run_periodically}}
{{ await func(*args, **kwargs)}}
{{ File "/usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py", line 78, in _poll}}
{{ for watch in self._watches:}}
{{RuntimeError: Set changed size during iteration}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)