[jira] [Updated] (SDAP-302) Collection Manager crashes when Collections Config is updated while actively scanning S3 dirs

["Eamon Ford (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SDAP-302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eamon Ford updated SDAP-302:
----------------------------
    Sprint: SDAP Sprint 7

> Collection Manager crashes when Collections Config is updated while actively scanning S3 dirs
> ---------------------------------------------------------------------------------------------
>
>                 Key: SDAP-302
>                 URL: https://issues.apache.org/jira/browse/SDAP-302
>             Project: Apache Science Data Analytics Platform
>          Issue Type: Bug
>            Reporter: Eamon Ford
>            Priority: Major
>
> If new collections are added to the collections config while the Collection Manager is in the middle of actively scanning S3 directories, then the Collection Manager prints the following error:
>  
> {{ERROR:asyncio:Task exception was never retrieved}}
> {{future: <Task finished name='Task-7319' coro=<S3Observer._run_periodically() done, defined at /usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py:55> exception=RuntimeError('Set changed size during iteration')>}}
> {{Traceback (most recent call last):}}
> {{ File "/usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py", line 71, in _run_periodically}}
> {{ await func(*args, **kwargs)}}
> {{ File "/usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py", line 78, in _poll}}
> {{ for watch in self._watches:}}
> {{RuntimeError: Set changed size during iteration}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)