[jira] [Created] (CLIMATE-837) Make Abstract Base Classes for dataset loaders.

["Alex Goodman (JIRA)" <ji...@apache.org>]

Alex Goodman created CLIMATE-837:
------------------------------------

             Summary: Make Abstract Base Classes for dataset loaders.
                 Key: CLIMATE-837
                 URL: https://issues.apache.org/jira/browse/CLIMATE-837
             Project: Apache Open Climate Workbench
          Issue Type: Improvement
          Components: data sources
    Affects Versions: 1.1.0
            Reporter: Alex Goodman
            Assignee: Huikyo Lee
             Fix For: 1.2.0


Now that the {{DatasetLoader}} class has made it possible for users to easily handle loading multiple datasets from different sources, [~huikyole] has suggested that we add another layer of abstraction one level down. Specifically, this pertains to each of the loader functions for each different data source (eg, ESGF, OPeNDAP, local, etc). In order to better standardize our handling of dataset loaders, we instead propose creating abstract base classes for the dataset loaders, as we have done with our metrics. For example, 

{code}
class GenericLoader:
   def load(self, **kwargs):
   # Handle loading
{code}

Although the function signatures of each of the source loaders are very different, they fundamentally either output a single or list of OCW Dataset objects, and may take a single or list of file locations. This would would be the basis for defining the abstract base classes. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)