[jira] [Created] (GRIFFIN-323) Refactor configuration for Data Source and Data Source Connector

["Chitral Verma (Jira)" <ji...@apache.org>]

Chitral Verma created GRIFFIN-323:
-------------------------------------

             Summary: Refactor configuration for Data Source and Data Source Connector
                 Key: GRIFFIN-323
                 URL: https://issues.apache.org/jira/browse/GRIFFIN-323
             Project: Griffin
          Issue Type: Improvement
            Reporter: Chitral Verma


Current config structure for Data Source is as follows,
{noformat}
 
"data.sources": [
    {
      "name": "src",
      "connectors": [
        {
          "type": "AVRO",
          "version": "1.7",
          "config": {
            "file.path": "<path>/<to>",
            "file.name": "<source-file>.avro"
          }
        }
      ]
    },
    {
      "name": "tgt",
      "connectors": [
        {
          "type": "AVRO",
          "version": "1.7",
          "config": {
            "file.path": "<path>/<to>",
            "file.name": "<target-file>.avro"
          }
        }
      ]
    }
  ]

{noformat}
 

This ticket proposes the following changes,
 * remove 'version' from 'DataConnectorParam' as it is not being used anywhere in the codebase.
 * change 'connectors' from array type to a single JSON object. Since a data source named X may only be of one type (hive, file etc), the connector field should not be an array.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)