You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@griffin.apache.org by "Wan Kun (Jira)" <ji...@apache.org> on 2020/02/10 09:10:00 UTC
[jira] [Resolved] (GRIFFIN-323) Refactor configuration for Data
Source and Data Source Connector
[ https://issues.apache.org/jira/browse/GRIFFIN-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wan Kun resolved GRIFFIN-323.
-----------------------------
Fix Version/s: 0.6.0
Resolution: Fixed
Issue resolved by pull request 568
[https://github.com/apache/griffin/pull/568]
> Refactor configuration for Data Source and Data Source Connector
> ----------------------------------------------------------------
>
> Key: GRIFFIN-323
> URL: https://issues.apache.org/jira/browse/GRIFFIN-323
> Project: Griffin
> Issue Type: Improvement
> Reporter: Chitral Verma
> Priority: Major
> Fix For: 0.6.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Current config structure for Data Source is as follows,
> {noformat}
>
> "data.sources": [
> {
> "name": "src",
> "connectors": [
> {
> "type": "AVRO",
> "version": "1.7",
> "config": {
> "file.path": "<path>/<to>",
> "file.name": "<source-file>.avro"
> }
> }
> ]
> },
> {
> "name": "tgt",
> "connectors": [
> {
> "type": "AVRO",
> "version": "1.7",
> "config": {
> "file.path": "<path>/<to>",
> "file.name": "<target-file>.avro"
> }
> }
> ]
> }
> ]
> {noformat}
>
> This ticket proposes the following changes,
> * remove 'version' from 'DataConnectorParam' as it is not being used anywhere in the codebase.
> * change 'connectors' from array type to a single JSON object. Since a data source named X may only be of one type (hive, file etc), the connector field should not be an array.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)