[jira] [Work logged] (GRIFFIN-1) Refactor service code to make it more open and extensible.

["William Guo (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/GRIFFIN-1?focusedWorklogId=38834&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-38834 ]

William Guo logged work on GRIFFIN-1:
-------------------------------------

                Author: William Guo
            Created on: 10/Mar/17 07:03
            Start Date: 10/Mar/17 06:57
    Worklog Time Spent: 4h 
      Work Description: refactoring 
existing accuracy measure model is like

{
  "source": "soj_view_event",
  "target": "be_view_event_queue",
  "accuracyMapping": [
    {
      "sourceColId": 0,
      "sourceColName": "uid",
      "targetColId": 0,
      "targetColName": "uid",
      "matchFunction": "true",
      "isPK": true
    },
    {
      "sourceColId": 2,
      "sourceColName": "page_id",
      "targetColId": 1,
      "targetColName": "page_id",
      "matchFunction": "false",
      "isPK": false
    },
    {
      "sourceColId": 1,
      "sourceColName": "site_id",
      "targetColId": 2,
      "targetColName": "site_id",
      "matchFunction": "false",
      "isPK": false
    },
    {
      "sourceColId": 3,
      "sourceColName": "curprice",
      "targetColId": 5,
      "targetColName": "curprice",
      "matchFunction": "false",
      "isPK": false
    },
    {
      "sourceColId": 4,
      "sourceColName": "itm",
      "targetColId": 6,
      "targetColName": "itm",
      "matchFunction": "false",
      "isPK": false
    }
  ],
  "srcPartitions": [
    {
      "colName": "dt",
      "colValue": "20160703"
    },
    {
      "colName": "hour",
      "colValue": "20"
    }
  ],
  "tgtPartitions": [
    [
      {
        "colName": "dt",
        "colValue": "20160703"
      },
      {
        "colName": "hour",
        "colValue": "20"
      }
    ],
    [
      {
        "colName": "dt",
        "colValue": "20160703"
      },
      {
        "colName": "hour",
        "colValue": "21"
      }
    ]
  ]
}

We need to separate partition(dt and hour) out of DataAsset abstract, we can create a new interface under data asset to encapsulate WHICH PART(partition-timeline based perspective or other dimensions) of DataAsset.

Issue Time Tracking
-------------------

            Worklog Id:     (was: 38834)
            Time Spent: 4h
    Remaining Estimate: 332h  (was: 336h)

> Refactor service code to make it more open and extensible.
> ----------------------------------------------------------
>
>                 Key: GRIFFIN-1
>                 URL: https://issues.apache.org/jira/browse/GRIFFIN-1
>             Project: Griffin (Incubating)
>          Issue Type: Task
>            Reporter: William Guo
>            Assignee: William Guo
>              Labels: github-import
>   Original Estimate: 336h
>          Time Spent: 4h
>  Remaining Estimate: 332h
>
> This project was embedded some legacy features from our company.
> We need to make it more open and extensible for service layer.
> 1 Let users to configure data source service endpoint.
> 2 Let users to configure underlying database instead of hardcode it as mongo.
> 3 Replace jersey service with spring mvc.
> 4 Replace jdbc connection with JPA Spring implemetation.
> 5 Refactor core modesl like data assert, DQSpec, DQRule to make it more extensible.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)