You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@griffin.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/04/13 01:47:41 UTC
[jira] [Commented] (GRIFFIN-11) Enable data quality Accuracy
measure in batch mode
[ https://issues.apache.org/jira/browse/GRIFFIN-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966990#comment-15966990 ]
ASF GitHub Bot commented on GRIFFIN-11:
---------------------------------------
GitHub user bhlx3lyx7 opened a pull request:
https://github.com/apache/incubator-griffin/pull/14
[GRIFFIN-11] Enable accuracy measurement for batch mode
[GRIFFIN-11]
Accuracy measurement for batch mode.
**Supporting**:
- hive data and avro file.
- simple calculation and exactly match function for ESL description.
**Not supporting**:
- param validation yet.
- condition filter expression before mapping match.
- sampling of data.
- persist data cleaner.
- more compare rule for mapping match.
- some group data feature for a batch of data.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bhlx3lyx7/incubator-griffin batch
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-griffin/pull/14.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14
----
commit cda42c2afed75088f988ba13c78f934f48d7e461
Author: Liu <ll...@ebay.com>
Date: 2017-03-31T05:41:00Z
init
commit db3bc88fa0ee3d2ba1988f6d16644dfd25ede641
Author: Liu <ll...@ebay.com>
Date: 2017-03-31T09:14:56Z
config
commit 448cda57054332a4280df77d21f68b63f2406112
Author: Liu <ll...@ebay.com>
Date: 2017-03-31T09:44:00Z
config
commit 83e818b25039ea63a5e95bf144c1236f1bfbaea1
Author: Liu <ll...@ebay.com>
Date: 2017-04-01T09:25:41Z
params
commit f02b3bdeb1db7f8db2a838065084702309380572
Author: Liu <ll...@ebay.com>
Date: 2017-04-01T09:44:37Z
log
commit a6d3aabb4cea9e701659d8a83c243f6a92b6a2a9
Author: Liu <ll...@lm-shc-16501428.corp.ebay.com>
Date: 2017-04-05T04:55:44Z
add util
commit 1eddeab7d730e1a05c76989155c02b48b327553e
Author: Liu <ll...@ebay.com>
Date: 2017-04-05T04:57:50Z
algo
commit b07cdfad325271747d2dbaabb06e38d35aca105e
Author: Liu <ll...@ebay.com>
Date: 2017-04-05T04:58:29Z
Merge branch 'batch' of https://github.com/bhlx3lyx7/incubator-griffin into batch
commit 0607402ba73262e4cfa52a0e39199b9f7232757a
Author: Liu <ll...@ebay.com>
Date: 2017-04-05T07:11:14Z
add persist
commit 09ec73f7ef7a0cd6ad608b6b042a817f216ddb91
Author: Liu <ll...@ebay.com>
Date: 2017-04-05T09:04:07Z
persist
commit 4623659bbbf8166fb760d0c16b9f9f5de0ae39c4
Author: Liu <ll...@ebay.com>
Date: 2017-04-06T09:41:14Z
parser
commit d9f1eb28771f77e4077086bec1910ba7f0bab25b
Author: Liu <ll...@ebay.com>
Date: 2017-04-06T10:01:39Z
run
commit 597ac44b0b9707e934cae8825a9d208fdffac0a7
Author: Liu <ll...@ebay.com>
Date: 2017-04-07T10:26:54Z
redesign expr
commit 62f23217dbea9178d140d91de98ab50c701584f2
Author: Liu <ll...@lm-shc-16501428.dhcp>
Date: 2017-04-08T08:57:49Z
1
commit 4784376062566eed24228c7d9e38dfe8b9d606c6
Author: Liu <ll...@lm-shc-16501428.dhcp>
Date: 2017-04-08T08:58:11Z
Merge branch 'batch' of https://github.com/bhlx3lyx7/incubator-griffin into batch
commit ee88c990743ab1a922d6e1930cdac5ef17deb7f8
Author: Liu <ll...@lm-shc-16501428.dhcp>
Date: 2017-04-09T16:26:15Z
expr
commit d25eaacd705012f41d1a2db5df58034a9aeb1a52
Author: Liu <ll...@ebay.com>
Date: 2017-04-10T07:01:04Z
data get
commit 36115bcd53cdf85878b73f097bbe23ec683124aa
Author: Liu <ll...@ebay.com>
Date: 2017-04-10T10:56:15Z
algorithm
commit 93f699ddd4ffc75adc2beb00b9e803ab6bcc5e0b
Author: Liu <ll...@ebay.com>
Date: 2017-04-11T01:47:40Z
simple version 1
commit d28bbb4e241ca08e84aee18b8b2325caf39b0dfc
Author: Liu <ll...@ebay.com>
Date: 2017-04-11T07:39:40Z
sample success
commit 8d2d0ee723070d67005e5dd9acdf7c043b3b4fcb
Author: Liu <ll...@ebay.com>
Date: 2017-04-11T07:40:43Z
avro done
commit 296b66bbd9a38ad4916182fa5ce83419c31be92d
Author: Liu <ll...@ebay.com>
Date: 2017-04-11T10:26:27Z
persist
commit 39fa96fe8abd572ac860eb9fa62684e451fecd19
Author: Liu <ll...@ebay.com>
Date: 2017-04-12T05:57:14Z
persist
commit 37a4f4b622950441565160c37b4eea6061d79500
Author: Liu <ll...@ebay.com>
Date: 2017-04-12T05:59:42Z
persist1
commit fbb34f9331b0d0b3d3d0b56e9b599c33f4dc3ebc
Author: Liu <ll...@ebay.com>
Date: 2017-04-12T06:38:12Z
persist log
commit 5a84c63aff5adac37ba4743e8225c330f6557fc3
Author: Liu <ll...@ebay.com>
Date: 2017-04-12T06:58:47Z
clean
commit 27f38af1d1f141f6457e777ed8eb1634e82356e8
Author: Liu <ll...@ebay.com>
Date: 2017-04-12T07:06:41Z
rename dsl to rule
commit a0803e0c1ab45556b6fd757de7761b2a492c7a35
Author: Liu <ll...@ebay.com>
Date: 2017-04-12T10:02:51Z
mismatch record
commit ae639164854961f816d227642a03935cc256e94d
Author: Liu <ll...@ebay.com>
Date: 2017-04-13T01:00:37Z
param file from hdfs
commit f97510e24907abf9afd6bad96c43c5c760df58de
Author: Liu <ll...@ebay.com>
Date: 2017-04-13T01:31:34Z
avro metadata
----
> Enable data quality Accuracy measure in batch mode
> --------------------------------------------------
>
> Key: GRIFFIN-11
> URL: https://issues.apache.org/jira/browse/GRIFFIN-11
> Project: Griffin (Incubating)
> Issue Type: Wish
> Reporter: William Guo
> Assignee: Lionel Liu
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)