You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@griffin.apache.org by Achyut Anand <ac...@cummins.com> on 2020/06/11 16:01:09 UTC
Queries regarding Apache Griffin
Hello,
This is Achyut from Cummins. My team is looking at a data profiling and rule based data quality tool. Apache Griffin seems like a tool that would help us achieve our goals. However, I wanted to know if we could integrate Griffin with our own applications or frameworks that we already have or do we always have to use Griffin's UI? Another question that I had was that can we define our rules for data quality and validation?
Thank you and have a great day!
Regards,
Achyut Anand
Data Engineer
Cummins Inc.
(617) 752-3389
Re: Queries regarding Apache Griffin
Posted by Eugene Liu <li...@apache.org>.
+ Achyut Anand in mail thread
________________________________
From: Eugene Liu <li...@apache.org>
Sent: Monday, June 15, 2020 10:51 PM
To: dev@griffin.apache.org <de...@griffin.apache.org>
Subject: Re: Queries regarding Apache Griffin
Yeah, You can absolutely just introduce 'measure' module into your project as Chitral mentions. But if you hope to try it, UI could help you complete configuration quickly.
Thx
Eugene Liu
________________________________
From: Chitral Verma <ch...@gmail.com>
Sent: Monday, June 15, 2020 10:40 PM
To: dev@griffin.apache.org <de...@griffin.apache.org>
Subject: Re: Queries regarding Apache Griffin
Hi Achyut,
You can pull the `measure` module from master and use that in your existing
codebase.
Data Quality expressions can be extended using `Expr2DQSteps`, you can
refer to `CompletenessExpr2DQSteps` as an example.
Let me know if you have any questions.
Regards,
Chitral Verma
On Mon, 15 Jun, 2020, 20:06 Achyut Anand, <ac...@cummins.com> wrote:
> Hello,
>
> This is Achyut from Cummins. My team is looking at a data profiling and
> rule based data quality tool. Apache Griffin seems like a tool that would
> help us achieve our goals. However, I wanted to know if we could integrate
> Griffin with our own applications or frameworks that we already have or do
> we always have to use Griffin's UI? Another question that I had was that
> can we define our rules for data quality and validation?
>
> Thank you and have a great day!
>
> Regards,
>
> Achyut Anand
> Data Engineer
> Cummins Inc.
> (617) 752-3389
>
>
Re: Queries regarding Apache Griffin
Posted by Eugene Liu <li...@apache.org>.
Yeah, You can absolutely just introduce 'measure' module into your project as Chitral mentions. But if you hope to try it, UI could help you complete configuration quickly.
Thx
Eugene Liu
________________________________
From: Chitral Verma <ch...@gmail.com>
Sent: Monday, June 15, 2020 10:40 PM
To: dev@griffin.apache.org <de...@griffin.apache.org>
Subject: Re: Queries regarding Apache Griffin
Hi Achyut,
You can pull the `measure` module from master and use that in your existing
codebase.
Data Quality expressions can be extended using `Expr2DQSteps`, you can
refer to `CompletenessExpr2DQSteps` as an example.
Let me know if you have any questions.
Regards,
Chitral Verma
On Mon, 15 Jun, 2020, 20:06 Achyut Anand, <ac...@cummins.com> wrote:
> Hello,
>
> This is Achyut from Cummins. My team is looking at a data profiling and
> rule based data quality tool. Apache Griffin seems like a tool that would
> help us achieve our goals. However, I wanted to know if we could integrate
> Griffin with our own applications or frameworks that we already have or do
> we always have to use Griffin's UI? Another question that I had was that
> can we define our rules for data quality and validation?
>
> Thank you and have a great day!
>
> Regards,
>
> Achyut Anand
> Data Engineer
> Cummins Inc.
> (617) 752-3389
>
>
Re: Queries regarding Apache Griffin
Posted by Chitral Verma <ch...@gmail.com>.
Hi Achyut,
You can pull the `measure` module from master and use that in your existing
codebase.
Data Quality expressions can be extended using `Expr2DQSteps`, you can
refer to `CompletenessExpr2DQSteps` as an example.
Let me know if you have any questions.
Regards,
Chitral Verma
On Mon, 15 Jun, 2020, 20:06 Achyut Anand, <ac...@cummins.com> wrote:
> Hello,
>
> This is Achyut from Cummins. My team is looking at a data profiling and
> rule based data quality tool. Apache Griffin seems like a tool that would
> help us achieve our goals. However, I wanted to know if we could integrate
> Griffin with our own applications or frameworks that we already have or do
> we always have to use Griffin's UI? Another question that I had was that
> can we define our rules for data quality and validation?
>
> Thank you and have a great day!
>
> Regards,
>
> Achyut Anand
> Data Engineer
> Cummins Inc.
> (617) 752-3389
>
>