You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@griffin.apache.org by Rajiv Vipani <Ra...@albertsons.com> on 2019/08/08 18:06:09 UTC

Apache Griffin connection to back end

Can Griffin connect to a source and target that is non-hive tables. Is there a sample one can share.

Many thanks.

Rajiv
________________________________
Warning: All e-mail sent to this address will be received by the corporate e-mail system, and is subject to archival and review by someone other than the recipient. This e-mail may contain proprietary information and is intended only for the use of the intended recipient(s). If the reader of this message is not the intended recipient(s), you are notified that you have received this message in error and that any review, dissemination, distribution or copying of this message is strictly prohibited. If you have received this message in error, please notify the sender immediately.
________________________________

Re: Apache Griffin connection to back end

Posted by Kevin Yao <ah...@gmail.com>.

Hi Nick,

Can we write a document about describing which classes involves and give
steps to implement?

Thanks,
Kevin

On Fri, Aug 9, 2019 at 8:50 AM Nick Sokolov <ch...@gmail.com> wrote:

> There is support for data source plugins. You can implement one and supply
> as extra jar in Livy config - you just need to implement interface and
> return dataframe create in plugin.
>
> On Thu, Aug 8, 2019, 15:24 Qian Wang <qw...@gmail.com> wrote:
>
> > Hi Rajiv,
> >
> > What kind of data source do you want to use? You can implement the
> > interface HiveMetaStoreService for your specific data source.
> >
> >
> > Best,
> > Qian
> > On Aug 8, 2019, 3:20 PM -0700, Rajiv Vipani <Rajiv.Vipani@albertsons.com
> >,
> > wrote:
> > > Can Griffin connect to a source and target that is non-hive tables. Is
> > there a sample one can share.
> > >
> > > Many thanks.
> > >
> > > Rajiv
> > > ________________________________
> > > Warning: All e-mail sent to this address will be received by the
> > corporate e-mail system, and is subject to archival and review by someone
> > other than the recipient. This e-mail may contain proprietary information
> > and is intended only for the use of the intended recipient(s). If the
> > reader of this message is not the intended recipient(s), you are notified
> > that you have received this message in error and that any review,
> > dissemination, distribution or copying of this message is strictly
> > prohibited. If you have received this message in error, please notify the
> > sender immediately.
> > > ________________________________
> >
>

Re: Apache Griffin connection to back end

Posted by Nick Sokolov <ch...@gmail.com>.

There is support for data source plugins. You can implement one and supply
as extra jar in Livy config - you just need to implement interface and
return dataframe create in plugin.

On Thu, Aug 8, 2019, 15:24 Qian Wang <qw...@gmail.com> wrote:

> Hi Rajiv,
>
> What kind of data source do you want to use? You can implement the
> interface HiveMetaStoreService for your specific data source.
>
>
> Best,
> Qian
> On Aug 8, 2019, 3:20 PM -0700, Rajiv Vipani <Ra...@albertsons.com>,
> wrote:
> > Can Griffin connect to a source and target that is non-hive tables. Is
> there a sample one can share.
> >
> > Many thanks.
> >
> > Rajiv
> > ________________________________
> > Warning: All e-mail sent to this address will be received by the
> corporate e-mail system, and is subject to archival and review by someone
> other than the recipient. This e-mail may contain proprietary information
> and is intended only for the use of the intended recipient(s). If the
> reader of this message is not the intended recipient(s), you are notified
> that you have received this message in error and that any review,
> dissemination, distribution or copying of this message is strictly
> prohibited. If you have received this message in error, please notify the
> sender immediately.
> > ________________________________
>

Re: Apache Griffin connection to back end

Posted by Qian Wang <qw...@gmail.com>.

Hi Rajiv,

What kind of data source do you want to use? You can implement the interface HiveMetaStoreService for your specific data source.


Best,
Qian
On Aug 8, 2019, 3:20 PM -0700, Rajiv Vipani <Ra...@albertsons.com>, wrote:
> Can Griffin connect to a source and target that is non-hive tables. Is there a sample one can share.
>
> Many thanks.
>
> Rajiv
> ________________________________
> Warning: All e-mail sent to this address will be received by the corporate e-mail system, and is subject to archival and review by someone other than the recipient. This e-mail may contain proprietary information and is intended only for the use of the intended recipient(s). If the reader of this message is not the intended recipient(s), you are notified that you have received this message in error and that any review, dissemination, distribution or copying of this message is strictly prohibited. If you have received this message in error, please notify the sender immediately.
> ________________________________