You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@beam.apache.org by Tomas Satka <sa...@gmail.com> on 2021/08/06 11:54:31 UTC

apache beam to apache atlas connector

Hi Team

Is there any data connector that can send metadata from beam to apache
atlas?
As of today we intend to use apache spark and send metadata to apache atlas
by hortonworks connector (
https://github.com/hortonworks-spark/spark-atlas-connector).

Is there an alternative once we switch spark to beam to the above mentioned
connector?

Thanks & Regards
Tomas

Re: apache beam to apache atlas connector

Posted by Luke Cwik <lc...@google.com>.

I'm not aware of an existing one.

You could try to author one and contribute it to the community.

On Sat, Aug 7, 2021 at 4:05 PM Tomas Satka <sa...@gmail.com> wrote:

> Hi Team
>
> Is there any data connector that can send metadata from beam to apache
> atlas?
> As of today we intend to use apache spark and send metadata to apache
> atlas by hortonworks connector (
> https://github.com/hortonworks-spark/spark-atlas-connector).
>
> Is there an alternative once we switch spark to beam to the above
> mentioned connector?
>
> Thanks & Regards
> Tomas
>

Re: apache beam to apache atlas connector

Posted by Luke Cwik <lc...@google.com>.

I'm not aware of an existing one.

You could try to author one and contribute it to the community.

On Sat, Aug 7, 2021 at 4:05 PM Tomas Satka <sa...@gmail.com> wrote:

> Hi Team
>
> Is there any data connector that can send metadata from beam to apache
> atlas?
> As of today we intend to use apache spark and send metadata to apache
> atlas by hortonworks connector (
> https://github.com/hortonworks-spark/spark-atlas-connector).
>
> Is there an alternative once we switch spark to beam to the above
> mentioned connector?
>
> Thanks & Regards
> Tomas
>