You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Fiona Zhao (JIRA)" <ji...@apache.org> on 2019/06/14 15:14:00 UTC

[jira] [Commented] (AIRFLOW-3486) cannot load lineage backend atlas following the instructions in lineage.rst

    [ https://issues.apache.org/jira/browse/AIRFLOW-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864174#comment-16864174 ] 

Fiona Zhao commented on AIRFLOW-3486:
-------------------------------------

Very helpful [~nbateshaus]!   Does lineage work for 1.10.0?  Really hope this can be resolved soon, we need it!

In the interim, is there any other workaround to ingest lineage from Airflow to Atlas "manually"?

> cannot load lineage backend atlas following the instructions in lineage.rst
> ---------------------------------------------------------------------------
>
>                 Key: AIRFLOW-3486
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3486
>             Project: Apache Airflow
>          Issue Type: Bug
>    Affects Versions: 1.10.1
>            Reporter: Nik Bates-Haus
>            Priority: Major
>         Attachments: lineage-backend-atlas.patch
>
>
> lineage.rst says to configure lineage as:
> {code:java}
> [lineage]
> backend = airflow.lineage.backend.atlas
> [atlas]
> username = my_username
> password = my_password
> host = host
> port = 21000
> {code}
> but this fails, because {{airflow.lineage.backend.atlas}} is a module, not a class, and therefore cannot be loaded by {{import_string}}.
> Specifying  {{airflow.lineage.backend.atlas.AtlasBackend}} instead loads the backend, but is unable to send to it because it tries to use the class, rather than an instance of the class, as the backend.
> I have a fix in the attached patch, including:
>  * Documentation fix
>  * Fix for {{_get_backend()}}
>  * Test to ensure that the backend can be loaded and used



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)