[jira] [Commented] (FALCON-1627) Provider integration with Azure Data Factory pipelines

["Venkat Ranganathan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FALCON-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15117858#comment-15117858 ] 

Venkat Ranganathan commented on FALCON-1627:
--------------------------------------------

The current implementation has a limitation that we create an entity with one instance for each ADF pipeline instance.   There will be enhancements done to ADF to update the protocol to support Falcon entities to be associated with ADF pipeline.  

> Provider integration with Azure Data Factory pipelines
> ------------------------------------------------------
>
>                 Key: FALCON-1627
>                 URL: https://issues.apache.org/jira/browse/FALCON-1627
>             Project: Falcon
>          Issue Type: New Feature
>    Affects Versions: 0.8
>            Reporter: Venkat Ranganathan
>            Assignee: Ying Zheng
>             Fix For: trunk
>
>         Attachments: ADF JSON Message Definition.pdf, ADFTutorial.pdf, FALCON-1627.patch
>
>
> Micrsosoft Azure Data Factory is Data processing service available on Microsoft Azure environment which allows users to  compose, orchestrate and manage  data pipelines somewhat similar to Falcon on the azure environment.   
> The integration will allow ADF to invoke a Falcon activity (replication, hive or pig proessing work) from the Azure Data Factory data pipeline so that Azure cloud and Hadoop onprem processing can be realized.
> The integration work has a few steps and will also be enhanced when ADF V3 protocol is introduced



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)