You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Hang Ruan (Jira)" <ji...@apache.org> on 2021/12/13 02:58:00 UTC

[jira] [Commented] (ATLAS-3812) Add schema for Apache Flink

    [ https://issues.apache.org/jira/browse/ATLAS-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458133#comment-17458133 ] 

Hang Ruan commented on ATLAS-3812:
----------------------------------

Hi, Community,
 
I recently read the flink application model in this request ([https://reviews.apache.org/r/73317/]). I do not understand why we should split the flink application into two entities: flink_application and flink_process. 
 
I want to know what concepts in flink these entities correspond to separately.

> Add schema for Apache Flink
> ---------------------------
>
>                 Key: ATLAS-3812
>                 URL: https://issues.apache.org/jira/browse/ATLAS-3812
>             Project: Atlas
>          Issue Type: New Feature
>          Components: atlas-intg
>            Reporter: Márton Balassi
>            Priority: Major
>
> Hi Apache Atlas team,
> I am an Apache Flink PMC member pursuing to add a Flink bridge to Atlas. As a first step of this I would like to contribute the following schema, ideally to the upcoming 2.1 release.
> {code}
> {
>     "enumDefs": [],
>     "structDefs": [],
>     "classificationDefs": [],
>     "entityDefs": [
>         {
>             "name": "flink_application",
>             "superTypes": [
>                 "Process"
>             ],
>             "serviceType": "flink",
>             "typeVersion": "1.0",
>             "attributeDefs": [
>                 {
>                     "name": "id",
>                     "typeName": "string",
>                     "cardinality": "SINGLE",
>                     "isIndexable": true,
>                     "isOptional": false,
>                     "isUnique": true
>                 },
>                 {
>                     "name": "startTime",
>                     "typeName": "date",
>                     "cardinality": "SINGLE",
>                     "isIndexable": false,
>                     "isOptional": true,
>                     "isUnique": false
>                 },
>                 {
>                     "name": "endTime",
>                     "typeName": "date",
>                     "cardinality": "SINGLE",
>                     "isIndexable": false,
>                     "isOptional": true,
>                     "isUnique": false
>                 },
>                 {
>                     "name": "conf",
>                     "typeName": "map<string,string>",
>                     "cardinality": "SINGLE",
>                     "isIndexable": false,
>                     "isOptional": true,
>                     "isUnique": false
>                 },
>                 {
>                     "name": "inputs",
>                     "typeName": "array<string>",
>                     "cardinality": "LIST",
>                     "isIndexable": false,
>                     "isOptional": false,
>                     "isUnique": false
>                 },
>                 {
>                     "name": "outputs",
>                     "typeName": "array<string>",
>                     "cardinality": "LIST",
>                     "isIndexable": false,
>                     "isOptional": false,
>                     "isUnique": false
>                 }
>             ]
>         }
>     ],
>     "relationshipDefs": []
> }
> {code}
> Also please add an icon based on the white outline from the Flink material page similarly to the existing Kafka icon.
> https://flink.apache.org/material.html



--
This message was sent by Atlassian Jira
(v8.20.1#820001)