You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@atlas.apache.org by ni...@apache.org on 2020/03/17 15:32:27 UTC
[atlas] branch branch-2.0 updated: ATLAS-3646 Create new
'spark_ml_model_dataset',
'spark_ml_pipeline_dataset' relationship defs (#89)
This is an automated email from the ASF dual-hosted git repository.
nixon pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/atlas.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new e512108 ATLAS-3646 Create new 'spark_ml_model_dataset','spark_ml_pipeline_dataset' relationship defs (#89)
e512108 is described below
commit e512108e5fc82f89f54b31e6e13a1aa0572ee547
Author: Vlad Glinsky <61...@users.noreply.github.com>
AuthorDate: Tue Mar 17 17:22:42 2020 +0200
ATLAS-3646 Create new 'spark_ml_model_dataset','spark_ml_pipeline_dataset' relationship defs (#89)
Change-Id: I429d7db085c26f90264c54f4b92b207b186bbd17
(cherry picked from commit 97ecfc7eb2b78d19fc125076e1e3961be230f83f)
---
addons/models/1000-Hadoop/1100-spark_model.json | 35 ++++++++++++++++++++++++-
1 file changed, 34 insertions(+), 1 deletion(-)
diff --git a/addons/models/1000-Hadoop/1100-spark_model.json b/addons/models/1000-Hadoop/1100-spark_model.json
index 054239b..e630958 100644
--- a/addons/models/1000-Hadoop/1100-spark_model.json
+++ b/addons/models/1000-Hadoop/1100-spark_model.json
@@ -523,7 +523,6 @@
"name": "columnLineages",
"isContainer": true,
"cardinality": "SET"
-
},
"propagateTags": "NONE"
},
@@ -544,6 +543,40 @@
"cardinality": "SINGLE"
},
"propagateTags": "NONE"
+ },
+ {
+ "name": "spark_ml_model_dataset",
+ "serviceType": "spark",
+ "typeVersion": "1.0",
+ "relationshipCategory": "ASSOCIATION",
+ "endDef1": {
+ "type": "spark_ml_model",
+ "name": "dataset",
+ "cardinality": "SINGLE"
+ },
+ "endDef2": {
+ "type": "DataSet",
+ "name": "model",
+ "cardinality": "SINGLE"
+ },
+ "propagateTags": "NONE"
+ },
+ {
+ "name": "spark_ml_pipeline_dataset",
+ "serviceType": "spark",
+ "typeVersion": "1.0",
+ "relationshipCategory": "ASSOCIATION",
+ "endDef1": {
+ "type": "spark_ml_pipeline",
+ "name": "dataset",
+ "cardinality": "SINGLE"
+ },
+ "endDef2": {
+ "type": "DataSet",
+ "name": "pipeline",
+ "cardinality": "SINGLE"
+ },
+ "propagateTags": "NONE"
}
]
}