You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by Sidharth Mishra <si...@gmail.com> on 2021/12/15 23:27:37 UTC

Review Request 73762: ATLAS-4508: Though a particular tag is blocked propagation , tag is still propagated

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73762/
-----------------------------------------------------------

Review request for atlas, Ashutosh Mestry, Disha Talreja, Jayendra Parab, Radhika Kundam, and Sarath Subramanian.


Bugs: ATLAS-4508
    https://issues.apache.org/jira/browse/ATLAS-4508


Repository: atlas


Description
-------

ATLAS-4508: Made the deferred classification tasks sequential


Diffs
-----

  repository/src/main/java/org/apache/atlas/tasks/TaskManagement.java 9a519bacc 


Diff: https://reviews.apache.org/r/73762/diff/1/


Testing
-------

Manually Tested:
2021-12-14 23:14:08,187 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
2021-12-14 23:14:08,188 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
2021-12-14 23:14:08,189 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ TaskManagement: Processing stats: total=4, sinceLastStatsReport=2 completedWithErrors=0, succeded=4 (TaskExecutor$TaskLogger:166)
-2021-12-14 23:14:08,366 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
2021-12-14 23:14:08,367 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,\"updateTime\":1638232823426,\"version\
 ":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},
 {\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityGui
 d\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl4\",\"entity
 Guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c
 2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,133 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)

....
....
....


2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
2021-12-14 23:15:04,656 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ TaskManagement: Processing stats: total=5, sinceLastStatsReport=2 completedWithErrors=0, succeded=5 (TaskExecutor$TaskLogger:166)
2021-12-14 23:15:04,773 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"endTime":1639523704654,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
2021-12-14 23:15:18,184 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"endTime":1639523718063,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,\"
 updateTime\":1638232823426,\"version\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"remov
 ePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":fal
 se},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":
 false},{\"typeName\":\"cl4\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"enti
 tyGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)


Thanks,

Sidharth Mishra

Re: Review Request 73762: ATLAS-4508: Though a particular tag is blocked propagation , tag is still propagated

Posted by Sarath Subramanian <sa...@apache.org>.

> On Dec. 15, 2021, 9:43 p.m., Sarath Subramanian wrote:
> > Ship It!

can you add precommit link?


- Sarath


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73762/#review223864
-----------------------------------------------------------


On Dec. 15, 2021, 3:27 p.m., Sidharth Mishra wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73762/
> -----------------------------------------------------------
> 
> (Updated Dec. 15, 2021, 3:27 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Disha Talreja, Jayendra Parab, Radhika Kundam, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4508
>     https://issues.apache.org/jira/browse/ATLAS-4508
> 
> 
> Repository: atlas
> 
> 
> Description
> -------
> 
> ATLAS-4508: Made the deferred classification tasks sequential
> 
> 
> Diffs
> -----
> 
>   repository/src/main/java/org/apache/atlas/tasks/TaskManagement.java 9a519bacc 
> 
> 
> Diff: https://reviews.apache.org/r/73762/diff/1/
> 
> 
> Testing
> -------
> 
> Manually Tested:
> 2021-12-14 23:14:08,187 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,188 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:14:08,189 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ TaskManagement: Processing stats: total=4, sinceLastStatsReport=2 completedWithErrors=0, succeded=4 (TaskExecutor$TaskLogger:166)
> -2021-12-14 23:14:08,366 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,367 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,\"updateTime\":1638232823426,\"versio
 n\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false
 },{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityG
 uid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl4\",\"enti
 tyGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-
 7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,133 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 
> ....
> ....
> ....
> 
> 
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:04,656 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ TaskManagement: Processing stats: total=5, sinceLastStatsReport=2 completedWithErrors=0, succeded=5 (TaskExecutor$TaskLogger:166)
> 2021-12-14 23:15:04,773 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"endTime":1639523704654,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:18,184 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"endTime":1639523718063,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,
 \"updateTime\":1638232823426,\"version\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"rem
 ovePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":f
 alse},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\
 ":false},{\"typeName\":\"cl4\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"en
 tityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 73762: ATLAS-4508: Though a particular tag is blocked propagation , tag is still propagated

Posted by Sidharth Mishra <si...@gmail.com>.

> On Dec. 16, 2021, 5:43 a.m., Sarath Subramanian wrote:
> > Ship It!
> 
> Sarath Subramanian wrote:
>     can you add precommit link?

https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/1006/ The failure is only at Atlas Falcon Bridge which is not related. Still I started another run - https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/1007/


- Sidharth


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73762/#review223864
-----------------------------------------------------------


On Dec. 15, 2021, 11:27 p.m., Sidharth Mishra wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73762/
> -----------------------------------------------------------
> 
> (Updated Dec. 15, 2021, 11:27 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Disha Talreja, Jayendra Parab, Radhika Kundam, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4508
>     https://issues.apache.org/jira/browse/ATLAS-4508
> 
> 
> Repository: atlas
> 
> 
> Description
> -------
> 
> ATLAS-4508: Made the deferred classification tasks sequential
> 
> 
> Diffs
> -----
> 
>   repository/src/main/java/org/apache/atlas/tasks/TaskManagement.java 9a519bacc 
> 
> 
> Diff: https://reviews.apache.org/r/73762/diff/1/
> 
> 
> Testing
> -------
> 
> Manually Tested:
> 2021-12-14 23:14:08,187 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,188 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:14:08,189 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ TaskManagement: Processing stats: total=4, sinceLastStatsReport=2 completedWithErrors=0, succeded=4 (TaskExecutor$TaskLogger:166)
> -2021-12-14 23:14:08,366 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,367 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,\"updateTime\":1638232823426,\"versio
 n\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false
 },{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityG
 uid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl4\",\"enti
 tyGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-
 7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,133 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 
> ....
> ....
> ....
> 
> 
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:04,656 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ TaskManagement: Processing stats: total=5, sinceLastStatsReport=2 completedWithErrors=0, succeded=5 (TaskExecutor$TaskLogger:166)
> 2021-12-14 23:15:04,773 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"endTime":1639523704654,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:18,184 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"endTime":1639523718063,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,
 \"updateTime\":1638232823426,\"version\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"rem
 ovePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":f
 alse},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\
 ":false},{\"typeName\":\"cl4\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"en
 tityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 73762: ATLAS-4508: Though a particular tag is blocked propagation , tag is still propagated

Posted by Sarath Subramanian <sa...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73762/#review223864
-----------------------------------------------------------


Ship it!




Ship It!

- Sarath Subramanian


On Dec. 15, 2021, 3:27 p.m., Sidharth Mishra wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73762/
> -----------------------------------------------------------
> 
> (Updated Dec. 15, 2021, 3:27 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Disha Talreja, Jayendra Parab, Radhika Kundam, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4508
>     https://issues.apache.org/jira/browse/ATLAS-4508
> 
> 
> Repository: atlas
> 
> 
> Description
> -------
> 
> ATLAS-4508: Made the deferred classification tasks sequential
> 
> 
> Diffs
> -----
> 
>   repository/src/main/java/org/apache/atlas/tasks/TaskManagement.java 9a519bacc 
> 
> 
> Diff: https://reviews.apache.org/r/73762/diff/1/
> 
> 
> Testing
> -------
> 
> Manually Tested:
> 2021-12-14 23:14:08,187 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,188 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:14:08,189 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ TaskManagement: Processing stats: total=4, sinceLastStatsReport=2 completedWithErrors=0, succeded=4 (TaskExecutor$TaskLogger:166)
> -2021-12-14 23:14:08,366 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,367 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,\"updateTime\":1638232823426,\"versio
 n\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false
 },{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityG
 uid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl4\",\"enti
 tyGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-
 7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,133 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 
> ....
> ....
> ....
> 
> 
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:04,656 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ TaskManagement: Processing stats: total=5, sinceLastStatsReport=2 completedWithErrors=0, succeded=5 (TaskExecutor$TaskLogger:166)
> 2021-12-14 23:15:04,773 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"endTime":1639523704654,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:18,184 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"endTime":1639523718063,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,
 \"updateTime\":1638232823426,\"version\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"rem
 ovePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":f
 alse},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\
 ":false},{\"typeName\":\"cl4\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"en
 tityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>

Re: Review Request 73762: ATLAS-4508: Though a particular tag is blocked propagation , tag is still propagated

Posted by Sarath Subramanian <sa...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73762/#review223877
-----------------------------------------------------------


Ship it!




Ship It!

- Sarath Subramanian


On Dec. 15, 2021, 3:27 p.m., Sidharth Mishra wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73762/
> -----------------------------------------------------------
> 
> (Updated Dec. 15, 2021, 3:27 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Disha Talreja, Jayendra Parab, Radhika Kundam, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-4508
>     https://issues.apache.org/jira/browse/ATLAS-4508
> 
> 
> Repository: atlas
> 
> 
> Description
> -------
> 
> ATLAS-4508: Made the deferred classification tasks sequential
> 
> 
> Diffs
> -----
> 
>   repository/src/main/java/org/apache/atlas/tasks/TaskManagement.java 9a519bacc 
> 
> 
> Diff: https://reviews.apache.org/r/73762/diff/1/
> 
> 
> Testing
> -------
> 
> Manually Tested:
> 2021-12-14 23:14:08,187 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,188 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:14:08,189 INFO  - [etp299413131-209 - 7c3d769f-ebca-46c0-aa5b-93b0edb93b22:] ~ TaskManagement: Processing stats: total=4, sinceLastStatsReport=2 completedWithErrors=0, succeded=4 (TaskExecutor$TaskLogger:166)
> -2021-12-14 23:14:08,366 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ Dispatching the number of tasks: 1 (TaskManagement:178)
> 2021-12-14 23:14:08,367 INFO  - [etp299413131-145 - 14af9f29-3cea-4022-a00e-04566a95bc5a:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,\"updateTime\":1638232823426,\"versio
 n\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false
 },{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityG
 uid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl4\",\"enti
 tyGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-
 7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"PENDING"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,132 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,133 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 
> ....
> ....
> ....
> 
> 
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:02,410 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ updateClassificationText: cl1: cl6 class1 cl8 cl12 cl4 cl3 cl7 cl13 cl13 cl2 cl9 cl10 cl11  (EntityGraphMapper:2769)
> 2021-12-14 23:15:04,656 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ TaskManagement: Processing stats: total=5, sinceLastStatsReport=2 completedWithErrors=0, succeded=5 (TaskExecutor$TaskLogger:166)
> 2021-12-14 23:15:04,773 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_ADD","guid":"9dd556a3-9b33-4ed9-83d6-dd8c8ae2a0c3","createdBy":"admin","createdTime":1639523648041,"updatedTime":1639523648041,"endTime":1639523704654,"parameters":{"relationshipGuid":null,"entityGuid":"93ef7590-e438-4b26-8eb1-7c2a9840584c","classificationVertexId":"163848304"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 2021-12-14 23:15:18,184 INFO  - [atlas-task-0-etp299413131-169 - 628d0e63-7058-49ae-807e-4fc93d9eebc5:] ~ {"type":"CLASSIFICATION_PROPAGATION_RELATIONSHIP_UPDATE","guid":"ff13ed40-5c5e-419a-bb37-01a8831fcaaa","createdBy":"admin","createdTime":1639523648240,"updatedTime":1639523648240,"endTime":1639523718063,"parameters":{"relationshipEdgeId":"a2p78-38i3k-4e1h-vqo","relationshipObject":"{\"typeName\":\"dataset_process_inputs\",\"guid\":\"e8d10244-7daa-4963-afaf-5774d8128276\",\"provenanceType\":0,\"end1\":{\"guid\":\"ac247f21-d9cd-4632-8934-59412615f175\",\"typeName\":\"hive_process\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.tbl_590@manulife:1585415411000\"}},\"end2\":{\"guid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"typeName\":\"hive_table\",\"uniqueAttributes\":{\"qualifiedName\":\"dbbb.table_templ@manulife\"}},\"label\":\"__Process.inputs\",\"propagateTags\":\"TWO_TO_ONE\",\"status\":\"ACTIVE\",\"createdBy\":\"admin\",\"updatedBy\":\"admin\",\"createTime\":1638232823426,
 \"updateTime\":1638232823426,\"version\":0,\"propagatedClassifications\":[{\"typeName\":\"cl10\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"rem
 ovePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl9\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"class1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":f
 alse},{\"typeName\":\"cl7\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}],\"blockedPropagatedClassifications\":[{\"typeName\":\"cl6\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl3\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl13\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl8\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\
 ":false},{\"typeName\":\"cl4\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl1\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl2\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl11\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl12\",\"entityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false},{\"typeName\":\"cl7\",\"en
 tityGuid\":\"93ef7590-e438-4b26-8eb1-7c2a9840584c\",\"entityStatus\":\"ACTIVE\",\"propagate\":true,\"validityPeriods\":[],\"removePropagationsOnEntityDelete\":false}]}"},"attemptCount":0,"status":"COMPLETE"} (TaskExecutor$TaskLogger:170)
> 
> 
> Thanks,
> 
> Sidharth Mishra
> 
>