[jira] [Created] (ATLAS-4460) Search API gets deleted partitionKeys of Hive table

["Solbi Choi (Jira)" <ji...@apache.org>]

Solbi Choi created ATLAS-4460:
---------------------------------

             Summary: Search API gets deleted partitionKeys of Hive table
                 Key: ATLAS-4460
                 URL: https://issues.apache.org/jira/browse/ATLAS-4460
             Project: Atlas
          Issue Type: Bug
          Components: hive-integration
    Affects Versions: 2.2.0
            Reporter: Solbi Choi
         Attachments: 스크린샷 2021-10-22 오후 5.07.47.png

Problems


When one of the partitionKeys in hive table deleted, atlas search API still gets all partitionKeys including deleted one. Adding `"excludeDeletedEntities": True` in request json doesn't work in this situation.

 

Reproduce
 * Create hive table with partition key and sync it using hive-import.
 * Delete the hive table and re-create hive table with same name but without partition key this time.
 * Then you can the partitionKey deleted in the Atlas web view.
 * But when trying search API to get the hive table entity using
 ** request = {
 "typeName": "hive_table",
 "attributes": [
 "db",
 "name",
 "partitionKeys"
 ],
 "entityFilters": {
 "criterion": [
 {
 "attributeName": "owner",
 "operator": "eq",
 "attributeValue": owner
 }
 ]
 },
 "excludeDeletedEntities": True,
 "limit": limit,
 "offset": offset
}
 * You get the deleted partitionKey also.
 ** 'partitionKeys': [\{'guid': '****', 'typeName': 'hive_column', 'uniqueAttributes': {'qualifiedName': 'foo.test_partition_drop.ds@primary'}}, \{'guid': '****', 'typeName': 'hive_column', 'uniqueAttributes': {'qualifiedName': 'foo.test_partition_drop.ts@primary'}}]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)