You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Radhika Kundam (Jira)" <ji...@apache.org> on 2021/07/27 18:56:00 UTC
[jira] [Comment Edited] (ATLAS-4324) FS entity created for load
data inpath is created as shell entity
[ https://issues.apache.org/jira/browse/ATLAS-4324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17356588#comment-17356588 ]
Radhika Kundam edited comment on ATLAS-4324 at 7/27/21, 6:55 PM:
-----------------------------------------------------------------
With this patch we are including Path entities to be retained at HS2 ActiveEntityfilter. And also provided configuration option at Hive Hook to add any entity types (comma separated)to be retained.
config property is : *atlas.hook.hive.hs2.filter.entity.additional.types.to.retain**=<entityType1>,<entityType2>*
was (Author: radhikak):
With this patch we are including Path entities to be retained at HS2 ActiveEntityfilter. And also provided configuration option at Hive Hook to add any entity types (comma separated)to be retained.
config property is : *atlas.hook.hive.hs2.filter.entity.types.to.retain=<entityType1>,<entityType2>*
> FS entity created for load data inpath is created as shell entity
> -----------------------------------------------------------------
>
> Key: ATLAS-4324
> URL: https://issues.apache.org/jira/browse/ATLAS-4324
> Project: Atlas
> Issue Type: Bug
> Components: hive-integration
> Affects Versions: 2.1.0
> Reporter: Radhika Kundam
> Assignee: Radhika Kundam
> Priority: Major
> Labels: hive-hooks
> Fix For: 3.0.0, 2.2.0
>
> Attachments: load_data_shell_entity.png
>
>
> beeline >
> create external table default.hive_table_cloud_load_data_in_path_123 (student_roll int, student_name string, student_dob date) ROW FORMAT DELIMITED FIELDS TERMINATED BY ' ' STORED AS TEXTFILE location 'hdfs://ns1/tmp/hive_table_cloud_load_data_in_path_123'
>
> load data inpath 'hdfs://ns1/tmp/data123.txt' into table hive_table_cloud_load_data_in_path_123;
>
> Creates 'hdfs://ns1/tmp/data123.txt' as shell entity.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)