You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "roxia (JIRA)" <ji...@apache.org> on 2017/02/16 03:07:41 UTC
[jira] [Created] (ATLAS-1560) import hive metadata into atlas
roxia created ATLAS-1560:
----------------------------
Summary: import hive metadata into atlas
Key: ATLAS-1560
URL: https://issues.apache.org/jira/browse/ATLAS-1560
Project: Atlas
Issue Type: Bug
Components: atlas-core
Affects Versions: 0.7.1-incubating
Reporter: roxia
Fix For: 0.7.1-incubating
My operations
1 I create hive db and hive_table
2 I exec the <atlas package>/bin/import-hive.sh
Result:
1 the hive db "default" can import into Atlas.
2 the hive db "default"`table can not import into Atlas
3 the other db can`t import into Atlas.
the databases:
+----------------+--+
| database_name |
+----------------+--+
| default |
| sap |
+----------------+--+
the default`table :
+-----------+--+
| tab_name |
+-----------+--+
| employee |
| test |
+-----------+--+
the table employee`description:
+-----------+------------+----------+--+
| col_name | data_type | comment |
+-----------+------------+----------+--+
| id | bigint | |
| name | string | |
| age | int | |
| city | string | |
+-----------+------------+----------+--+
the import-hive.sh`log:
2017-02-16 02:49:06,899 DEBUG - [main:] ~ Updating entity id d79122c6-8547-4687-9bf1-0140ea59662c with {
"jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Reference",
"id":{
"jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Id",
"id":"d79122c6-8547-4687-9bf1-0140ea59662c",
"version":0,
"typeName":"hive_db",
"state":"ACTIVE"
},
"typeName":"hive_db",
"values":{
"name":"default",
"location":"hdfs://ocp-s17:8020/user/hive/warehouse",
"description":"Default Hive database",
"ownerType":2,
"qualifiedName":"default@primary",
"owner":"public",
"clusterName":"primary",
"parameters":{
}
},
"traitNames":[
],
"traits":{
}
} (AtlasClient:812)
2017-02-16 02:49:06,899 DEBUG - [main:] ~ Using resource http://localhost:21000/api/atlas/entities/d79122c6-8547-4687-9bf1-0140ea59662c for 0 times (AtlasClient:789)
2017-02-16 02:49:08,866 DEBUG - [main:] ~ API http://localhost:21000/api/atlas/entities/d79122c6-8547-4687-9bf1-0140ea59662c returned status 200 (AtlasClient:1230)
2017-02-16 02:49:09,051 INFO - [main:] ~ Importing tables [] for db default (HiveMetaStoreBridge:254)
2017-02-16 02:49:09,051 INFO - [main:] ~ Successfully imported all 0 tables from default (HiveMetaStoreBridge:261)
Hive Data Model imported successfully!!!
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)