You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "roxia (JIRA)" <ji...@apache.org> on 2017/02/16 03:07:41 UTC

[jira] [Created] (ATLAS-1560) import hive metadata into atlas

roxia created ATLAS-1560:
----------------------------

             Summary: import hive metadata into atlas
                 Key: ATLAS-1560
                 URL: https://issues.apache.org/jira/browse/ATLAS-1560
             Project: Atlas
          Issue Type: Bug
          Components:  atlas-core
    Affects Versions: 0.7.1-incubating
            Reporter: roxia
             Fix For: 0.7.1-incubating


My operations
1 I create hive db and hive_table
2 I exec the <atlas package>/bin/import-hive.sh

Result:
1 the hive db "default" can import into Atlas.
2 the hive db "default"`table can not  import into Atlas
3 the other db can`t import into Atlas.

the databases:
+----------------+--+
| database_name  |
+----------------+--+
| default        |
| sap            |
+----------------+--+

the default`table :
+-----------+--+
| tab_name  |
+-----------+--+
| employee  |
| test      |
+-----------+--+

the table employee`description:
+-----------+------------+----------+--+
| col_name  | data_type  | comment  |
+-----------+------------+----------+--+
| id        | bigint     |          |
| name      | string     |          |
| age       | int        |          |
| city      | string     |          |
+-----------+------------+----------+--+

the import-hive.sh`log:

2017-02-16 02:49:06,899 DEBUG - [main:] ~ Updating entity id d79122c6-8547-4687-9bf1-0140ea59662c with {
  "jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Reference",
  "id":{
    "jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Id",
    "id":"d79122c6-8547-4687-9bf1-0140ea59662c",
    "version":0,
    "typeName":"hive_db",
    "state":"ACTIVE"
  },
  "typeName":"hive_db",
  "values":{
    "name":"default",
    "location":"hdfs://ocp-s17:8020/user/hive/warehouse",
    "description":"Default Hive database",
    "ownerType":2,
    "qualifiedName":"default@primary",
    "owner":"public",
    "clusterName":"primary",
    "parameters":{

    }
  },
  "traitNames":[

  ],
  "traits":{

  }
} (AtlasClient:812)
2017-02-16 02:49:06,899 DEBUG - [main:] ~ Using resource http://localhost:21000/api/atlas/entities/d79122c6-8547-4687-9bf1-0140ea59662c for 0 times (AtlasClient:789)
2017-02-16 02:49:08,866 DEBUG - [main:] ~ API http://localhost:21000/api/atlas/entities/d79122c6-8547-4687-9bf1-0140ea59662c returned status 200 (AtlasClient:1230)
2017-02-16 02:49:09,051 INFO  - [main:] ~ Importing tables [] for db default (HiveMetaStoreBridge:254)
2017-02-16 02:49:09,051 INFO  - [main:] ~ Successfully imported all 0 tables from default  (HiveMetaStoreBridge:261)
Hive Data Model imported successfully!!!






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)