You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Nixon Rodrigues (JIRA)" <ji...@apache.org> on 2018/04/02 09:59:00 UTC
[jira] [Commented] (ATLAS-2525) Atlas Hbase/Hive hook improvement
to provide import from file
[ https://issues.apache.org/jira/browse/ATLAS-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16422081#comment-16422081 ]
Nixon Rodrigues commented on ATLAS-2525:
----------------------------------------
[~rmani] , Can you review this line in [^0001-ATLAS-2525-Atlas-Hbase-Hive-hook-improvement-to-prov.patch]
HiveMetaStoreBridge.java
{noformat}
String databaseToImport = cmd.getOptionValue("d");
String tableToImport = cmd.getOptionValue("t");
+ String fileToImport = cmd.getOptionValue("t");
{noformat}
> Atlas Hbase/Hive hook improvement to provide import from file
> -------------------------------------------------------------
>
> Key: ATLAS-2525
> URL: https://issues.apache.org/jira/browse/ATLAS-2525
> Project: Atlas
> Issue Type: Bug
> Affects Versions: trunk, 0.8.2
> Reporter: Ramesh Mani
> Assignee: Ramesh Mani
> Priority: Major
> Fix For: trunk, 0.8.2
>
> Attachments: 0001-ATLAS-2525-Atlas-Hbase-Hive-hook-improvement-to-prov.patch
>
>
> Atlas Hbase/Hive hook improvement to provide import from file
> Hook script should have another option -f to accept a file which contains the database/table in hive or namespace/table in hbase and import it into Atlas
> Format can be JSON or CSV.
> HIVE CASE:
> import-hive.sh -f <filename>: This can be JSON or CSV file
> {code:java}
> import-hive.sh -f <filename>: This can be JSON or CSV file
> Imports all databases and tables in the file...
> cvs format:
> database1,tbl1,tbl2,tbl3,..
> database2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "database1" :["tbl1","tbl2","tbl3",..]
> "database2" :["tbl1","tbl2","tbl3",..]
> }{code}
> JSON format:
> { "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2" :["tbl1","tbl2","tbl3",..] }
> HBASE CASE:
> {code:java}
> import-hbase.sh [-t <filename>] : This can be JSON or CSV file
> cvs format:
> namespace1,tbl1,tbl2,tbl3,..
> namespace2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "namespace1" :["tbl1","tbl2","tbl3",..]
> "namespace2" :["tbl1","tbl2","tbl3",..]
> }
> {code:java}
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)