You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Ramesh Mani (JIRA)" <ji...@apache.org> on 2018/03/30 01:26:00 UTC
[jira] [Updated] (ATLAS-2525) Atlas Hbase/Hive hook improvement to
provide import from file
[ https://issues.apache.org/jira/browse/ATLAS-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ramesh Mani updated ATLAS-2525:
-------------------------------
Description:
Atlas Hbase/Hive hook improvement to provide import from file
Hook script should have another option -f to accept a file which contains the database/table in hive or namespace/table in hbase and import it into Atlas
Format can be JSON or CSV.
HIVE CASE:
import-hive.sh -f <filename>: This can be JSON or CSV file Imports all databases and tables in the file... cvs format: namespace1,tbl1,tbl2,tbl3,.. namespace2,tbl1,tbl2,tbl3,..
{code:java}
{code:java}
import-hive.sh -f <filename>: This can be JSON or CSV file
Imports all databases and tables in the file...
cvs format:
database1,tbl1,tbl2,tbl3,..
database2,tbl1,tbl2,tbl3,..
JSON format:
{
"database1" :["tbl1","tbl2","tbl3",..]
"database2" :["tbl1","tbl2","tbl3",..]
}{code}
JSON format:
{ "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2" :["tbl1","tbl2","tbl3",..] }
HBASE CASE:
{code:java}
import-hbase.sh [-t <filename>] : This can be JSON or CSV file
cvs format:
namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
JSON format:
{
"namespace1" :["tbl1","tbl2","tbl3",..]
"namespace2" :["tbl1","tbl2","tbl3",..]
}
{code:java}
{code}
was:
Atlas Hbase/Hive hook improvement to provide import from file
Hook script should have another option -f to accept a file which contains the database/table in hive or namespace/table in hbase and import it into Atlas
Format can be JSON or CSV.
HIVE CASE:
import-hive.sh -f <filename>: This can be JSON or CSV file
Imports all databases and tables in the file...
cvs format:
namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
JSON format:
{
"namespace1" :["tbl1","tbl2","tbl3",..]
"namespace2" :["tbl1","tbl2","tbl3",..]
}
HBASE CASE:
{code:java}
Usage 2: import-hbase.sh [-t <filename>] : This can be JSON or CSV file
cvs format:
namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
JSON format:
{
"namespace1" :["tbl1","tbl2","tbl3",..]
"namespace2" :["tbl1","tbl2","tbl3",..]
}
{code:java}
{code}
> Atlas Hbase/Hive hook improvement to provide import from file
> -------------------------------------------------------------
>
> Key: ATLAS-2525
> URL: https://issues.apache.org/jira/browse/ATLAS-2525
> Project: Atlas
> Issue Type: Bug
> Reporter: Ramesh Mani
> Priority: Major
>
> Atlas Hbase/Hive hook improvement to provide import from file
> Hook script should have another option -f to accept a file which contains the database/table in hive or namespace/table in hbase and import it into Atlas
> Format can be JSON or CSV.
> HIVE CASE:
> import-hive.sh -f <filename>: This can be JSON or CSV file Imports all databases and tables in the file... cvs format: namespace1,tbl1,tbl2,tbl3,.. namespace2,tbl1,tbl2,tbl3,..
> {code:java}
> {code:java}
> import-hive.sh -f <filename>: This can be JSON or CSV file
> Imports all databases and tables in the file...
> cvs format:
> database1,tbl1,tbl2,tbl3,..
> database2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "database1" :["tbl1","tbl2","tbl3",..]
> "database2" :["tbl1","tbl2","tbl3",..]
> }{code}
> JSON format:
> { "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2" :["tbl1","tbl2","tbl3",..] }
> HBASE CASE:
> {code:java}
> import-hbase.sh [-t <filename>] : This can be JSON or CSV file
> cvs format:
> namespace1,tbl1,tbl2,tbl3,..
> namespace2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "namespace1" :["tbl1","tbl2","tbl3",..]
> "namespace2" :["tbl1","tbl2","tbl3",..]
> }
> {code:java}
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)