You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by Ramesh Mani <rm...@hortonworks.com> on 2018/05/10 21:33:33 UTC
Review Request 67071: ATLAS-2649:Hive Hook should create lineage
entities
when storage handler mechanism to create hbase tables via hive
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67071/
-----------------------------------------------------------
Review request for atlas, Madhan Neethiraj, Sarath Subramanian, and Sharmadha Sainath.
Bugs: ATLAS-2649
https://issues.apache.org/jira/browse/ATLAS-2649
Repository: atlas
Description
-------
ATLAS-2649:Hive Hook should create lineage entities when storage handler mechanism to create hbase tables via hive
Diffs
-----
addons/hive-bridge/pom.xml 0d4ab2c
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java ca13812
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java 1c072e9
Diff: https://reviews.apache.org/r/67071/diff/1/
Testing
-------
Verify the lineage creation for
1) Hive Managed table without namespace (default)
2) Hive Managed table with namesapce
3) Hive External table from hbase table
CREATE TABLE hbase_table_emp19(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
CREATE TABLE hbase_table_emp20(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "emp20");
CREATE EXTERNAL TABLE hbase_table_empext2(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp17");
Thanks,
Ramesh Mani
Re: Review Request 67071: ATLAS-2649:Hive Hook should create lineage
entities when storage handler mechanism to create hbase tables via
hive
Posted by Madhan Neethiraj <ma...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67071/#review202895
-----------------------------------------------------------
Ship it!
Ship It!
- Madhan Neethiraj
On May 11, 2018, 5:48 a.m., Ramesh Mani wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/67071/
> -----------------------------------------------------------
>
> (Updated May 11, 2018, 5:48 a.m.)
>
>
> Review request for atlas, Madhan Neethiraj, Sarath Subramanian, and Sharmadha Sainath.
>
>
> Bugs: ATLAS-2649
> https://issues.apache.org/jira/browse/ATLAS-2649
>
>
> Repository: atlas
>
>
> Description
> -------
>
> ATLAS-2649:Hive Hook should create lineage entities when storage handler mechanism to create hbase tables via hive
>
>
> Diffs
> -----
>
> addons/hive-bridge/pom.xml 0d4ab2c
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java ca13812
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java 1c072e9
>
>
> Diff: https://reviews.apache.org/r/67071/diff/3/
>
>
> Testing
> -------
>
> Verify the lineage creation for
> 1) Hive Managed table without namespace (default)
> 2) Hive Managed table with namesapce
> 3) Hive External table from hbase table
>
> CREATE TABLE hbase_table_emp19(id int, name string, role string)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
> TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
>
> CREATE TABLE hbase_table_emp20(id int, name string, role string)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
> TBLPROPERTIES ("hbase.table.name" = "emp20");
>
> CREATE EXTERNAL TABLE hbase_table_empext2(id int, name string, role string)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
> TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
>
>
> Thanks,
>
> Ramesh Mani
>
>
Re: Review Request 67071: ATLAS-2649:Hive Hook should create lineage
entities when storage handler mechanism to create hbase tables via
hive
Posted by Ramesh Mani <rm...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67071/
-----------------------------------------------------------
(Updated May 11, 2018, 5:48 a.m.)
Review request for atlas, Madhan Neethiraj, Sarath Subramanian, and Sharmadha Sainath.
Changes
-------
Updated patch
Bugs: ATLAS-2649
https://issues.apache.org/jira/browse/ATLAS-2649
Repository: atlas
Description
-------
ATLAS-2649:Hive Hook should create lineage entities when storage handler mechanism to create hbase tables via hive
Diffs (updated)
-----
addons/hive-bridge/pom.xml 0d4ab2c
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java ca13812
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java 1c072e9
Diff: https://reviews.apache.org/r/67071/diff/3/
Changes: https://reviews.apache.org/r/67071/diff/2-3/
Testing
-------
Verify the lineage creation for
1) Hive Managed table without namespace (default)
2) Hive Managed table with namesapce
3) Hive External table from hbase table
CREATE TABLE hbase_table_emp19(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
CREATE TABLE hbase_table_emp20(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "emp20");
CREATE EXTERNAL TABLE hbase_table_empext2(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
Thanks,
Ramesh Mani
Re: Review Request 67071: ATLAS-2649:Hive Hook should create lineage
entities when storage handler mechanism to create hbase tables via
hive
Posted by Ramesh Mani <rm...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67071/
-----------------------------------------------------------
(Updated May 10, 2018, 10:12 p.m.)
Review request for atlas, Madhan Neethiraj, Sarath Subramanian, and Sharmadha Sainath.
Changes
-------
Nullpointer checkes added
Bugs: ATLAS-2649
https://issues.apache.org/jira/browse/ATLAS-2649
Repository: atlas
Description
-------
ATLAS-2649:Hive Hook should create lineage entities when storage handler mechanism to create hbase tables via hive
Diffs (updated)
-----
addons/hive-bridge/pom.xml 0d4ab2c
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java ca13812
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java 1c072e9
Diff: https://reviews.apache.org/r/67071/diff/2/
Changes: https://reviews.apache.org/r/67071/diff/1-2/
Testing (updated)
-------
Verify the lineage creation for
1) Hive Managed table without namespace (default)
2) Hive Managed table with namesapce
3) Hive External table from hbase table
CREATE TABLE hbase_table_emp19(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
CREATE TABLE hbase_table_emp20(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "emp20");
CREATE EXTERNAL TABLE hbase_table_empext2(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
Thanks,
Ramesh Mani
Re: Review Request 67071: ATLAS-2649:Hive Hook should create lineage
entities when storage handler mechanism to create hbase tables via
hive
Posted by Ramesh Mani <rm...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67071/
-----------------------------------------------------------
(Updated May 10, 2018, 9:34 p.m.)
Review request for atlas, Madhan Neethiraj, Sarath Subramanian, and Sharmadha Sainath.
Bugs: ATLAS-2649
https://issues.apache.org/jira/browse/ATLAS-2649
Repository: atlas
Description
-------
ATLAS-2649:Hive Hook should create lineage entities when storage handler mechanism to create hbase tables via hive
Diffs
-----
addons/hive-bridge/pom.xml 0d4ab2c
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java ca13812
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java 1c072e9
Diff: https://reviews.apache.org/r/67071/diff/1/
Testing
-------
Verify the lineage creation for
1) Hive Managed table without namespace (default)
2) Hive Managed table with namesapce
3) Hive External table from hbase table
CREATE TABLE hbase_table_emp19(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp19");
CREATE TABLE hbase_table_emp20(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "emp20");
CREATE EXTERNAL TABLE hbase_table_empext2(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" = "demo:emp17");
Thanks,
Ramesh Mani