You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Pengcheng Xiong (JIRA)" <ji...@apache.org> on 2016/06/21 19:57:57 UTC
[jira] [Commented] (HIVE-14040) insert overwrite for HBase doesn't
overwrite
[ https://issues.apache.org/jira/browse/HIVE-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342537#comment-15342537 ]
Pengcheng Xiong commented on HIVE-14040:
----------------------------------------
Here is some other finding. It seems that we allow create partition table with HBaseHandler but insert overwrite does not work.
{code}
set hive.exec.dynamic.partition.mode=nonstrict;
set hive.exec.max.dynamic.partitions.pernode=100000;
DROP TABLE users;
CREATE TABLE users(k string, state string, country string) partitioned by(key string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (
"hbase.columns.mapping" = "info:state,info:country"
);
INSERT OVERWRITE TABLE users partition(key) SELECT 'user1', 'IA', 'USA', key FROM src;
desc formatted users;
select * from users;
{code}
the output
{code}
POSTHOOK: query: desc formatted users
POSTHOOK: type: DESCTABLE
POSTHOOK: Input: default@users
# col_name data_type comment
k string
state string
country string
# Partition Information
# col_name data_type comment
key string
# Detailed Table Information
Database: default
#### A masked pattern was here ####
Retention: 0
#### A masked pattern was here ####
Table Type: MANAGED_TABLE
Table Parameters:
storage_handler org.apache.hadoop.hive.hbase.HBaseStorageHandler
#### A masked pattern was here ####
# Storage Information
SerDe Library: org.apache.hadoop.hive.hbase.HBaseSerDe
InputFormat: null
OutputFormat: null
Compressed: No
Num Buckets: -1
Bucket Columns: []
Sort Columns: []
Storage Desc Params:
hbase.columns.mapping info:state,info:country
serialization.format 1
PREHOOK: query: select * from users
PREHOOK: type: QUERY
PREHOOK: Input: default@users
#### A masked pattern was here ####
POSTHOOK: query: select * from users
POSTHOOK: type: QUERY
POSTHOOK: Input: default@users
#### A masked pattern was here ####
{code}
> insert overwrite for HBase doesn't overwrite
> --------------------------------------------
>
> Key: HIVE-14040
> URL: https://issues.apache.org/jira/browse/HIVE-14040
> Project: Hive
> Issue Type: Sub-task
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
>
> Creating a table and doing insert overwrite twice with two different rows (for example) results in the table with both rows, rather than only one as per "overwrite"
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)