You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Navis Ryu <na...@nexr.com> on 2014/07/08 07:27:38 UTC
Review Request 23332: Implement data loading from user provided string
directly for test
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/23332/
-----------------------------------------------------------
Review request for hive.
Bugs: HIVE-3227
https://issues.apache.org/jira/browse/HIVE-3227
Repository: hive-git
Description
-------
{code}
load data instream 'key value\nkey2 value2' into table test;
{code}
This will make test easier and also can reduce test time. For example,
{code}
-- ppr_pushdown.q
create table ppr_test (key string) partitioned by (ds string);
alter table ppr_test add partition (ds = '1234');
insert overwrite table ppr_test partition(ds = '1234') select * from (select '1234' from src limit 1 union all select 'abcd' from src limit 1) s;
{code}
last query is 4MR job. But can be replaced by
{code}
create table ppr_test (key string) partitioned by (ds string) ROW FORMAT delimited fields terminated by ' ';
alter table ppr_test add partition (ds = '1234');
load data local instream '1234\nabcd' overwrite into table ppr_test partition(ds = '1234');
{code}
Diffs
-----
ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 412a046
ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g f934ac4
ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java 8bd24d3
ql/src/test/queries/clientpositive/load_instream.q PRE-CREATION
ql/src/test/results/clientpositive/load_instream.q.out PRE-CREATION
Diff: https://reviews.apache.org/r/23332/diff/
Testing
-------
Thanks,
Navis Ryu