You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Jason Dere <jd...@hortonworks.com> on 2016/11/23 07:53:40 UTC
Review Request 54022: HIVE-15270 ExprNode/Sarg changes to support
values supplied during query runtime
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/54022/
-----------------------------------------------------------
Review request for hive, Ashutosh Chauhan and Prasanth_J.
Bugs: HIVe-15270
https://issues.apache.org/jira/browse/HIVe-15270
Repository: hive-git
Description
-------
- Some concept of available runtime values that can be retrieved for a MapWork/ReduceWork
- ExprNode/Sarg changes to pass a Conf during initialization - this allows the expression to retrieve the MapWork at query time (using Utilities.getMapWork(Configuration)) to access runtime-supplied values.
- Ability to populate the runtime values in Tez mode via incoming Tez edges
Diffs
-----
orc/src/test/org/apache/orc/impl/TestRecordReaderImpl.java cdd62ac
ql/src/java/org/apache/hadoop/hive/ql/exec/AbstractMapJoinOperator.java 69ba4a2
ql/src/java/org/apache/hadoop/hive/ql/exec/CommonJoinOperator.java 5512ee2
ql/src/java/org/apache/hadoop/hive/ql/exec/DynamicValueRegistry.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeColumnEvaluator.java 24c8281
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeConstantDefaultEvaluator.java 89a75eb
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeConstantEvaluator.java 4fe72a0
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeDynamicValueEvaluator.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluator.java b8d6ab7
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluatorFactory.java 0d03d8f
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluatorHead.java 42685fb
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluatorRef.java 0a6b66a
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeFieldEvaluator.java ff32626
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeGenericFuncEvaluator.java 221abd9
ql/src/java/org/apache/hadoop/hive/ql/exec/FilterOperator.java bd0d28c
ql/src/java/org/apache/hadoop/hive/ql/exec/GroupByOperator.java f28d33e
ql/src/java/org/apache/hadoop/hive/ql/exec/HashTableSinkOperator.java ac5331e
ql/src/java/org/apache/hadoop/hive/ql/exec/JoinUtil.java 6cbcab6
ql/src/java/org/apache/hadoop/hive/ql/exec/SelectOperator.java 9049ddd
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DynamicValueRegistryTez.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/MapRecordProcessor.java 6f36dfb
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/ReduceRecordProcessor.java cf3c8ab
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorMapJoinOperator.java 0cb6c8a
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorSMBMapJoinOperator.java 80b0a14
ql/src/java/org/apache/hadoop/hive/ql/io/sarg/ConvertAstToSearchArg.java 9013084
ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java 9e9beb0
ql/src/java/org/apache/hadoop/hive/ql/plan/BaseWork.java 13a0811
ql/src/java/org/apache/hadoop/hive/ql/plan/DynamicValue.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDynamicValueDesc.java PRE-CREATION
ql/src/test/org/apache/hadoop/hive/ql/io/sarg/TestConvertAstToSearchArg.java 93b50a6
ql/src/test/org/apache/hadoop/hive/ql/io/sarg/TestSearchArgumentImpl.java 8cbc26d
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/LiteralDelegate.java PRE-CREATION
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentFactory.java 8fda95c
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentImpl.java 10d8c51
Diff: https://reviews.apache.org/r/54022/diff/
Testing
-------
Thanks,
Jason Dere
Re: Review Request 54022: HIVE-15270 ExprNode/Sarg changes to support
values supplied during query runtime
Posted by Jason Dere <jd...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/54022/
-----------------------------------------------------------
(Updated Nov. 28, 2016, 11:10 p.m.)
Review request for hive, Ashutosh Chauhan and Prasanth_J.
Changes
-------
Fixed bugs leading to unit test failures.
Bugs: HIVe-15270
https://issues.apache.org/jira/browse/HIVe-15270
Repository: hive-git
Description
-------
- Some concept of available runtime values that can be retrieved for a MapWork/ReduceWork
- ExprNode/Sarg changes to pass a Conf during initialization - this allows the expression to retrieve the MapWork at query time (using Utilities.getMapWork(Configuration)) to access runtime-supplied values.
- Ability to populate the runtime values in Tez mode via incoming Tez edges
Diffs (updated)
-----
orc/src/test/org/apache/orc/impl/TestRecordReaderImpl.java cdd62ac
ql/src/java/org/apache/hadoop/hive/ql/exec/AbstractMapJoinOperator.java 69ba4a2
ql/src/java/org/apache/hadoop/hive/ql/exec/CommonJoinOperator.java 5512ee2
ql/src/java/org/apache/hadoop/hive/ql/exec/DynamicValueRegistry.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeColumnEvaluator.java 24c8281
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeConstantDefaultEvaluator.java 89a75eb
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeConstantEvaluator.java 4fe72a0
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeDynamicValueEvaluator.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluator.java b8d6ab7
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluatorFactory.java 0d03d8f
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluatorHead.java 42685fb
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluatorRef.java 0a6b66a
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeFieldEvaluator.java ff32626
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeGenericFuncEvaluator.java 221abd9
ql/src/java/org/apache/hadoop/hive/ql/exec/FilterOperator.java bd0d28c
ql/src/java/org/apache/hadoop/hive/ql/exec/GroupByOperator.java f28d33e
ql/src/java/org/apache/hadoop/hive/ql/exec/HashTableSinkOperator.java ac5331e
ql/src/java/org/apache/hadoop/hive/ql/exec/JoinUtil.java 6cbcab6
ql/src/java/org/apache/hadoop/hive/ql/exec/SelectOperator.java 9049ddd
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DynamicValueRegistryTez.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/MapRecordProcessor.java 6f36dfb
ql/src/java/org/apache/hadoop/hive/ql/exec/tez/ReduceRecordProcessor.java cf3c8ab
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorMapJoinOperator.java 0cb6c8a
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorSMBMapJoinOperator.java 80b0a14
ql/src/java/org/apache/hadoop/hive/ql/io/sarg/ConvertAstToSearchArg.java 9013084
ql/src/java/org/apache/hadoop/hive/ql/optimizer/FixedBucketPruningOptimizer.java 9e9beb0
ql/src/java/org/apache/hadoop/hive/ql/plan/BaseWork.java 13a0811
ql/src/java/org/apache/hadoop/hive/ql/plan/DynamicValue.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDynamicValueDesc.java PRE-CREATION
ql/src/test/org/apache/hadoop/hive/ql/io/sarg/TestConvertAstToSearchArg.java 93b50a6
ql/src/test/org/apache/hadoop/hive/ql/io/sarg/TestSearchArgumentImpl.java 8cbc26d
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/LiteralDelegate.java PRE-CREATION
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentFactory.java 8fda95c
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentImpl.java 10d8c51
Diff: https://reviews.apache.org/r/54022/diff/
Testing
-------
Thanks,
Jason Dere