[jira] [Commented] (HIVE-1653) Ability to enforce correct stats

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547964#comment-13547964 ] 

Hudson commented on HIVE-1653:
------------------------------

Integrated in Hive-trunk-hadoop2 #54 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/54/])
    HIVE-1653. Ability to enforce correct stats. (njain via kevinwilfong) (Revision 1366103)

     Result = ABORTED
kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1366103
Files : 
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml.template
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TableScanOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/StatsWork.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/stats
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/stats/DummyStatsAggregator.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/stats/DummyStatsPublisher.java
* /hive/trunk/ql/src/test/queries/clientnegative/stats_aggregator_error_1.q
* /hive/trunk/ql/src/test/queries/clientnegative/stats_aggregator_error_2.q
* /hive/trunk/ql/src/test/queries/clientnegative/stats_publisher_error_1.q
* /hive/trunk/ql/src/test/queries/clientnegative/stats_publisher_error_2.q
* /hive/trunk/ql/src/test/queries/clientpositive/stats_aggregator_error_1.q
* /hive/trunk/ql/src/test/queries/clientpositive/stats_publisher_error_1.q
* /hive/trunk/ql/src/test/results/clientnegative/stats_aggregator_error_1.q.out
* /hive/trunk/ql/src/test/results/clientnegative/stats_aggregator_error_2.q.out
* /hive/trunk/ql/src/test/results/clientnegative/stats_publisher_error_1.q.out
* /hive/trunk/ql/src/test/results/clientnegative/stats_publisher_error_2.q.out
* /hive/trunk/ql/src/test/results/clientpositive/stats_aggregator_error_1.q.out
* /hive/trunk/ql/src/test/results/clientpositive/stats_publisher_error_1.q.out

                
> Ability to enforce correct stats
> --------------------------------
>
>                 Key: HIVE-1653
>                 URL: https://issues.apache.org/jira/browse/HIVE-1653
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.10.0
>
>
> This is a follow-up for https://issues.apache.org/jira/browse/HIVE-1361.
> If one of the mappers/reducers cannot publish stats, it may lead to wrong aggregated stats.
> There should be a way to avoid this - at the least, a configuration variable which fails the 
> task if stats cannot be published

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira