You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2016/01/06 02:15:39 UTC
[jira] [Commented] (HIVE-12590) Repeated UDAFs with literals can
produce incorrect result
[ https://issues.apache.org/jira/browse/HIVE-12590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084490#comment-15084490 ]
Hive QA commented on HIVE-12590:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12780432/HIVE-12590.5.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 139 failed/errored test(s), 9997 tests executed
*Failed tests:*
{noformat}
TestHWISessionManager - did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_sortmerge_join_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_case_sensitivity
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer11
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input16
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input22
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input4_cb_delim
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input_lazyserde
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join40
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join42
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_array
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multigroupby_singlemr
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_schema_evol_orc_acid_mapwork_part
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_schema_evol_orc_acidvec_mapwork_part
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver_hbase_ppd_join
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_input16_cc
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_schema_evol_orc_acid_mapwork_part
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_schema_evol_orc_acidvec_mapwork_part
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_input16_cc
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_uri_import
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_join_cond_unqual_ambiguous_vc
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join40
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_array
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_multigroupby_singlemr
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_order2
org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testMultiSessionMultipleUse
org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testSingleSessionMultipleUse
org.apache.hadoop.hive.ql.parse.TestIUD.testDeleteNoWhere
org.apache.hadoop.hive.ql.parse.TestIUD.testDeleteWithWhere
org.apache.hadoop.hive.ql.parse.TestIUD.testInsertIntoTableAsSelectFromNamedVirtTable
org.apache.hadoop.hive.ql.parse.TestIUD.testInsertIntoTableAsSelectFromNamedVirtTableNamedCol
org.apache.hadoop.hive.ql.parse.TestIUD.testInsertIntoTableFromAnonymousTable
org.apache.hadoop.hive.ql.parse.TestIUD.testInsertIntoTableFromAnonymousTable1Row
org.apache.hadoop.hive.ql.parse.TestIUD.testInsertIntoTableFromAnonymousTable1RowNamedCol
org.apache.hadoop.hive.ql.parse.TestIUD.testMultiInsert
org.apache.hadoop.hive.ql.parse.TestIUD.testSelectStarFromVirtTable1Row
org.apache.hadoop.hive.ql.parse.TestIUD.testSelectStarFromVirtTable2Row
org.apache.hadoop.hive.ql.parse.TestIUD.testSelectStarFromVirtTable2RowNamedProjections
org.apache.hadoop.hive.ql.parse.TestIUD.testStandardInsertIntoTable
org.apache.hadoop.hive.ql.parse.TestIUD.testUpdateNoWhereMultiSet
org.apache.hadoop.hive.ql.parse.TestIUD.testUpdateNoWhereSingleSet
org.apache.hadoop.hive.ql.parse.TestIUD.testUpdateWithWhereMultiSet
org.apache.hadoop.hive.ql.parse.TestIUD.testUpdateWithWhereSingleSet
org.apache.hadoop.hive.ql.parse.TestIUD.testUpdateWithWhereSingleSetExpr
org.apache.hadoop.hive.ql.parse.TestQBSubQuery.testExtractConjuncts
org.apache.hadoop.hive.ql.parse.TestQBSubQuery.testExtractSubQueries
org.apache.hadoop.hive.ql.parse.TestQBSubQuery.testRewriteOuterQueryWhere2
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_ALL
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_ALTER
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_ARRAY
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_AS
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_AUTHORIZATION
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_BETWEEN
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_BIGINT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_BINARY
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_BOOLEAN
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_BOTH
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_BY
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_CREATE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_CUBE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_CURRENT_DATE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_CURRENT_TIMESTAMP
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_CURSOR
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_DATE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_DECIMAL
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_DELETE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_DESCRIBE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_DOUBLE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_DROP
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_EXISTS
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_EXTERNAL
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_FALSE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_FETCH
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_FLOAT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_FOR
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_FULL
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_GRANT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_GROUP
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_GROUPING
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_IMPORT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_IN
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_INNER
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_INSERT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_INT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_INTERSECT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_INTO
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_IS
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_LATERAL
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_LEFT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_LIKE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_LOCAL
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_NONE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_NULL
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_OF
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_ORDER
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_OUT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_OUTER
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_PARTITION
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_PERCENT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_PROCEDURE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_RANGE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_READS
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_REGEXP
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_REVOKE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_RIGHT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_RLIKE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_ROLLUP
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_ROW
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_ROWS
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_SET
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_SMALLINT
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_TABLE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_TIMESTAMP
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_TO
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_TRIGGER
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_TRUE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_TRUNCATE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_UNION
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_UPDATE
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_USER
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_USING
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_VALUES
org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsPositive.testSQL11ReservedKeyWords_WITH
org.apache.hadoop.hive.ql.parse.positive.TestTransactionStatement.testAutoCommit
org.apache.hadoop.hive.ql.parse.positive.TestTransactionStatement.testTxnCommitRollback
org.apache.hadoop.hive.ql.parse.positive.TestTransactionStatement.testTxnStart
org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveOperationType.checkHiveOperationTypeMatch
org.apache.hive.jdbc.TestSSL.testSSLVersion
org.apache.hive.service.cli.TestEmbeddedThriftBinaryCLIService.testExecuteStatementParallel
org.apache.hive.spark.client.TestSparkClient.testAddJarsAndFiles
org.apache.hive.spark.client.TestSparkClient.testCounters
org.apache.hive.spark.client.TestSparkClient.testErrorJob
org.apache.hive.spark.client.TestSparkClient.testJobSubmission
org.apache.hive.spark.client.TestSparkClient.testMetricsCollection
org.apache.hive.spark.client.TestSparkClient.testRemoteClient
org.apache.hive.spark.client.TestSparkClient.testSimpleSparkJob
org.apache.hive.spark.client.TestSparkClient.testSyncRpc
{noformat}
Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6520/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6520/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-6520/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 139 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12780432 - PreCommit-HIVE-TRUNK-Build
> Repeated UDAFs with literals can produce incorrect result
> ---------------------------------------------------------
>
> Key: HIVE-12590
> URL: https://issues.apache.org/jira/browse/HIVE-12590
> Project: Hive
> Issue Type: Bug
> Components: Query Planning
> Affects Versions: 1.0.1, 1.1.1, 1.2.1, 2.0.0
> Reporter: Laljo John Pullokkaran
> Assignee: Ashutosh Chauhan
> Priority: Critical
> Attachments: HIVE-12590.2.patch, HIVE-12590.3.patch, HIVE-12590.4.patch, HIVE-12590.4.patch, HIVE-12590.5.patch, HIVE-12590.patch
>
>
> Repeated UDAF with literals could produce wrong result.
> This is not a common use case, nevertheless a bug.
> hive> select max('pants'), max('pANTS') from t1 group by key;
> Total MapReduce CPU Time Spent: 0 msec
> OK
> pANTS pANTS
> pANTS pANTS
> pANTS pANTS
> pANTS pANTS
> pANTS pANTS
> Time taken: 296.252 seconds, Fetched: 5 row(s)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)