You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zhenxiao Luo (Updated) (JIRA)" <ji...@apache.org> on 2012/02/08 20:55:00 UTC
[jira] [Updated] (HIVE-2790) When integrating into MapReduce2,
GROUP BY on Floating Point and String types are broken
[ https://issues.apache.org/jira/browse/HIVE-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2790:
-------------------------------
Description:
Query result(-30.33) is missing in the running output:
[junit] Begin query: groupby_neg_float.q
[junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
[junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* more -I job_[0-9]*_[0-9]* -I USING 'java -cp /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/groupby_neg_float.q.out /home/cloudera/Code/hive/ql/src/test/results/clientpositive/groupby_neg_float.q.out
[junit] 14c14,15
[junit] < POSTHOOK: Output: file:/tmp/cloudera/hive_2012-01-24_10-57-51_652_2049459353574360528/-mr-10000
[junit] —
[junit] > POSTHOOK: Output: file:/data/users/njain/hive5/hive5/build/ql/tmp/815331462/10000
[junit] > -30.33
[junit] 28c29,30
[junit] < POSTHOOK: Output: file:/tmp/cloudera/hive_2012-01-24_10-57-56_909_7738265803221872068/-mr-10000
[junit] —
[junit] > POSTHOOK: Output: file:/data/users/njain/hive5/hive5/build/ql/tmp/2082702070/10000
[junit] junit.framework.AssertionFailedError: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_neg_float(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] Exception: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] > -30.33
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.)
When trying the following(GROUP BY on Floating Point type and string type):
FROM src
SELECT -30.33
GROUP BY -30.33
LIMIT 1;
FROM src
SELECT '-30.33'
GROUP BY '-30.33'
LIMIT 1;
Get NULL in result
was:
Query result(-30.33) is missing in the running output:
[junit] Begin query: groupby_neg_float.q
[junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
[junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* more -I job_[0-9]*_[0-9]* -I USING 'java -cp /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/groupby_neg_float.q.out /home/cloudera/Code/hive/ql/src/test/results/clientpositive/groupby_neg_float.q.out
[junit] 14c14,15
[junit] < POSTHOOK: Output: file:/tmp/cloudera/hive_2012-01-24_10-57-51_652_2049459353574360528/-mr-10000
[junit] —
[junit] > POSTHOOK: Output: file:/data/users/njain/hive5/hive5/build/ql/tmp/815331462/10000
[junit] > -30.33
[junit] 28c29,30
[junit] < POSTHOOK: Output: file:/tmp/cloudera/hive_2012-01-24_10-57-56_909_7738265803221872068/-mr-10000
[junit] —
[junit] > POSTHOOK: Output: file:/data/users/njain/hive5/hive5/build/ql/tmp/2082702070/10000
[junit] junit.framework.AssertionFailedError: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_neg_float(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] Exception: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] > -30.33
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.)
Summary: When integrating into MapReduce2, GROUP BY on Floating Point and String types are broken (was: When integrating into MapReduce2, SELECT 'number' GROUP BY 'number' returns NULL)
> When integrating into MapReduce2, GROUP BY on Floating Point and String types are broken
> ----------------------------------------------------------------------------------------
>
> Key: HIVE-2790
> URL: https://issues.apache.org/jira/browse/HIVE-2790
> Project: Hive
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
>
> Query result(-30.33) is missing in the running output:
> [junit] Begin query: groupby_neg_float.q
> [junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
> [junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
> [junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
> [junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
> [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* more -I job_[0-9]*_[0-9]* -I USING 'java -cp /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/groupby_neg_float.q.out /home/cloudera/Code/hive/ql/src/test/results/clientpositive/groupby_neg_float.q.out
> [junit] 14c14,15
> [junit] < POSTHOOK: Output: file:/tmp/cloudera/hive_2012-01-24_10-57-51_652_2049459353574360528/-mr-10000
> [junit] —
> [junit] > POSTHOOK: Output: file:/data/users/njain/hive5/hive5/build/ql/tmp/815331462/10000
> [junit] > -30.33
> [junit] 28c29,30
> [junit] < POSTHOOK: Output: file:/tmp/cloudera/hive_2012-01-24_10-57-56_909_7738265803221872068/-mr-10000
> [junit] —
> [junit] > POSTHOOK: Output: file:/data/users/njain/hive5/hive5/build/ql/tmp/2082702070/10000
> [junit] junit.framework.AssertionFailedError: Client execution results failed with error code = 1
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
> [junit] at junit.framework.Assert.fail(Assert.java:50)
> [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_neg_float(TestCliDriver.java:129)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit] at java.lang.reflect.Method.invoke(Method.java:616)
> [junit] at junit.framework.TestCase.runTest(TestCase.java:168)
> [junit] at junit.framework.TestCase.runBare(TestCase.java:134)
> [junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
> [junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
> [junit] at junit.framework.TestResult.run(TestResult.java:113)
> [junit] at junit.framework.TestCase.run(TestCase.java:124)
> [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
> [junit] at junit.framework.TestSuite.run(TestSuite.java:238)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
> [junit] Exception: Client execution results failed with error code = 1
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
> [junit] > -30.33
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.)
> When trying the following(GROUP BY on Floating Point type and string type):
> FROM src
> SELECT -30.33
> GROUP BY -30.33
> LIMIT 1;
> FROM src
> SELECT '-30.33'
> GROUP BY '-30.33'
> LIMIT 1;
> Get NULL in result
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira