You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Yifeng Geng (JIRA)" <ji...@apache.org> on 2011/05/19 18:56:47 UTC
[jira] [Created] (HIVE-2170) Cannot run Hive 0.7.0 with Hadoop
0.20.203
Cannot run Hive 0.7.0 with Hadoop 0.20.203
-------------------------------------------
Key: HIVE-2170
URL: https://issues.apache.org/jira/browse/HIVE-2170
Project: Hive
Issue Type: Bug
Components: CLI
Affects Versions: 0.7.0
Reporter: Yifeng Geng
Run hive-0.7.0 when hadoop-0.20.203 is up, get error as follows:
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Hive history file=/tmp/yifeng/hive_job_log_yifeng_201105200054_1479252065.txt
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.security.UserGroupInformation.login(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
at org.apache.hadoop.hive.shims.Hadoop20Shims.getUGIForConf(Hadoop20Shims.java:448)
at org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:51)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:222)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:219)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:417)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-2170) Cannot run Hive 0.7.0 with Hadoop
0.20.203
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jakob Homan resolved HIVE-2170.
-------------------------------
Resolution: Cannot Reproduce
Resolving as cannot reproduce. If you run into further configuration issues, the mailing list is the best bet.
> Cannot run Hive 0.7.0 with Hadoop 0.20.203
> -------------------------------------------
>
> Key: HIVE-2170
> URL: https://issues.apache.org/jira/browse/HIVE-2170
> Project: Hive
> Issue Type: Bug
> Components: CLI
> Affects Versions: 0.7.0
> Reporter: Yifeng Geng
>
> Run hive-0.7.0 when hadoop-0.20.203 is up, get error as follows:
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> Hive history file=/tmp/yifeng/hive_job_log_yifeng_201105200054_1479252065.txt
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.security.UserGroupInformation.login(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
> at org.apache.hadoop.hive.shims.Hadoop20Shims.getUGIForConf(Hadoop20Shims.java:448)
> at org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:51)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:222)
> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:219)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:417)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2170) Cannot run Hive 0.7.0 with Hadoop
0.20.203
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13060911#comment-13060911 ]
Jakob Homan commented on HIVE-2170:
-----------------------------------
I've tested 0.7 against our 203 cluster with no problems. I believe you've got an old hadoop jar lying around, since you're getting the pre-203, non-secure shim.
{noformat}[jhoman@da_machine hive-0.7.0-bin]$ bin/hive
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Hive history file=/tmp/jhoman/hive_job_log_jhoman_201107062259_426061277.txt
hive> create table doctors(id int, first_name string, last_name string)
> row format delimited fields terminated by '\t'
> stored as textfile;
OK
Time taken: 3.745 seconds
hive> load data local inpath '../test.tsv' into table doctors;
Copying data from file:/shared/home/jhoman/test.tsv
Copying file: file:/shared/home/jhoman/test.tsv
Loading data to table default.doctors
OK
Time taken: 0.412 seconds
hive> select * from doctors;
OK
4 david tennant
5 christopher eccleston
6 matt smith
Time taken: 0.18 seconds
hive> select * from doctors where last_name='eccleston';
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201107062247_0001, Tracking URL = http://da_jt:50030/jobdetails.jsp?jobid=job_201107062247_0001
Kill Command = /shared/apps/hadoop/latest/bin/../bin/hadoop job -Dmapred.job.tracker=da_jt:9001 -kill job_201107062247_0001
2011-07-06 23:01:58,989 Stage-1 map = 0%, reduce = 0%
2011-07-06 23:02:05,044 Stage-1 map = 100%, reduce = 0%
2011-07-06 23:02:11,101 Stage-1 map = 100%, reduce = 100%
Ended Job = job_201107062247_0001
OK
5 christopher eccleston
Time taken: 28.213 seconds
{noformat}
> Cannot run Hive 0.7.0 with Hadoop 0.20.203
> -------------------------------------------
>
> Key: HIVE-2170
> URL: https://issues.apache.org/jira/browse/HIVE-2170
> Project: Hive
> Issue Type: Bug
> Components: CLI
> Affects Versions: 0.7.0
> Reporter: Yifeng Geng
>
> Run hive-0.7.0 when hadoop-0.20.203 is up, get error as follows:
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> Hive history file=/tmp/yifeng/hive_job_log_yifeng_201105200054_1479252065.txt
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.security.UserGroupInformation.login(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
> at org.apache.hadoop.hive.shims.Hadoop20Shims.getUGIForConf(Hadoop20Shims.java:448)
> at org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:51)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:222)
> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:219)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:417)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira