You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Roman Shaposhnik (Created) (JIRA)" <ji...@apache.org> on 2011/10/28 01:44:33 UTC
[jira] [Created] (BIGTOP-203) sqoop needs to have access to hadoop
.jars in its lib
sqoop needs to have access to hadoop .jars in its lib
-----------------------------------------------------
Key: BIGTOP-203
URL: https://issues.apache.org/jira/browse/BIGTOP-203
Project: Bigtop
Issue Type: Bug
Affects Versions: 0.1.0
Reporter: Roman Shaposhnik
Assignee: Roman Shaposhnik
Fix For: 0.2.0
Otherwise it fails like this:
sqoop help
Warning: /usr/lib/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139001#comment-13139001 ]
Roman Shaposhnik commented on BIGTOP-203:
-----------------------------------------
Just to be extremely clear as to what's going on: we're not removing Sqoop from Bigtop, we're disabling it for 0.2.0 release and we plan to enable it back again when we transition to either Hadoop 0.22 or 0.23. Those Hadoop release have all the APIs that Sqoop expects.
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138943#comment-13138943 ]
Bruno Mahé commented on BIGTOP-203:
-----------------------------------
Since it does not meet basic criteria, we should disable it.
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-203) sqoop needs to have access to hadoop
.jars in its lib
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-203:
------------------------------------
Attachment: BIGTOP-203.patch.txt
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
> Attachments: BIGTOP-203.patch.txt
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138944#comment-13138944 ]
Bruno Mahé commented on BIGTOP-203:
-----------------------------------
+1 on removing it
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138932#comment-13138932 ]
Roman Shaposhnik commented on BIGTOP-203:
-----------------------------------------
The following:
org.apache.hadoop.mapreduce.lib.db.DBWritable
org.apache.hadoop.mapreduce.lib.input.CombineFileSplit
org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat
org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader
is also missing in pre .21 and I'm not sure it'll be trivial to workaround.
Now, given that -- I'm inclined to disable Sqoop in 0.2.0
Thoughts?
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (BIGTOP-203) sqoop needs to have
access to hadoop .jars in its lib
Posted by "Bruno Mahé (Issue Comment Edited JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138944#comment-13138944 ]
Bruno Mahé edited comment on BIGTOP-203 at 10/28/11 11:27 PM:
--------------------------------------------------------------
+1 on disabling it
was (Author: bmahe):
+1 on removing it
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138983#comment-13138983 ]
Roman Shaposhnik commented on BIGTOP-203:
-----------------------------------------
https://issues.apache.org/jira/browse/SQOOP-384
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140654#comment-13140654 ]
Bruno Mahé commented on BIGTOP-203:
-----------------------------------
+1. Can't wait to reactivate it!
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
> Attachments: BIGTOP-203.patch.txt
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Bhavesh Shah (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164264#comment-13164264 ]
Bhavesh Shah commented on BIGTOP-203:
-------------------------------------
I am also facing same kind of problems.
I have also set the $HBASE_HOME and $ZOOKEEPER_HOME.
how to solve it? pls suggest me.
Thanks.
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
> Attachments: BIGTOP-203.patch.txt
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138978#comment-13138978 ]
Eli Collins commented on BIGTOP-203:
------------------------------------
What's the upstream Sqoop issue for this?
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-203) sqoop needs to have access to
hadoop .jars in its lib
Posted by "Peter Linnell (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140694#comment-13140694 ]
Peter Linnell commented on BIGTOP-203:
--------------------------------------
+1 Will be nice to have this back in 0.3.0
> sqoop needs to have access to hadoop .jars in its lib
> -----------------------------------------------------
>
> Key: BIGTOP-203
> URL: https://issues.apache.org/jira/browse/BIGTOP-203
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.2.0
>
> Attachments: BIGTOP-203.patch.txt
>
>
> Otherwise it fails like this:
> sqoop help
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;
> at com.cloudera.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:209)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)
> The root cause of this issue is that sqoop has a hardcoded dependency on Cloudera's version of Hadoop :-(
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira