You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by yogesh dhari <yo...@live.com> on 2012/06/13 12:26:38 UTC

ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Hi Jagat, I am using Sqoop version 1.1.0 n hadoop 0.20.2When I run import command ie. sqoop import --connect I got this error..ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..Please suggest.  		 	   		  

RE: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by yogesh dhari <yo...@live.com>.
Hi Jacec,
I am running this command to import table from PostgreSQL to hadoop ( from from another machine on same network) sqoop import --connect jdbc:PostgreSQL9.1://159.224.135.117/Demo --table Class -username ykumar60 --password abc@123 --target-dir /HADOOP/hadoop-0.20.2
And it fails and shows this error
ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string: jdbc:PostgreSQL9.1://169.254.145.119/Demo    at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:119)    at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:202)    at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)    at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:441)    at org.apache.sqoop.Sqoop.run(Sqoop.java:145)    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)

Please help 
Regards,Yogesh Kumar
> Date: Fri, 15 Jun 2012 21:52:02 +0200
> From: jarcec@apache.org
> To: user@sqoop.apache.org
> Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> 
> You're welcome sir,
> I'm glad that I could help.
> 
> Jarcec
> 
> On Fri, Jun 15, 2012 at 11:32:50PM +0530, yogesh dhari wrote:
> > 
> > Hi Jarcec, I have downloaded and tried with
> > sqoop-1.4.1-incubating__hadoop-0.20.tar.gz and it solved the issue,
> > Thank you very much.its solved now.Thanks a lot.
> > GreetingsYogesh kumar
> > 
> > 
> > > Date: Fri, 15 Jun 2012 07:56:07 +0200
> > > From: jarcec@apache.org
> > > To: user@sqoop.apache.org
> > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > 
> > > Good morning sir,
> > > please disregard my initial hint about missing hadoop jars.
> > > 
> > > I've take a close look on your issue. This was typical error message prior sqoop version 1.4.1-incubating, because we were not supporting pure hadoop version 0.20. However version 1.4.1-incubating should be supporting 0.20. I've download the release as is available on apache website (sqoop-1.4.1-incubating__hadoop-0.20.tar.gz) and explored it. There is no longer code that would call Configuration.getInstance method (that is expected and fine). So I'm wondering why you got this Exception.
> > > 
> > > Could you please verify that you've really downloaded 1.4.1-incubating version? Version 1.4.0-incubating is not enough. Also could you please verify that this version is really being used? (for example that you're not using your old 1.1.0 jars instead somehow)
> > > 
> > > Jarcec
> > > 
> > > On Thu, Jun 14, 2012 at 08:55:19PM +0530, yogesh dhari wrote:
> > > > 
> > > > Hello Jarcec
> > > > I have correctly set the HADOOP_HOME
> > > > export HADOOP_HOME=/HADOOP/hadoop-0.20.2        (Here I have put the hadoop 0.20.2)export PATH=$HADOOP_HOME/bin:$PATH
> > > > and I am sorry I haven't got your point that hadoop jars are not present in the class path.Please explain it little bit.
> > > > Greetings Yogesh Kumar
> > > > 
> > > > 
> > > > > Date: Thu, 14 Jun 2012 14:22:15 +0200
> > > > > From: jarcec@apache.org
> > > > > To: user@sqoop.apache.org
> > > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > 
> > > > > Hi Yogesh,
> > > > > I believe that this exception is thrown because hadoop jars are not present in the class path. Do you have correctly set up variable HADOOP_HOME pointing to your hadoop installation?
> > > > > 
> > > > > Jarcec
> > > > > 
> > > > > On Thu, Jun 14, 2012 at 05:18:54PM +0530, yogesh dhari wrote:
> > > > > > 
> > > > > > Hi Jarcec
> > > > > > Thanks a lot for helping.
> > > > > > I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
> > > > > > mediaadmins-iMac-2:~ mediaadmin$ sqoop help
> > > > > > Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> > > > > > 
> > > > > > Please suggest.
> > > > > > Regards Yogesh Kumar
> > > > > > > From: jarcec@apache.org
> > > > > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > > > Date: Wed, 13 Jun 2012 12:31:04 +0200
> > > > > > > To: user@sqoop.apache.org
> > > > > > > 
> > > > > > > Hi Yogesh,
> > > > > > > version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> > > > > > > 
> > > > > > > You can choose closes apache mirror on following web page:
> > > > > > > 
> > > > > > > http://www.apache.org/dyn/closer.cgi/sqoop/
> > > > > > > 
> > > > > > > Jarcec
> > > > > > > 
> > > > > > > On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> > > > > > > 
> > > > > > > > Hi Jagat, I am using 
> > > > > > > > Sqoop version 1.1.0 n hadoop 0.20.2
> > > > > > > > 
> > > > > > > > When I run import command ie. 
> > > > > > > > sqoop import --connect 
> > > > > > > > 
> > > > > > > > I got this error..
> > > > > > > > 
> > > > > > > > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > > > > 
> > > > > > > > Please suggest.
> > > > > > > 
> > > > > >  		 	   		  
> > > >  		 	   		  
> >  		 	   		  
 		 	   		  

RE: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by yogesh dhari <yo...@live.com>.
Hi dear jarcecI am very much thankful to you that you have me help me out. Really you are doing the best job to helping out people like me.
And I am sorry to say I will again give you some trouble regarding any issue in sqoop, if in case I will face any issue in near future. :-)
Thanks a millionYogesh Kumar

> Date: Fri, 15 Jun 2012 21:52:02 +0200
> From: jarcec@apache.org
> To: user@sqoop.apache.org
> Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> 
> You're welcome sir,
> I'm glad that I could help.
> 
> Jarcec
> 
> On Fri, Jun 15, 2012 at 11:32:50PM +0530, yogesh dhari wrote:
> > 
> > Hi Jarcec, I have downloaded and tried with
> > sqoop-1.4.1-incubating__hadoop-0.20.tar.gz and it solved the issue,
> > Thank you very much.its solved now.Thanks a lot.
> > GreetingsYogesh kumar
> > 
> > 
> > > Date: Fri, 15 Jun 2012 07:56:07 +0200
> > > From: jarcec@apache.org
> > > To: user@sqoop.apache.org
> > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > 
> > > Good morning sir,
> > > please disregard my initial hint about missing hadoop jars.
> > > 
> > > I've take a close look on your issue. This was typical error message prior sqoop version 1.4.1-incubating, because we were not supporting pure hadoop version 0.20. However version 1.4.1-incubating should be supporting 0.20. I've download the release as is available on apache website (sqoop-1.4.1-incubating__hadoop-0.20.tar.gz) and explored it. There is no longer code that would call Configuration.getInstance method (that is expected and fine). So I'm wondering why you got this Exception.
> > > 
> > > Could you please verify that you've really downloaded 1.4.1-incubating version? Version 1.4.0-incubating is not enough. Also could you please verify that this version is really being used? (for example that you're not using your old 1.1.0 jars instead somehow)
> > > 
> > > Jarcec
> > > 
> > > On Thu, Jun 14, 2012 at 08:55:19PM +0530, yogesh dhari wrote:
> > > > 
> > > > Hello Jarcec
> > > > I have correctly set the HADOOP_HOME
> > > > export HADOOP_HOME=/HADOOP/hadoop-0.20.2        (Here I have put the hadoop 0.20.2)export PATH=$HADOOP_HOME/bin:$PATH
> > > > and I am sorry I haven't got your point that hadoop jars are not present in the class path.Please explain it little bit.
> > > > Greetings Yogesh Kumar
> > > > 
> > > > 
> > > > > Date: Thu, 14 Jun 2012 14:22:15 +0200
> > > > > From: jarcec@apache.org
> > > > > To: user@sqoop.apache.org
> > > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > 
> > > > > Hi Yogesh,
> > > > > I believe that this exception is thrown because hadoop jars are not present in the class path. Do you have correctly set up variable HADOOP_HOME pointing to your hadoop installation?
> > > > > 
> > > > > Jarcec
> > > > > 
> > > > > On Thu, Jun 14, 2012 at 05:18:54PM +0530, yogesh dhari wrote:
> > > > > > 
> > > > > > Hi Jarcec
> > > > > > Thanks a lot for helping.
> > > > > > I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
> > > > > > mediaadmins-iMac-2:~ mediaadmin$ sqoop help
> > > > > > Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> > > > > > 
> > > > > > Please suggest.
> > > > > > Regards Yogesh Kumar
> > > > > > > From: jarcec@apache.org
> > > > > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > > > Date: Wed, 13 Jun 2012 12:31:04 +0200
> > > > > > > To: user@sqoop.apache.org
> > > > > > > 
> > > > > > > Hi Yogesh,
> > > > > > > version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> > > > > > > 
> > > > > > > You can choose closes apache mirror on following web page:
> > > > > > > 
> > > > > > > http://www.apache.org/dyn/closer.cgi/sqoop/
> > > > > > > 
> > > > > > > Jarcec
> > > > > > > 
> > > > > > > On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> > > > > > > 
> > > > > > > > Hi Jagat, I am using 
> > > > > > > > Sqoop version 1.1.0 n hadoop 0.20.2
> > > > > > > > 
> > > > > > > > When I run import command ie. 
> > > > > > > > sqoop import --connect 
> > > > > > > > 
> > > > > > > > I got this error..
> > > > > > > > 
> > > > > > > > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > > > > 
> > > > > > > > Please suggest.
> > > > > > > 
> > > > > >  		 	   		  
> > > >  		 	   		  
> >  		 	   		  
 		 	   		  

Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
You're welcome sir,
I'm glad that I could help.

Jarcec

On Fri, Jun 15, 2012 at 11:32:50PM +0530, yogesh dhari wrote:
> 
> Hi Jarcec, I have downloaded and tried with
> sqoop-1.4.1-incubating__hadoop-0.20.tar.gz and it solved the issue,
> Thank you very much.its solved now.Thanks a lot.
> GreetingsYogesh kumar
> 
> 
> > Date: Fri, 15 Jun 2012 07:56:07 +0200
> > From: jarcec@apache.org
> > To: user@sqoop.apache.org
> > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > 
> > Good morning sir,
> > please disregard my initial hint about missing hadoop jars.
> > 
> > I've take a close look on your issue. This was typical error message prior sqoop version 1.4.1-incubating, because we were not supporting pure hadoop version 0.20. However version 1.4.1-incubating should be supporting 0.20. I've download the release as is available on apache website (sqoop-1.4.1-incubating__hadoop-0.20.tar.gz) and explored it. There is no longer code that would call Configuration.getInstance method (that is expected and fine). So I'm wondering why you got this Exception.
> > 
> > Could you please verify that you've really downloaded 1.4.1-incubating version? Version 1.4.0-incubating is not enough. Also could you please verify that this version is really being used? (for example that you're not using your old 1.1.0 jars instead somehow)
> > 
> > Jarcec
> > 
> > On Thu, Jun 14, 2012 at 08:55:19PM +0530, yogesh dhari wrote:
> > > 
> > > Hello Jarcec
> > > I have correctly set the HADOOP_HOME
> > > export HADOOP_HOME=/HADOOP/hadoop-0.20.2        (Here I have put the hadoop 0.20.2)export PATH=$HADOOP_HOME/bin:$PATH
> > > and I am sorry I haven't got your point that hadoop jars are not present in the class path.Please explain it little bit.
> > > Greetings Yogesh Kumar
> > > 
> > > 
> > > > Date: Thu, 14 Jun 2012 14:22:15 +0200
> > > > From: jarcec@apache.org
> > > > To: user@sqoop.apache.org
> > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > 
> > > > Hi Yogesh,
> > > > I believe that this exception is thrown because hadoop jars are not present in the class path. Do you have correctly set up variable HADOOP_HOME pointing to your hadoop installation?
> > > > 
> > > > Jarcec
> > > > 
> > > > On Thu, Jun 14, 2012 at 05:18:54PM +0530, yogesh dhari wrote:
> > > > > 
> > > > > Hi Jarcec
> > > > > Thanks a lot for helping.
> > > > > I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
> > > > > mediaadmins-iMac-2:~ mediaadmin$ sqoop help
> > > > > Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> > > > > 
> > > > > Please suggest.
> > > > > Regards Yogesh Kumar
> > > > > > From: jarcec@apache.org
> > > > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > > Date: Wed, 13 Jun 2012 12:31:04 +0200
> > > > > > To: user@sqoop.apache.org
> > > > > > 
> > > > > > Hi Yogesh,
> > > > > > version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> > > > > > 
> > > > > > You can choose closes apache mirror on following web page:
> > > > > > 
> > > > > > http://www.apache.org/dyn/closer.cgi/sqoop/
> > > > > > 
> > > > > > Jarcec
> > > > > > 
> > > > > > On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> > > > > > 
> > > > > > > Hi Jagat, I am using 
> > > > > > > Sqoop version 1.1.0 n hadoop 0.20.2
> > > > > > > 
> > > > > > > When I run import command ie. 
> > > > > > > sqoop import --connect 
> > > > > > > 
> > > > > > > I got this error..
> > > > > > > 
> > > > > > > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > > > 
> > > > > > > Please suggest.
> > > > > > 
> > > > >  		 	   		  
> > >  		 	   		  
>  		 	   		  

RE: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by yogesh dhari <yo...@live.com>.
Hi Jarcec, I have downloaded and tried with
sqoop-1.4.1-incubating__hadoop-0.20.tar.gz and it solved the issue,
Thank you very much.its solved now.Thanks a lot.
GreetingsYogesh kumar


> Date: Fri, 15 Jun 2012 07:56:07 +0200
> From: jarcec@apache.org
> To: user@sqoop.apache.org
> Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> 
> Good morning sir,
> please disregard my initial hint about missing hadoop jars.
> 
> I've take a close look on your issue. This was typical error message prior sqoop version 1.4.1-incubating, because we were not supporting pure hadoop version 0.20. However version 1.4.1-incubating should be supporting 0.20. I've download the release as is available on apache website (sqoop-1.4.1-incubating__hadoop-0.20.tar.gz) and explored it. There is no longer code that would call Configuration.getInstance method (that is expected and fine). So I'm wondering why you got this Exception.
> 
> Could you please verify that you've really downloaded 1.4.1-incubating version? Version 1.4.0-incubating is not enough. Also could you please verify that this version is really being used? (for example that you're not using your old 1.1.0 jars instead somehow)
> 
> Jarcec
> 
> On Thu, Jun 14, 2012 at 08:55:19PM +0530, yogesh dhari wrote:
> > 
> > Hello Jarcec
> > I have correctly set the HADOOP_HOME
> > export HADOOP_HOME=/HADOOP/hadoop-0.20.2        (Here I have put the hadoop 0.20.2)export PATH=$HADOOP_HOME/bin:$PATH
> > and I am sorry I haven't got your point that hadoop jars are not present in the class path.Please explain it little bit.
> > Greetings Yogesh Kumar
> > 
> > 
> > > Date: Thu, 14 Jun 2012 14:22:15 +0200
> > > From: jarcec@apache.org
> > > To: user@sqoop.apache.org
> > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > 
> > > Hi Yogesh,
> > > I believe that this exception is thrown because hadoop jars are not present in the class path. Do you have correctly set up variable HADOOP_HOME pointing to your hadoop installation?
> > > 
> > > Jarcec
> > > 
> > > On Thu, Jun 14, 2012 at 05:18:54PM +0530, yogesh dhari wrote:
> > > > 
> > > > Hi Jarcec
> > > > Thanks a lot for helping.
> > > > I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
> > > > mediaadmins-iMac-2:~ mediaadmin$ sqoop help
> > > > Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> > > > 
> > > > Please suggest.
> > > > Regards Yogesh Kumar
> > > > > From: jarcec@apache.org
> > > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > Date: Wed, 13 Jun 2012 12:31:04 +0200
> > > > > To: user@sqoop.apache.org
> > > > > 
> > > > > Hi Yogesh,
> > > > > version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> > > > > 
> > > > > You can choose closes apache mirror on following web page:
> > > > > 
> > > > > http://www.apache.org/dyn/closer.cgi/sqoop/
> > > > > 
> > > > > Jarcec
> > > > > 
> > > > > On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> > > > > 
> > > > > > Hi Jagat, I am using 
> > > > > > Sqoop version 1.1.0 n hadoop 0.20.2
> > > > > > 
> > > > > > When I run import command ie. 
> > > > > > sqoop import --connect 
> > > > > > 
> > > > > > I got this error..
> > > > > > 
> > > > > > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > > 
> > > > > > Please suggest.
> > > > > 
> > > >  		 	   		  
> >  		 	   		  
 		 	   		  

Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Good morning sir,
please disregard my initial hint about missing hadoop jars.

I've take a close look on your issue. This was typical error message prior sqoop version 1.4.1-incubating, because we were not supporting pure hadoop version 0.20. However version 1.4.1-incubating should be supporting 0.20. I've download the release as is available on apache website (sqoop-1.4.1-incubating__hadoop-0.20.tar.gz) and explored it. There is no longer code that would call Configuration.getInstance method (that is expected and fine). So I'm wondering why you got this Exception.

Could you please verify that you've really downloaded 1.4.1-incubating version? Version 1.4.0-incubating is not enough. Also could you please verify that this version is really being used? (for example that you're not using your old 1.1.0 jars instead somehow)

Jarcec

On Thu, Jun 14, 2012 at 08:55:19PM +0530, yogesh dhari wrote:
> 
> Hello Jarcec
> I have correctly set the HADOOP_HOME
> export HADOOP_HOME=/HADOOP/hadoop-0.20.2        (Here I have put the hadoop 0.20.2)export PATH=$HADOOP_HOME/bin:$PATH
> and I am sorry I haven't got your point that hadoop jars are not present in the class path.Please explain it little bit.
> Greetings Yogesh Kumar
> 
> 
> > Date: Thu, 14 Jun 2012 14:22:15 +0200
> > From: jarcec@apache.org
> > To: user@sqoop.apache.org
> > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > 
> > Hi Yogesh,
> > I believe that this exception is thrown because hadoop jars are not present in the class path. Do you have correctly set up variable HADOOP_HOME pointing to your hadoop installation?
> > 
> > Jarcec
> > 
> > On Thu, Jun 14, 2012 at 05:18:54PM +0530, yogesh dhari wrote:
> > > 
> > > Hi Jarcec
> > > Thanks a lot for helping.
> > > I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
> > > mediaadmins-iMac-2:~ mediaadmin$ sqoop help
> > > Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> > > 
> > > Please suggest.
> > > Regards Yogesh Kumar
> > > > From: jarcec@apache.org
> > > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > Date: Wed, 13 Jun 2012 12:31:04 +0200
> > > > To: user@sqoop.apache.org
> > > > 
> > > > Hi Yogesh,
> > > > version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> > > > 
> > > > You can choose closes apache mirror on following web page:
> > > > 
> > > > http://www.apache.org/dyn/closer.cgi/sqoop/
> > > > 
> > > > Jarcec
> > > > 
> > > > On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> > > > 
> > > > > Hi Jagat, I am using 
> > > > > Sqoop version 1.1.0 n hadoop 0.20.2
> > > > > 
> > > > > When I run import command ie. 
> > > > > sqoop import --connect 
> > > > > 
> > > > > I got this error..
> > > > > 
> > > > > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > > 
> > > > > Please suggest.
> > > > 
> > >  		 	   		  
>  		 	   		  

RE: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by yogesh dhari <yo...@live.com>.
Hello Jarcec
I have correctly set the HADOOP_HOME
export HADOOP_HOME=/HADOOP/hadoop-0.20.2        (Here I have put the hadoop 0.20.2)export PATH=$HADOOP_HOME/bin:$PATH
and I am sorry I haven't got your point that hadoop jars are not present in the class path.Please explain it little bit.
Greetings Yogesh Kumar


> Date: Thu, 14 Jun 2012 14:22:15 +0200
> From: jarcec@apache.org
> To: user@sqoop.apache.org
> Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> 
> Hi Yogesh,
> I believe that this exception is thrown because hadoop jars are not present in the class path. Do you have correctly set up variable HADOOP_HOME pointing to your hadoop installation?
> 
> Jarcec
> 
> On Thu, Jun 14, 2012 at 05:18:54PM +0530, yogesh dhari wrote:
> > 
> > Hi Jarcec
> > Thanks a lot for helping.
> > I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
> > mediaadmins-iMac-2:~ mediaadmin$ sqoop help
> > Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> > 
> > Please suggest.
> > Regards Yogesh Kumar
> > > From: jarcec@apache.org
> > > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > Date: Wed, 13 Jun 2012 12:31:04 +0200
> > > To: user@sqoop.apache.org
> > > 
> > > Hi Yogesh,
> > > version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> > > 
> > > You can choose closes apache mirror on following web page:
> > > 
> > > http://www.apache.org/dyn/closer.cgi/sqoop/
> > > 
> > > Jarcec
> > > 
> > > On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> > > 
> > > > Hi Jagat, I am using 
> > > > Sqoop version 1.1.0 n hadoop 0.20.2
> > > > 
> > > > When I run import command ie. 
> > > > sqoop import --connect 
> > > > 
> > > > I got this error..
> > > > 
> > > > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > > 
> > > > Please suggest.
> > > 
> >  		 	   		  
 		 	   		  

Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Hi Yogesh,
I believe that this exception is thrown because hadoop jars are not present in the class path. Do you have correctly set up variable HADOOP_HOME pointing to your hadoop installation?

Jarcec

On Thu, Jun 14, 2012 at 05:18:54PM +0530, yogesh dhari wrote:
> 
> Hi Jarcec
> Thanks a lot for helping.
> I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
> mediaadmins-iMac-2:~ mediaadmin$ sqoop help
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> 
> Please suggest.
> Regards Yogesh Kumar
> > From: jarcec@apache.org
> > Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > Date: Wed, 13 Jun 2012 12:31:04 +0200
> > To: user@sqoop.apache.org
> > 
> > Hi Yogesh,
> > version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> > 
> > You can choose closes apache mirror on following web page:
> > 
> > http://www.apache.org/dyn/closer.cgi/sqoop/
> > 
> > Jarcec
> > 
> > On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> > 
> > > Hi Jagat, I am using 
> > > Sqoop version 1.1.0 n hadoop 0.20.2
> > > 
> > > When I run import command ie. 
> > > sqoop import --connect 
> > > 
> > > I got this error..
> > > 
> > > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > > 
> > > Please suggest.
> > 
>  		 	   		  

RE: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by yogesh dhari <yo...@live.com>.
Hi Jarcec
Thanks a lot for helping.
I have upgraded to 1.4.1-incubatingand after setting path i have tried to run "sqoop help" , but its showing this error;
mediaadmins-iMac-2:~ mediaadmin$ sqoop help
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getInstances(Ljava/lang/String;Ljava/lang/Class;)Ljava/util/List;    at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:139)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:210)    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)    at org.apache.sqoop.Sqoop.main(Sqoop.java:238)    at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)

Please suggest.
Regards Yogesh Kumar
> From: jarcec@apache.org
> Subject: Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> Date: Wed, 13 Jun 2012 12:31:04 +0200
> To: user@sqoop.apache.org
> 
> Hi Yogesh,
> version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?
> 
> You can choose closes apache mirror on following web page:
> 
> http://www.apache.org/dyn/closer.cgi/sqoop/
> 
> Jarcec
> 
> On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:
> 
> > Hi Jagat, I am using 
> > Sqoop version 1.1.0 n hadoop 0.20.2
> > 
> > When I run import command ie. 
> > sqoop import --connect 
> > 
> > I got this error..
> > 
> > ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> > 
> > Please suggest.
> 
 		 	   		  

Re: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Hi Yogesh,
version 1.1.0 is very old. Could you upgrade to the recent 1.4.1-incubating?

You can choose closes apache mirror on following web page:

http://www.apache.org/dyn/closer.cgi/sqoop/

Jarcec

On Jun 13, 2012, at 12:26 PM, yogesh dhari wrote:

> Hi Jagat, I am using 
> Sqoop version 1.1.0 n hadoop 0.20.2
> 
> When I run import command ie. 
> sqoop import --connect 
> 
> I got this error..
> 
> ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not find appropriate Hadoop shim for 0.20.2..
> 
> Please suggest.