You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Andy Srine <an...@gmail.com> on 2014/03/27 01:08:03 UTC
Hadoop 2.0.5 V Hadoop 2.2.0
Friends,
Is there something different between using Sqoop with Hadoop 2.0.5 versus
2.2.0? I have 2 clusters that are very similar, but things work much better
in 2.2.0 and I see the following errors in 2.0.5. The only other difference
is, I do use non-default ports for SQOOP on the 2.0.5 cluster.
sqoop:000> show version --all
client version:
Sqoop 1.99.3 revision 2404393160301df16a94716a3034e31b03e27b0b
Compiled by mengweid on Fri Oct 18 14:15:53 EDT 2013
Exception has occurred during processing command
Exception: com.sun.jersey.api.client.ClientHandlerException Message:
java.net.ConnectException: Connection refused
2014-03-27 00:04:59,481 INFO mapreduce.MapreduceSubmissionEngine
[org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
Found hadoop configuration file mapred-site.xml
2014-03-27 00:04:59,482 INFO mapreduce.MapreduceSubmissionEngine
[org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
Found hadoop configuration file yarn-site.xml
2014-03-27 00:05:00,868 ERROR core.SqoopServer
[org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)] Server
startup failure
org.apache.sqoop.common.SqoopException: MAPREDUCE_0002:Failure on
submission engine initialization
at
org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:115)
at
org.apache.sqoop.framework.JobManager.initialize(JobManager.java:215)
at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:53)
at
org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:36)
at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4206)
at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4705)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
Thanks,
Andy
Re: Hadoop 2.0.5 V Hadoop 2.2.0
Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Hi Andy,
did you noticed the root exception in the log?
Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
Did you check Hadoop configuration? You can find more details how to configure Sqoop 2 server in our installation guide:
http://sqoop.apache.org/docs/1.99.3/Installation.html#configuring-server
Jarcec
On Mon, Mar 31, 2014 at 05:00:57PM -0700, Andy Srine wrote:
> Log attached. Thanks Jarek.
>
> Regards,
> Andy
>
>
>
> On Sat, Mar 29, 2014 at 8:43 AM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
>
> > I barely remember that some Sqoop 2 versions were not running on Hadoop
> > 2.0.4- due to MAPREDUCE-5240. But Hadoop 2.0.5 should be fine as far as I
> > remember.
> >
> > Would you mind checking the server log and sharing with us the entire
> > exception? The shared text seems to be truncate as there is no "Caused by"
> > section.
> >
> > Jarcec
> >
> > On Wed, Mar 26, 2014 at 05:08:03PM -0700, Andy Srine wrote:
> > > Friends,
> > >
> > > Is there something different between using Sqoop with Hadoop 2.0.5 versus
> > > 2.2.0? I have 2 clusters that are very similar, but things work much
> > better
> > > in 2.2.0 and I see the following errors in 2.0.5. The only other
> > difference
> > > is, I do use non-default ports for SQOOP on the 2.0.5 cluster.
> > >
> > > sqoop:000> show version --all
> > >
> > > client version:
> > >
> > > Sqoop 1.99.3 revision 2404393160301df16a94716a3034e31b03e27b0b
> > >
> > > Compiled by mengweid on Fri Oct 18 14:15:53 EDT 2013
> > >
> > > Exception has occurred during processing command
> > >
> > > Exception: com.sun.jersey.api.client.ClientHandlerException Message:
> > > java.net.ConnectException: Connection refused
> > >
> > >
> > >
> > > 2014-03-27 00:04:59,481 INFO mapreduce.MapreduceSubmissionEngine
> > >
> > [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
> > > Found hadoop configuration file mapred-site.xml
> > >
> > > 2014-03-27 00:04:59,482 INFO mapreduce.MapreduceSubmissionEngine
> > >
> > [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
> > > Found hadoop configuration file yarn-site.xml
> > >
> > > 2014-03-27 00:05:00,868 ERROR core.SqoopServer
> > > [org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)]
> > Server
> > > startup failure
> > >
> > > org.apache.sqoop.common.SqoopException: MAPREDUCE_0002:Failure on
> > > submission engine initialization
> > >
> > > at
> > >
> > org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:115)
> > >
> > > at
> > > org.apache.sqoop.framework.JobManager.initialize(JobManager.java:215)
> > >
> > > at
> > org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:53)
> > >
> > > at
> > >
> > org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:36)
> > >
> > > at
> > >
> > org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4206)
> > >
> > > at
> > > org.apache.catalina.core.StandardContext.start(StandardContext.java:4705)
> > >
> > > at
> > >
> > org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
> > >
> > > at
> > > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
> > >
> > >
> > >
> > > Thanks,
> > > Andy
> >
>
>
>
> --
> Thanks,
> Andy
Re: Hadoop 2.0.5 V Hadoop 2.2.0
Posted by Andy Srine <an...@gmail.com>.
Log attached. Thanks Jarek.
Regards,
Andy
On Sat, Mar 29, 2014 at 8:43 AM, Jarek Jarcec Cecho <ja...@apache.org>wrote:
> I barely remember that some Sqoop 2 versions were not running on Hadoop
> 2.0.4- due to MAPREDUCE-5240. But Hadoop 2.0.5 should be fine as far as I
> remember.
>
> Would you mind checking the server log and sharing with us the entire
> exception? The shared text seems to be truncate as there is no "Caused by"
> section.
>
> Jarcec
>
> On Wed, Mar 26, 2014 at 05:08:03PM -0700, Andy Srine wrote:
> > Friends,
> >
> > Is there something different between using Sqoop with Hadoop 2.0.5 versus
> > 2.2.0? I have 2 clusters that are very similar, but things work much
> better
> > in 2.2.0 and I see the following errors in 2.0.5. The only other
> difference
> > is, I do use non-default ports for SQOOP on the 2.0.5 cluster.
> >
> > sqoop:000> show version --all
> >
> > client version:
> >
> > Sqoop 1.99.3 revision 2404393160301df16a94716a3034e31b03e27b0b
> >
> > Compiled by mengweid on Fri Oct 18 14:15:53 EDT 2013
> >
> > Exception has occurred during processing command
> >
> > Exception: com.sun.jersey.api.client.ClientHandlerException Message:
> > java.net.ConnectException: Connection refused
> >
> >
> >
> > 2014-03-27 00:04:59,481 INFO mapreduce.MapreduceSubmissionEngine
> >
> [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
> > Found hadoop configuration file mapred-site.xml
> >
> > 2014-03-27 00:04:59,482 INFO mapreduce.MapreduceSubmissionEngine
> >
> [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
> > Found hadoop configuration file yarn-site.xml
> >
> > 2014-03-27 00:05:00,868 ERROR core.SqoopServer
> > [org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)]
> Server
> > startup failure
> >
> > org.apache.sqoop.common.SqoopException: MAPREDUCE_0002:Failure on
> > submission engine initialization
> >
> > at
> >
> org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:115)
> >
> > at
> > org.apache.sqoop.framework.JobManager.initialize(JobManager.java:215)
> >
> > at
> org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:53)
> >
> > at
> >
> org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:36)
> >
> > at
> >
> org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4206)
> >
> > at
> > org.apache.catalina.core.StandardContext.start(StandardContext.java:4705)
> >
> > at
> >
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
> >
> > at
> > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
> >
> >
> >
> > Thanks,
> > Andy
>
--
Thanks,
Andy
Re: Hadoop 2.0.5 V Hadoop 2.2.0
Posted by Jarek Jarcec Cecho <ja...@apache.org>.
I barely remember that some Sqoop 2 versions were not running on Hadoop 2.0.4- due to MAPREDUCE-5240. But Hadoop 2.0.5 should be fine as far as I remember.
Would you mind checking the server log and sharing with us the entire exception? The shared text seems to be truncate as there is no "Caused by" section.
Jarcec
On Wed, Mar 26, 2014 at 05:08:03PM -0700, Andy Srine wrote:
> Friends,
>
> Is there something different between using Sqoop with Hadoop 2.0.5 versus
> 2.2.0? I have 2 clusters that are very similar, but things work much better
> in 2.2.0 and I see the following errors in 2.0.5. The only other difference
> is, I do use non-default ports for SQOOP on the 2.0.5 cluster.
>
> sqoop:000> show version --all
>
> client version:
>
> Sqoop 1.99.3 revision 2404393160301df16a94716a3034e31b03e27b0b
>
> Compiled by mengweid on Fri Oct 18 14:15:53 EDT 2013
>
> Exception has occurred during processing command
>
> Exception: com.sun.jersey.api.client.ClientHandlerException Message:
> java.net.ConnectException: Connection refused
>
>
>
> 2014-03-27 00:04:59,481 INFO mapreduce.MapreduceSubmissionEngine
> [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
> Found hadoop configuration file mapred-site.xml
>
> 2014-03-27 00:04:59,482 INFO mapreduce.MapreduceSubmissionEngine
> [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:100)]
> Found hadoop configuration file yarn-site.xml
>
> 2014-03-27 00:05:00,868 ERROR core.SqoopServer
> [org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)] Server
> startup failure
>
> org.apache.sqoop.common.SqoopException: MAPREDUCE_0002:Failure on
> submission engine initialization
>
> at
> org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:115)
>
> at
> org.apache.sqoop.framework.JobManager.initialize(JobManager.java:215)
>
> at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:53)
>
> at
> org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:36)
>
> at
> org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4206)
>
> at
> org.apache.catalina.core.StandardContext.start(StandardContext.java:4705)
>
> at
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
>
> at
> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
>
>
>
> Thanks,
> Andy