You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Firas Khasawneh <Fi...@sas.com> on 2013/10/17 21:24:09 UTC
Sqoop hangs
Hi,
When importing from a Postgres database, sqoop hangs and never exists unless I kill it from the command line. Any help regarding this? I am not seeing any errors or log files for sqoop.
Thanks,
Firas
Re: Sqoop hangs
Posted by Abraham Elmahrek <ab...@cloudera.com>.
Firas,
Happy to hear things are working.
-Abe
On Fri, Oct 18, 2013 at 5:37 AM, Firas Khasawneh <Fi...@sas.com>wrote:
> Hi Abraham,****
>
> ** **
>
> I am not sure what happened but my machine restarted because of a patch
> update last night. After I rebooted my virtual box and restarted hadoop and
> sqoop, everything worked just fine including import into hdfs and hive.***
> *
>
> Regarding using –verbose flag, it really did not make a difference. Also
> nothing was displayed in the logs (actually there are no logs I can see for
> sqoop). Regarding hadoop, this is the binary distribution that I just
> untarred in a directory, I don’t see any separate****
>
> Mapreduce directory.****
>
> ** **
>
> Thanks,
> Firas ****
>
> ** **
>
> ** **
>
> *From:* Abraham Elmahrek [mailto:abe@cloudera.com]
> *Sent:* Thursday, October 17, 2013 10:22 PM
>
> *To:* user@sqoop.apache.org
> *Subject:* Re: Sqoop hangs****
>
> ** **
>
> Firas,****
>
> ** **
>
> That setting should point to the location of your hadoop mapreduce
> installation (ie. /usr/lib/hadoop-0.20-mapreduce).****
>
> ** **
>
> Sqoop uses MapReduce to distribute the transfer of data. This means that a
> MapReduce job will be created and several tasks to perform the work. Could
> you please inspect your job tracker and task logs? Also, remember to run
> your sqoop job with the "verbose" (--verbose) command to get the most out
> of logging.****
>
> ** **
>
> If you're still having difficulty, please provide your sqoop log, job
> tracker log, and relevant task logs.****
>
> ** **
>
> -Abe****
>
> ** **
>
> On Thu, Oct 17, 2013 at 1:09 PM, Firas Khasawneh <Fi...@sas.com>
> wrote:****
>
> Hi Abraham,****
>
> ****
>
> I am using hadoop 1.2.1. In my path, the only doubt, I have is the setting
> of HADOOP_MAPRED_HOME. I tried to set it to hadoop home, to /tmp and to a
> directory that does not exist. I am still not getting any errors. It just
> hangs and never come back.****
>
> ****
>
> Thanks,****
>
> Firas ****
>
> ****
>
> *From:* Firas Khasawneh
> *Sent:* Thursday, October 17, 2013 3:57 PM
> *To:* user@sqoop.apache.org
> *Subject:* RE: Sqoop hangs****
>
> ****
>
> Hi Abraham,****
>
> ****
>
> I am using Postgres 9.1 on Ubuntu. Nothing in the logs. I am also able to
> do table-list from sqoop.****
>
> ****
>
> Thanks,****
>
> Firas****
>
> ****
>
> *From:* Abraham Elmahrek [mailto:abe@cloudera.com <ab...@cloudera.com>]
> *Sent:* Thursday, October 17, 2013 3:50 PM
> *To:* user@sqoop.apache.org
> *Subject:* Re: Sqoop hangs****
>
> ****
>
> Firas,****
>
> ****
>
> Have you checked your postgresql logs? The database could be in a
> deadlock. Also, what version of PostGreSQL are you running?****
>
> ****
>
> -Abe****
>
> ****
>
> On Thu, Oct 17, 2013 at 12:24 PM, Firas Khasawneh <Fi...@sas.com>
> wrote:****
>
> Hi,****
>
> ****
>
> When importing from a Postgres database, sqoop hangs and never exists
> unless I kill it from the command line. Any help regarding this? I am not
> seeing any errors or log files for sqoop.****
>
> ****
>
> Thanks,****
>
> Firas****
>
> ****
>
> ****
>
> ** **
>
RE: Sqoop hangs
Posted by Firas Khasawneh <Fi...@sas.com>.
Hi Abraham,
I am not sure what happened but my machine restarted because of a patch update last night. After I rebooted my virtual box and restarted hadoop and sqoop, everything worked just fine including import into hdfs and hive.
Regarding using -verbose flag, it really did not make a difference. Also nothing was displayed in the logs (actually there are no logs I can see for sqoop). Regarding hadoop, this is the binary distribution that I just untarred in a directory, I don't see any separate
Mapreduce directory.
Thanks,
Firas
From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: Thursday, October 17, 2013 10:22 PM
To: user@sqoop.apache.org
Subject: Re: Sqoop hangs
Firas,
That setting should point to the location of your hadoop mapreduce installation (ie. /usr/lib/hadoop-0.20-mapreduce).
Sqoop uses MapReduce to distribute the transfer of data. This means that a MapReduce job will be created and several tasks to perform the work. Could you please inspect your job tracker and task logs? Also, remember to run your sqoop job with the "verbose" (--verbose) command to get the most out of logging.
If you're still having difficulty, please provide your sqoop log, job tracker log, and relevant task logs.
-Abe
On Thu, Oct 17, 2013 at 1:09 PM, Firas Khasawneh <Fi...@sas.com>> wrote:
Hi Abraham,
I am using hadoop 1.2.1. In my path, the only doubt, I have is the setting of HADOOP_MAPRED_HOME. I tried to set it to hadoop home, to /tmp and to a directory that does not exist. I am still not getting any errors. It just hangs and never come back.
Thanks,
Firas
From: Firas Khasawneh
Sent: Thursday, October 17, 2013 3:57 PM
To: user@sqoop.apache.org<ma...@sqoop.apache.org>
Subject: RE: Sqoop hangs
Hi Abraham,
I am using Postgres 9.1 on Ubuntu. Nothing in the logs. I am also able to do table-list from sqoop.
Thanks,
Firas
From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: Thursday, October 17, 2013 3:50 PM
To: user@sqoop.apache.org<ma...@sqoop.apache.org>
Subject: Re: Sqoop hangs
Firas,
Have you checked your postgresql logs? The database could be in a deadlock. Also, what version of PostGreSQL are you running?
-Abe
On Thu, Oct 17, 2013 at 12:24 PM, Firas Khasawneh <Fi...@sas.com>> wrote:
Hi,
When importing from a Postgres database, sqoop hangs and never exists unless I kill it from the command line. Any help regarding this? I am not seeing any errors or log files for sqoop.
Thanks,
Firas
Re: Sqoop hangs
Posted by Abraham Elmahrek <ab...@cloudera.com>.
Firas,
That setting should point to the location of your hadoop mapreduce
installation (ie. /usr/lib/hadoop-0.20-mapreduce).
Sqoop uses MapReduce to distribute the transfer of data. This means that a
MapReduce job will be created and several tasks to perform the work. Could
you please inspect your job tracker and task logs? Also, remember to run
your sqoop job with the "verbose" (--verbose) command to get the most out
of logging.
If you're still having difficulty, please provide your sqoop log, job
tracker log, and relevant task logs.
-Abe
On Thu, Oct 17, 2013 at 1:09 PM, Firas Khasawneh <Fi...@sas.com>wrote:
> Hi Abraham,****
>
> ** **
>
> I am using hadoop 1.2.1. In my path, the only doubt, I have is the setting
> of HADOOP_MAPRED_HOME. I tried to set it to hadoop home, to /tmp and to a
> directory that does not exist. I am still not getting any errors. It just
> hangs and never come back.****
>
> ** **
>
> Thanks,****
>
> Firas ****
>
> ** **
>
> *From:* Firas Khasawneh
> *Sent:* Thursday, October 17, 2013 3:57 PM
> *To:* user@sqoop.apache.org
> *Subject:* RE: Sqoop hangs****
>
> ** **
>
> Hi Abraham,****
>
> ** **
>
> I am using Postgres 9.1 on Ubuntu. Nothing in the logs. I am also able to
> do table-list from sqoop.****
>
> ** **
>
> Thanks,****
>
> Firas****
>
> ** **
>
> *From:* Abraham Elmahrek [mailto:abe@cloudera.com <ab...@cloudera.com>]
> *Sent:* Thursday, October 17, 2013 3:50 PM
> *To:* user@sqoop.apache.org
> *Subject:* Re: Sqoop hangs****
>
> ** **
>
> Firas,****
>
> ** **
>
> Have you checked your postgresql logs? The database could be in a
> deadlock. Also, what version of PostGreSQL are you running?****
>
> ** **
>
> -Abe****
>
> ** **
>
> On Thu, Oct 17, 2013 at 12:24 PM, Firas Khasawneh <Fi...@sas.com>
> wrote:****
>
> Hi,****
>
> ****
>
> When importing from a Postgres database, sqoop hangs and never exists
> unless I kill it from the command line. Any help regarding this? I am not
> seeing any errors or log files for sqoop.****
>
> ****
>
> Thanks,****
>
> Firas****
>
> ****
>
> ** **
>
RE: Sqoop hangs
Posted by Firas Khasawneh <Fi...@sas.com>.
Hi Abraham,
I am using hadoop 1.2.1. In my path, the only doubt, I have is the setting of HADOOP_MAPRED_HOME. I tried to set it to hadoop home, to /tmp and to a directory that does not exist. I am still not getting any errors. It just hangs and never come back.
Thanks,
Firas
From: Firas Khasawneh
Sent: Thursday, October 17, 2013 3:57 PM
To: user@sqoop.apache.org
Subject: RE: Sqoop hangs
Hi Abraham,
I am using Postgres 9.1 on Ubuntu. Nothing in the logs. I am also able to do table-list from sqoop.
Thanks,
Firas
From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: Thursday, October 17, 2013 3:50 PM
To: user@sqoop.apache.org<ma...@sqoop.apache.org>
Subject: Re: Sqoop hangs
Firas,
Have you checked your postgresql logs? The database could be in a deadlock. Also, what version of PostGreSQL are you running?
-Abe
On Thu, Oct 17, 2013 at 12:24 PM, Firas Khasawneh <Fi...@sas.com>> wrote:
Hi,
When importing from a Postgres database, sqoop hangs and never exists unless I kill it from the command line. Any help regarding this? I am not seeing any errors or log files for sqoop.
Thanks,
Firas
RE: Sqoop hangs
Posted by Firas Khasawneh <Fi...@sas.com>.
Hi Abraham,
I am using Postgres 9.1 on Ubuntu. Nothing in the logs. I am also able to do table-list from sqoop.
Thanks,
Firas
From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: Thursday, October 17, 2013 3:50 PM
To: user@sqoop.apache.org
Subject: Re: Sqoop hangs
Firas,
Have you checked your postgresql logs? The database could be in a deadlock. Also, what version of PostGreSQL are you running?
-Abe
On Thu, Oct 17, 2013 at 12:24 PM, Firas Khasawneh <Fi...@sas.com>> wrote:
Hi,
When importing from a Postgres database, sqoop hangs and never exists unless I kill it from the command line. Any help regarding this? I am not seeing any errors or log files for sqoop.
Thanks,
Firas
Re: Sqoop hangs
Posted by Abraham Elmahrek <ab...@cloudera.com>.
Firas,
Have you checked your postgresql logs? The database could be in a deadlock.
Also, what version of PostGreSQL are you running?
-Abe
On Thu, Oct 17, 2013 at 12:24 PM, Firas Khasawneh
<Fi...@sas.com>wrote:
> Hi,****
>
> ** **
>
> When importing from a Postgres database, sqoop hangs and never exists
> unless I kill it from the command line. Any help regarding this? I am not
> seeing any errors or log files for sqoop.****
>
> ** **
>
> Thanks,****
>
> Firas****
>
> ** **
>