You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@tez.apache.org by Snehal B <bs...@gmail.com> on 2018/02/14 06:21:05 UTC

Tez jobs created by Sqoop are getting killed

Hi,

I am trying to run the Tez job for importing data from postgres database to
Hive table via Sqoop command and continuously seeing Tez jobs getting
failed. Below is the Sqoop command:



sqoop import --connect jdbc:postgresql://************.
us-east-1.rds.amazonaws.com:5432/newdb --table t1 --username ****
--password ***** --direct --hive-import --hive-overwrite --split-by id
--verbose



At the end, Tez purposely kills the yarn job because it cannot connect to
the AM with the below INFO statement :

17/07/20 05:33:56 INFO client.TezClient: Shutting down Tez Session,
sessionName=HIVE-0a1c30f0-4ab5-4bf1-9b98-79d462deb53d,
applicationId=application_1495052092751_127259

17/07/20 05:33:56 INFO client.TezClient: Could not connect to AM, killing
session via YARN, sessionName=HIVE-0a1c30f0-4ab5-4bf1-9b98-79d462deb53d,
applicationId=application_1495052092751_127259



I am able to get my data to Hive but can see a lot of above errors which
are annoying. Do we have any workaround or a way to suppress these errors?


Thanks & Regards!

Re: Tez jobs created by Sqoop are getting killed

Posted by Jonathan Eagles <je...@gmail.com>.

Thanks for reporting this. The best way to diagnose this is to post the AM
logs. The client logs show there was an error connecting to the application
master (AM) process. Likely it was unable to startup correctly, and the AM
logs will show why.

Regards,
Jon

On Feb 14, 2018 12:21 AM, "Snehal B" <bs...@gmail.com> wrote:

> Hi,
>
> I am trying to run the Tez job for importing data from postgres database
> to Hive table via Sqoop command and continuously seeing Tez jobs getting
> failed. Below is the Sqoop command:
>
>
>
> sqoop import --connect jdbc:postgresql://************.
> us-east-1.rds.amazonaws.com:5432/newdb --table t1 --username ****
> --password ***** --direct --hive-import --hive-overwrite --split-by id
> --verbose
>
>
>
> At the end, Tez purposely kills the yarn job because it cannot connect to
> the AM with the below INFO statement :
>
> 17/07/20 05:33:56 INFO client.TezClient: Shutting down Tez Session,
> sessionName=HIVE-0a1c30f0-4ab5-4bf1-9b98-79d462deb53d,
> applicationId=application_1495052092751_127259
>
> 17/07/20 05:33:56 INFO client.TezClient: Could not connect to AM, killing
> session via YARN, sessionName=HIVE-0a1c30f0-4ab5-4bf1-9b98-79d462deb53d,
> applicationId=application_1495052092751_127259
>
>
>
> I am able to get my data to Hive but can see a lot of above errors which
> are annoying. Do we have any workaround or a way to suppress these errors?
>
>
> Thanks & Regards!
>