You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Boglarka Egyed (JIRA)" <ji...@apache.org> on 2017/06/06 11:46:18 UTC

[jira] [Comment Edited] (SQOOP-3193) Sqoop comamnd to overwrite the table

    [ https://issues.apache.org/jira/browse/SQOOP-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038587#comment-16038587 ] 

Boglarka Egyed edited comment on SQOOP-3193 at 6/6/17 11:45 AM:
----------------------------------------------------------------

Hi [~jayanthir],

The version info doesn't seem to be correct as it refers to Sqoop2, however, the command you have provided is definitely a Sqoop1 as that one is the command line tool (Sqoop2 works differently). Could you please review it?

Based on the Sqoop User Guide --hive-overwrite will overwrite your table using a CREATE TABLE statement so I think the --create-hive-table command in your example is unnecessary and causes the already exists error message, please see:
https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_importing_data_into_hive

Cheers,
Bogi


was (Author: boglarkaegyed):
Hi [~jayanthir],

The version info doesn't seem to be correct as it refers to Sqoop2, however, the command you have provided is definitely a Sqoop1 as that one is the command line tool (Sqoop2 works differently).

Based on the Sqoop User Guide --hive-overwrite will overwrite your table using a CREATE TABLE statement so I think the --create-hive-table command in your example is unnecessary and causes the already exists error message, please see:
https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_importing_data_into_hive

Cheers,
Bogi

> Sqoop comamnd to overwrite the table
> ------------------------------------
>
>                 Key: SQOOP-3193
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3193
>             Project: Sqoop
>          Issue Type: Bug
>          Components: sqoop2-shell
>    Affects Versions: 1.99.7
>         Environment: linux
>            Reporter: Jayanthi R
>              Labels: features
>             Fix For: no-release
>
>
> I am using sqoop import command and I want to overwrite the data when I use it for second or third time (except the first time)
> sqoop import --connect jdbc:postgresql://reuxeuls677.bp.com/auditdb --username audit_user --password theaudituserloginpassword --table test_automation --hive-overwrite --hive-table sqoophive -m 1  --hive-import --hive-database 'test_automation_db' --create-hive-table --hive-table test_automation;
> But, I am getting the following error:
> 17/06/06 09:34:13 ERROR tool.ImportTool: Encountered IOException running import job: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://HDPEMDCPROD/user/dluser/test_automation already exists



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)