You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Eric Lin (JIRA)" <ji...@apache.org> on 2017/04/15 03:17:41 UTC

[jira] [Updated] (SQOOP-3158) Columns added to Mysql after initial sqoop import, export back to table with same schema fails

     [ https://issues.apache.org/jira/browse/SQOOP-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Lin updated SQOOP-3158:
----------------------------
    Attachment: SQOOP-3158.patch

Attaching PATCH for this issue. Basically we need to check if there are more data for the current row, and if nothing, assign "null" value to it, so that NULL value will be entered into table.

However, if the column itself is defined as NOT NULL in MySQL, the export will still fail. This should be expected.

> Columns added to Mysql after initial sqoop import, export back to table with same schema fails 
> -----------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-3158
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3158
>             Project: Sqoop
>          Issue Type: Improvement
>            Reporter: viru reddy
>            Assignee: Eric Lin
>              Labels: newbie
>         Attachments: SQOOP-3158.patch
>
>
> I have table in MySQL with 2 columns until yesterday. The columns are id and name.
> 1,Raj
> 2,Jack
> I have imported this data into HDFS yesterday itself as a file. Today we added a new column to the table in MySQL called salary. The table looks like below.
> 1,Raj
> 2,Jack
> 3,Jill,2000
> 4,Nick,3000
> Now I have done Incremental import on this table as a file.
> Part-m-00000 file contains
> 1,Raj
> 2,Jack
> Part-m-00001 file contains
> 3,Jill,2000
> 4,Nick,3000
> Now I created a new table in MySQL with same schema as Original MySQL table with columns id name and salary.
> When I do sqoop export only last 2 rows are getting inserted to the new table in MySQL  and the sqoop export fails
> How can I reflect all the rows to be inserted to the table.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)