You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2012/10/12 23:11:02 UTC

[jira] [Resolved] (SQOOP-360) Duplication of the record in the case of using import mode

     [ https://issues.apache.org/jira/browse/SQOOP-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Jarcec Cecho resolved SQOOP-360.
--------------------------------------

    Resolution: Not A Problem

Hi Satoshi,
I've tried this scenario on recent 1.4.2 version I wasn't able to reproduce the malfunction. Even in case of 100 mappers, sqoop imported only 10 rows as expected. I'm closing this issue for now, however please do not hesitate to reopen it if needed!

Also I've noticed that your patch seems to be more general then is scope of this issue. If you wish to proceed with it, please file a new JIRA, rebase your patch to current trunk and upload it to review board. I'll be more then happy to review it!

Jarcec
                
> Duplication of the record in the case of using import mode 
> -----------------------------------------------------------
>
>                 Key: SQOOP-360
>                 URL: https://issues.apache.org/jira/browse/SQOOP-360
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors
>    Affects Versions: 1.3.0
>            Reporter: SATOSHI KONDO
>              Labels: patch
>         Attachments: SQOOP-360.patch
>
>
> When I use Import mode of Sqoop,
> I get duplicate records.
> This occurs on condition of the following. 
> 1.Use Import mode of Sqoop
> 2.Set a character type to "split-by" parameter 
> 3.Set a big value to "num-mappers" parameter
> The big value is a relatively large thing as compared with the total number of records. 
> For example, 
> when total number of records is 10,
> I set 100 to "num-mappers" parameter.
> I expect to get 10 records.
> But I get 10 or more lines.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira