You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Dan Richelson (JIRA)" <ji...@apache.org> on 2012/12/08 00:57:22 UTC

[jira] [Comment Edited] (SQOOP-360) Duplication of the record in the case of using import mode

    [ https://issues.apache.org/jira/browse/SQOOP-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526894#comment-13526894 ] 

Dan Richelson edited comment on SQOOP-360 at 12/7/12 11:56 PM:
---------------------------------------------------------------

I too am having this problem with an import from Postgresql 8.4. I am specifying 30 mappers and using a "split-by" operator. I'm using Sqoop 1.4.1 (CDH4.0.1)
                
      was (Author: drichelson):
    I too am having this problem with an import from Postgresql 8.4. I am specifying 30 mappers and using a "split-by" operator.
                  
> Duplication of the record in the case of using import mode 
> -----------------------------------------------------------
>
>                 Key: SQOOP-360
>                 URL: https://issues.apache.org/jira/browse/SQOOP-360
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors
>    Affects Versions: 1.3.0
>            Reporter: SATOSHI KONDO
>              Labels: patch
>         Attachments: SQOOP-360.patch
>
>
> When I use Import mode of Sqoop,
> I get duplicate records.
> This occurs on condition of the following. 
> 1.Use Import mode of Sqoop
> 2.Set a character type to "split-by" parameter 
> 3.Set a big value to "num-mappers" parameter
> The big value is a relatively large thing as compared with the total number of records. 
> For example, 
> when total number of records is 10,
> I set 100 to "num-mappers" parameter.
> I expect to get 10 records.
> But I get 10 or more lines.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira