You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Dan Richelson (JIRA)" <ji...@apache.org> on 2012/12/08 00:57:22 UTC
[jira] [Comment Edited] (SQOOP-360) Duplication of the record in
the case of using import mode
[ https://issues.apache.org/jira/browse/SQOOP-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526894#comment-13526894 ]
Dan Richelson edited comment on SQOOP-360 at 12/7/12 11:56 PM:
---------------------------------------------------------------
I too am having this problem with an import from Postgresql 8.4. I am specifying 30 mappers and using a "split-by" operator. I'm using Sqoop 1.4.1 (CDH4.0.1)
was (Author: drichelson):
I too am having this problem with an import from Postgresql 8.4. I am specifying 30 mappers and using a "split-by" operator.
> Duplication of the record in the case of using import mode
> -----------------------------------------------------------
>
> Key: SQOOP-360
> URL: https://issues.apache.org/jira/browse/SQOOP-360
> Project: Sqoop
> Issue Type: Bug
> Components: connectors
> Affects Versions: 1.3.0
> Reporter: SATOSHI KONDO
> Labels: patch
> Attachments: SQOOP-360.patch
>
>
> When I use Import mode of Sqoop,
> I get duplicate records.
> This occurs on condition of the following.
> 1.Use Import mode of Sqoop
> 2.Set a character type to "split-by" parameter
> 3.Set a big value to "num-mappers" parameter
> The big value is a relatively large thing as compared with the total number of records.
> For example,
> when total number of records is 10,
> I set 100 to "num-mappers" parameter.
> I expect to get 10 records.
> But I get 10 or more lines.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira