You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@sqoop.apache.org by "Veena Basavaraj (JIRA)" <ji...@apache.org> on 2015/01/10 18:15:34 UTC

[jira] [Updated] (SQOOP-2001) Sqoop2 Kite connector might produce duplicate values when retrying failed tasks.

     [ https://issues.apache.org/jira/browse/SQOOP-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Veena Basavaraj updated SQOOP-2001:
-----------------------------------
    Fix Version/s: 2.0.0

> Sqoop2 Kite connector might produce duplicate values when retrying failed tasks.
> --------------------------------------------------------------------------------
>
>                 Key: SQOOP-2001
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2001
>             Project: Sqoop
>          Issue Type: Bug
>            Reporter: Ryan Blue
>             Fix For: 2.0.0
>
>
> This happens (as I understand things) because Kite may make files visible before a task is completed or committed in the combined temporary dataset directory. We should be able to avoid this by setting the temporary dataset's writer cache limit to something huge - so files are not closed until the overall writer is closed, no matter how many files are open.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)