You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "Keith Turner (Created) (JIRA)" <ji...@apache.org> on 2012/02/15 23:58:00 UTC

[jira] [Created] (ACCUMULO-410) Bulk import may copy successful files into fail dir

Bulk import may copy successful files into fail dir
---------------------------------------------------

                 Key: ACCUMULO-410
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-410
             Project: Accumulo
          Issue Type: Bug
            Reporter: Keith Turner


The bulk import FATE operation LoadFile bulk imports files and copies failed files.  If master dies in the middle of coping the failed files, when it restarts it will start the FATE op from the beginning.  In this situation previously failed files could succeed.  However the failed files would still be in the fail dir.  To overcome this the copying for failed files could be a follow on FATE op, of the FATE op could clear the failed dir before copying to make idempotent. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (ACCUMULO-410) Bulk import may copy successful files into fail dir

Posted by "Keith Turner (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/ACCUMULO-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Keith Turner updated ACCUMULO-410:
----------------------------------

    Fix Version/s:     (was: 1.4.0)
                   1.4.1
    
> Bulk import may copy successful files into fail dir
> ---------------------------------------------------
>
>                 Key: ACCUMULO-410
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-410
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master
>            Reporter: Keith Turner
>             Fix For: 1.4.1
>
>
> The bulk import FATE operation LoadFile bulk imports files and copies failed files.  If master dies in the middle of coping the failed files, when it restarts it will start the FATE op from the beginning.  In this situation previously failed files could succeed.  However the failed files would still be in the fail dir.  To overcome this the copying for failed files could be a follow on FATE op, of the FATE op could clear the failed dir before copying to make idempotent. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (ACCUMULO-410) Bulk import may copy successful files into fail dir

Posted by "Keith Turner (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/ACCUMULO-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Keith Turner updated ACCUMULO-410:
----------------------------------

      Component/s: master
    Fix Version/s: 1.4.0
    
> Bulk import may copy successful files into fail dir
> ---------------------------------------------------
>
>                 Key: ACCUMULO-410
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-410
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master
>            Reporter: Keith Turner
>             Fix For: 1.4.0
>
>
> The bulk import FATE operation LoadFile bulk imports files and copies failed files.  If master dies in the middle of coping the failed files, when it restarts it will start the FATE op from the beginning.  In this situation previously failed files could succeed.  However the failed files would still be in the fail dir.  To overcome this the copying for failed files could be a follow on FATE op, of the FATE op could clear the failed dir before copying to make idempotent. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira