You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@allura.apache.org by Jorge Martín <jo...@users.sf.net> on 2013/10/18 14:42:51 UTC
[allura:tickets] Re: #6769 Make GC Issues importer resilient to upstream
changes mid-import
Hello, please admin, unsubscribe me from this mailiing list.
Thanks in advance.
On Fri, Oct 18, 2013 at 1:40 PM, Cory Johns <ma...@users.sf.net>wrote:
>
> - *QA*: Wayne Witzel ❸
>
> ------------------------------
>
> * [tickets:#6769] <http://sourceforge.net/p/allura/tickets/6769/> Make GC
> Issues importer resilient to upstream changes mid-import*
>
> *Status:* code-review
> *Labels:* import google-code
> *Created:* Thu Oct 17, 2013 09:42 PM UTC by Cory Johns
> *Last Updated:* Thu Oct 17, 2013 11:21 PM UTC
> *Owner:* Cory Johns
>
> For long imports, tickets could be added, removed, or made private
> upstream while the import is running. This can cause the list of ticket
> numbers to change, and since they're not all pre-loaded, there is a higher
> chance of this happening and causing DuplicateKeyErrors.
>
> Change iter_issues to:
>
> - Pull in all issue IDs prior to importing any tickets (this will
> reduce the window for changes)
> - Iterate the issue IDs in increasing order instead of the current
> random order (this will prevent adding new tickets, the most likely change,
> from causing problems)
> - Remove any duplicates from the list of issue IDs caused by tickets
> that were deleted or marked private
> - Once the import is completed, check for any newly added issues
>
> ------------------------------
>
> Sent from sourceforge.net because allura-dev@incubator.apache.org is
> subscribed to https://sourceforge.net/p/allura/tickets/
>
> To unsubscribe from further messages, a project admin can change settings
> at https://sourceforge.net/p/allura/admin/tickets/options. Or, if this is
> a mailing list, you can unsubscribe from the mailing list.
>
--
Jorge Martín
Fundación CENATIC
Centro Nacional de Referencia de Aplicación de las TIC basadas en
fuentes abiertas / National Competency Centre for the application of
open source technologies
Avenida Clara Campoamor s/n
06200 Almendralejo (Badajoz)
Tlf +34 924 677 316
Fax +34 924 666 896
jorge.martin@cenatic.es
http://www.cenatic.es
Sus datos figuran en un fichero automatizado propiedad de "Fundación
CENATIC". Si desea acceder a sus datos, rectificarlos, cancelarlos u
oponerse a su tratamiento, diríjase a "Fundación CENATIC",
AvenidaClara Campoamor s/n, de Almendralejo, provincia de Badajoz,
C.P. 06200, o enviando un email a legal@cenatic.es
--
---------------------------------------------------------------------------------------------------------
Correo Corporativo Fundación Cenatic
Este email ha sido enviado desde una plataforma perteneciente a la
Fundación Cenatic
Cualquier duda o modificacion contactar con Fundación Cenatic
+34 924 67 73 16
info@cenatic.es
---
** [tickets:#6769] Make GC Issues importer resilient to upstream changes mid-import**
**Status:** closed
**Labels:** import google-code
**Created:** Thu Oct 17, 2013 09:42 PM UTC by Cory Johns
**Last Updated:** Fri Oct 18, 2013 11:54 AM UTC
**Owner:** Cory Johns
For long imports, tickets could be added, removed, or made private upstream while the import is running. This can cause the list of ticket numbers to change, and since they're not all pre-loaded, there is a higher chance of this happening and causing `DuplicateKeyError`s.
Change `iter_issues` to:
* Pull in all issue IDs prior to importing any tickets (this will reduce the window for changes)
* Iterate the issue IDs in increasing order instead of the current random order (this will prevent adding new tickets, the most likely change, from causing problems)
* Remove any duplicates from the list of issue IDs caused by tickets that were deleted or marked private
* Once the import is completed, check for any newly added issues
---
Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to http://sourceforge.net/p/allura/tickets/
To unsubscribe from further messages, a project admin can change settings at http://sourceforge.net/p/allura/admin/tickets/options. Or, if this is a mailing list, you can unsubscribe from the mailing list.