You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@maven.apache.org by "Milos Kleint (JIRA)" <ji...@codehaus.org> on 2007/11/05 16:50:35 UTC

[jira] Created: (MRM-578) unfinished scanning after NPE

unfinished scanning after NPE
-----------------------------

                 Key: MRM-578
                 URL: http://jira.codehaus.org/browse/MRM-578
             Project: Archiva
          Issue Type: Bug
          Components: repository scanning
    Affects Versions: 1.0-beta-3
         Environment: macosx 1.4, jdk 1.5, archiva beta3
            Reporter: Milos Kleint
         Attachments: error.txt

I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (MRM-578) unfinished scanning after NPE

Posted by "Milos Kleint (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milos Kleint updated MRM-578:
-----------------------------

    Attachment: error2.txt

yet another attempt to index repository

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.0-beta-4
>
>         Attachments: error.txt, error2.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MRM-578) unfinished scanning after NPE

Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_113429 ] 

Brett Porter commented on MRM-578:
----------------------------------

I was able to scan 71% of the repository successfully (up to org.apache.something) before I needed to shutdown and leave. It was going very slowly, but successfully. Postponing for further investigation

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.1
>
>         Attachments: error.txt, error2.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MRM-578) unfinished scanning after NPE

Posted by "Milos Kleint (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_113274 ] 

Milos Kleint commented on MRM-578:
----------------------------------

how do I start with a clean table? i've deleted ~/.m2/archiva then the data/archiva folder and .index in the repository directory.
I always need to start archiva once, it complains on the console about missing tables, I shut it down, start again and trigger the scanning..

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.0-beta-4
>
>         Attachments: error.txt, error2.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (MRM-578) unfinished scanning after NPE

Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maria Odea Ching updated MRM-578:
---------------------------------

    Fix Version/s:     (was: 1.0-beta-4)
                   1.0

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.0
>
>         Attachments: error.txt, error2.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (MRM-578) unfinished scanning after NPE

Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brett Porter updated MRM-578:
-----------------------------

    Fix Version/s: 1.0-beta-4

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.0-beta-4
>
>         Attachments: error.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (MRM-578) unfinished scanning after NPE

Posted by "Milos Kleint (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milos Kleint updated MRM-578:
-----------------------------

    Attachment: error3.txt

yet again failed scanning after cleaning the data structures

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.1
>
>         Attachments: error.txt, error2.txt, error3.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (MRM-578) unfinished scanning after NPE

Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brett Porter updated MRM-578:
-----------------------------

    Fix Version/s:     (was: 1.0)
                   1.1

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.1
>
>         Attachments: error.txt, error2.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MRM-578) unfinished scanning after NPE

Posted by "Joakim Erdfelt (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_113253 ] 

Joakim Erdfelt commented on MRM-578:
------------------------------------

I've tested this with 1.0-beta-3 and the current archiva/trunk on my full central (ibiblio) mirror.
I cannot reproduce this error.

{noformat}
12384893 [pool-2-thread-1] INFO  org.codehaus.plexus.taskqueue.execution.TaskExecutor:repository-scanning  - Finished repository task:
.\ Scan of ibiblio \.__________________________________________
  Repository Dir    : /home/repo1/ibiblio
  Repository Name   : Ibiblio Mirror
  Repository Layout : default
  Known Consumers   : (5 configured)
                      create-missing-checksums
                      update-db-artifact
                      index-content
                      auto-rename
                      auto-remove
  Invalid Consumers : <none>
  Duration          : 1 Hour 35 Seconds 590 Milliseconds
  When Gathered     : 11/6/07 2:02 PM
  Total File Count  : 281074
  Avg Time Per File : 12 Milliseconds
______________________________________________________________
{noformat}

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.0-beta-4
>
>         Attachments: error.txt, error2.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MRM-578) unfinished scanning after NPE

Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/MRM-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_113304 ] 

Brett Porter commented on MRM-578:
----------------------------------

what you've done should be as clean as you can get, I think.

I don't get the restart problem - the complaints at the start are about SA and JPOX_ tables which can be safely ignored. If you are getting other problems, then there is certainly something going on where you have a database still in use somehow.

looking at the exceptions it seems to indicate a race condition. I can't see what would cause it though - so one thing to try might be to avoid any interaction with the web interface during the initial scan.

We should spend some time investigating this - but I'm inclined to move it post 1.0... wdyt?

> unfinished scanning after NPE
> -----------------------------
>
>                 Key: MRM-578
>                 URL: http://jira.codehaus.org/browse/MRM-578
>             Project: Archiva
>          Issue Type: Bug
>          Components: repository scanning
>    Affects Versions: 1.0-beta-3
>         Environment: macosx 1.4, jdk 1.5, archiva beta3
>            Reporter: Milos Kleint
>             Fix For: 1.0
>
>         Attachments: error.txt, error2.txt
>
>
> I repeatedly tried to index a mirror of central repository. In previous attempts, usually got  "Too many files opened" kind of errors. This time it's a NPE, see attached console output

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira