You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@maven.apache.org by "Oskar Carlstedt (JIRA)" <ji...@codehaus.org> on 2009/03/23 13:23:13 UTC

[jira] Created: (MNG-4104) Clean up maven repository

Clean up maven repository
-------------------------

                 Key: MNG-4104
                 URL: http://jira.codehaus.org/browse/MNG-4104
             Project: Maven 2
          Issue Type: Improvement
          Components: Artifacts and Repositories
         Environment: All
            Reporter: Oskar Carlstedt


Hi All!

The Maven repository is getting bigger and bigger and I think there must be some restrictions when adding components (read jars, wars,ears etc) to it. I tried to make a mirror via rsync and got a lot of example wars, example jars etc. Why are there war-files in the Maven repo at all? Why does Geronimo have all their jar files in the global maven repository? Wouldn't it be better to have a spearate repo for non-util products like Apache Tomcat, Apache Geronimo, JBoss, etc., etc.

I agree to the fact that the repository shall contain most of the components you might need in your development but I don't need war files, I dont need example files and most probably I don't need app server jar files. What I need is software components from the repo - not fully functional programs that I can download from resp. vendor page. These fully functional program files are taking up so much HD space and is probably a huge reason why a rsync process will conatin synciong for hours.

So my question is - is there a job to be done here or am I just wrong (crazy) in my opinion above?

Kind regards
Oskar Carlstedt


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MEV-621) Clean up maven repository

Posted by "Oskar Carlstedt (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/MEV-621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=171271#action_171271 ] 

Oskar Carlstedt commented on MEV-621:
-------------------------------------

Hi All!

As of today my rsync process to get my own mirror  have been going for almost 3 days, and it is still not finished. I think there will about 4-5 GB left to download. Maybe it is even  more. So far I'v downloaded 46 BG of data - it is far away from those 16 GB that is mentioned in the mirror guide.

As I think you understand this is not a good solution and it will definitely not work in the future. So how do we create something better? My suggestion is to split the current repo1.maven.org/maven2 into at least three sub repositories that are exposed via a proxy. Thinkable sub repositories are final-programs, tools and examples. 

In the final-programs repository we place everything that is used directly by an end user. E.g. Tomcat's jar files, Jonas's jar files, war files etc.

In the tools repository we put most of the used stuff like log4j, spring framework, etc.

Finally in the examples repository we can add all those examples we have.


Cheers,
Oskar


> Clean up maven repository
> -------------------------
>
>                 Key: MEV-621
>                 URL: http://jira.codehaus.org/browse/MEV-621
>             Project: Maven Evangelism
>          Issue Type: Improvement
>            Reporter: Oskar Carlstedt
>
> Hi All!
> The Maven repository is getting bigger and bigger and I think there must be some restrictions when adding components (read jars, wars,ears etc) to it. I tried to make a mirror via rsync and got a lot of example wars, example jars etc. Why are there war-files in the Maven repo at all? Why does Geronimo have all their jar files in the global maven repository? Wouldn't it be better to have a spearate repo for non-util products like Apache Tomcat, Apache Geronimo, JBoss, etc., etc.
> I agree to the fact that the repository shall contain most of the components you might need in your development but I don't need war files, I dont need example files and most probably I don't need app server jar files. What I need is software components from the repo - not fully functional programs that I can download from resp. vendor page. These fully functional program files are taking up so much HD space and is probably a huge reason why a rsync process will conatin synciong for hours.
> So my question is - is there a job to be done here or am I just wrong (crazy) in my opinion above?
> Kind regards
> Oskar Carlstedt

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MEV-621) Clean up maven repository

Posted by "Benjamin Bentmann (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/MEV-621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=171272#action_171272 ] 

Benjamin Bentmann commented on MEV-621:
---------------------------------------

Given that developer groups usually require only a very small fraction of stuff from central, the recommended way is to use a [repository manager|http://maven.apache.org/repository-management.html].

> Clean up maven repository
> -------------------------
>
>                 Key: MEV-621
>                 URL: http://jira.codehaus.org/browse/MEV-621
>             Project: Maven Evangelism
>          Issue Type: Improvement
>            Reporter: Oskar Carlstedt
>
> Hi All!
> The Maven repository is getting bigger and bigger and I think there must be some restrictions when adding components (read jars, wars,ears etc) to it. I tried to make a mirror via rsync and got a lot of example wars, example jars etc. Why are there war-files in the Maven repo at all? Why does Geronimo have all their jar files in the global maven repository? Wouldn't it be better to have a spearate repo for non-util products like Apache Tomcat, Apache Geronimo, JBoss, etc., etc.
> I agree to the fact that the repository shall contain most of the components you might need in your development but I don't need war files, I dont need example files and most probably I don't need app server jar files. What I need is software components from the repo - not fully functional programs that I can download from resp. vendor page. These fully functional program files are taking up so much HD space and is probably a huge reason why a rsync process will conatin synciong for hours.
> So my question is - is there a job to be done here or am I just wrong (crazy) in my opinion above?
> Kind regards
> Oskar Carlstedt

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Closed: (MEV-621) Clean up maven repository

Posted by "Juven Xu (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/MEV-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Juven Xu closed MEV-621.
------------------------

    Resolution: Not A Bug
      Assignee: Juven Xu

it's up to the OSS projects to upload whatever they want to, we can not control it.

> Clean up maven repository
> -------------------------
>
>                 Key: MEV-621
>                 URL: http://jira.codehaus.org/browse/MEV-621
>             Project: Maven Evangelism
>          Issue Type: Improvement
>            Reporter: Oskar Carlstedt
>            Assignee: Juven Xu
>
> Hi All!
> The Maven repository is getting bigger and bigger and I think there must be some restrictions when adding components (read jars, wars,ears etc) to it. I tried to make a mirror via rsync and got a lot of example wars, example jars etc. Why are there war-files in the Maven repo at all? Why does Geronimo have all their jar files in the global maven repository? Wouldn't it be better to have a spearate repo for non-util products like Apache Tomcat, Apache Geronimo, JBoss, etc., etc.
> I agree to the fact that the repository shall contain most of the components you might need in your development but I don't need war files, I dont need example files and most probably I don't need app server jar files. What I need is software components from the repo - not fully functional programs that I can download from resp. vendor page. These fully functional program files are taking up so much HD space and is probably a huge reason why a rsync process will conatin synciong for hours.
> So my question is - is there a job to be done here or am I just wrong (crazy) in my opinion above?
> Kind regards
> Oskar Carlstedt

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Moved: (MEV-621) Clean up maven repository

Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/MEV-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brett Porter moved MNG-4104 to MEV-621:
---------------------------------------

       Priority:     (was: Major)
    Environment:     (was: All)
    Component/s:     (was: Artifacts and Repositories)
     Complexity:   (was: Intermediate)
       Workflow: jira  (was: Maven New)
            Key: MEV-621  (was: MNG-4104)
        Project: Maven Evangelism  (was: Maven 2)

> Clean up maven repository
> -------------------------
>
>                 Key: MEV-621
>                 URL: http://jira.codehaus.org/browse/MEV-621
>             Project: Maven Evangelism
>          Issue Type: Improvement
>            Reporter: Oskar Carlstedt
>
> Hi All!
> The Maven repository is getting bigger and bigger and I think there must be some restrictions when adding components (read jars, wars,ears etc) to it. I tried to make a mirror via rsync and got a lot of example wars, example jars etc. Why are there war-files in the Maven repo at all? Why does Geronimo have all their jar files in the global maven repository? Wouldn't it be better to have a spearate repo for non-util products like Apache Tomcat, Apache Geronimo, JBoss, etc., etc.
> I agree to the fact that the repository shall contain most of the components you might need in your development but I don't need war files, I dont need example files and most probably I don't need app server jar files. What I need is software components from the repo - not fully functional programs that I can download from resp. vendor page. These fully functional program files are taking up so much HD space and is probably a huge reason why a rsync process will conatin synciong for hours.
> So my question is - is there a job to be done here or am I just wrong (crazy) in my opinion above?
> Kind regards
> Oskar Carlstedt

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MEV-621) Clean up maven repository

Posted by "Oskar Carlstedt (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/MEV-621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=172255#action_172255 ] 

Oskar Carlstedt commented on MEV-621:
-------------------------------------

Hi again!

Ok, using a proxy cn help me. I've been doing so for a while now. But what if I'm sitting in a closed environment as I'm doing right now. Our development environment does not have access to the Internet and therefore a repository manager does not help me. Artifactory can help me in some way. It is possible to export some repositories to another proxy via a file copy. So it's ok - but still it woul be much easier fo me if I could make a mirror with development components in for example 15GB.

As of today, and as mention above, if I try do do a rsync I get more than 60GB and most of the space is occupied by *.zip, *.tar.gz, *example*, full application servers etc., etc. Is till don't get it - why don't have several repositories where each repository has its own role.

Cheers,
Oskar





> Clean up maven repository
> -------------------------
>
>                 Key: MEV-621
>                 URL: http://jira.codehaus.org/browse/MEV-621
>             Project: Maven Evangelism
>          Issue Type: Improvement
>            Reporter: Oskar Carlstedt
>
> Hi All!
> The Maven repository is getting bigger and bigger and I think there must be some restrictions when adding components (read jars, wars,ears etc) to it. I tried to make a mirror via rsync and got a lot of example wars, example jars etc. Why are there war-files in the Maven repo at all? Why does Geronimo have all their jar files in the global maven repository? Wouldn't it be better to have a spearate repo for non-util products like Apache Tomcat, Apache Geronimo, JBoss, etc., etc.
> I agree to the fact that the repository shall contain most of the components you might need in your development but I don't need war files, I dont need example files and most probably I don't need app server jar files. What I need is software components from the repo - not fully functional programs that I can download from resp. vendor page. These fully functional program files are taking up so much HD space and is probably a huge reason why a rsync process will conatin synciong for hours.
> So my question is - is there a job to be done here or am I just wrong (crazy) in my opinion above?
> Kind regards
> Oskar Carlstedt

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira