You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Enis Soztutar (JIRA)" <ji...@apache.org> on 2010/05/13 20:06:44 UTC
[jira] Created: (NUTCH-821) Use ivy in nutch builds
Use ivy in nutch builds
-----------------------
Key: NUTCH-821
URL: https://issues.apache.org/jira/browse/NUTCH-821
Project: Nutch
Issue Type: New Feature
Components: build
Affects Versions: 2.0
Reporter: Enis Soztutar
Assignee: Enis Soztutar
Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885291#action_12885291 ]
Chris A. Mattmann commented on NUTCH-821:
-----------------------------------------
Guys,
Why have any libs in the lib dir at all? If we need to get the jars uploaded to Maven Central, we can do a one time upload, via the process here:
http://maven.apache.org/guides/mini/guide-central-repository-upload.html
Which jars do we need to get into Central? I can take the lead on it as I've got some work to do there for Tika anyways.
Cheers,
Chris
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885244#action_12885244 ]
Julien Nioche commented on NUTCH-821:
-------------------------------------
I found [http://ant.apache.org/ivy/ivyde/] which allows to manage Ivy dependencies in Eclipse.
I had to rewrite ivy/ivy.xml to make the version numbers explicit as IvyDE was not able to load the properties in ivy/library.properties but it worked fine after that. The beauty of it is that we don't rely on the content of build/lib at all
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869763#action_12869763 ]
Paolo Castagna commented on NUTCH-821:
--------------------------------------
Same "pain" you are experiencing with the Nutch dependencies which are not in the Maven repository will be experienced by Nutch users which might want to depend/reuse Nutch code in their project.
But, I do agree... publishing Nutch artifacts is another issue.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869912#action_12869912 ]
Enis Soztutar commented on NUTCH-821:
-------------------------------------
Opened issue NUTCH-825, for publishing the artifacts.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885896#action_12885896 ]
Julien Nioche commented on NUTCH-821:
-------------------------------------
Committed revision 961306 and 961318
Slightly improved management of plugins since the patch to make them use the common ivysettings + removed ivy/library.properties to get IvyDE to work properly
Thanks for the comments and review of the patch
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885547#action_12885547 ]
Chris A. Mattmann commented on NUTCH-821:
-----------------------------------------
Hi Julien:
I reviewed your patch, and am +1 for you to commit it. That said, I wanted to clarify my proposal. My proposal is that we get rid of the $NUTCH/lib directory in its entirety, I wasn't so much as commenting on the plugin jars, though now that you bring it up, maybe we could integrate ivy in them as well. I don't think it would be too super hard to get the jars into Maven central. I'm reading up on the Sonatype Forge right now and might be able to get this working.
As for Hadoop, is there any requirement that we manage the jar lib for Hadoop in Nutch? Couldn't we simply pull the jar down dynamically via ivy or via some magic in build.xml? I think if we could then we could simply remove $NUTCH/lib whic was my original intention.
In the meanwhile, I'll create another issue to track all this, but you have my +1 to commit your patch and mark this issue as resolved. I'll link the new issue I create back to this one to indicate their relationship to one another.
Cheers,
Chris
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885583#action_12885583 ]
Andrzej Bialecki commented on NUTCH-821:
-----------------------------------------
+1 for this patch for now - all good comments, there's plenty of improvements we can make, so let's line them up as separate issues.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869082#action_12869082 ]
Paolo Castagna commented on NUTCH-821:
--------------------------------------
Is there any plan to publish Nutch artifacts in the future?
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869052#action_12869052 ]
Julien Nioche commented on NUTCH-821:
-------------------------------------
Ciao Paolo, the aim is not to publish Nutch artifacts but mainly to manage the dependencies. A simple and straightforward combination of Ant and Ivy will do fine for that.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885207#action_12885207 ]
Julien Nioche commented on NUTCH-821:
-------------------------------------
{QUOTE}
I think this patch refers to some parts that were already removed in NUTCH-837 ...
{QUOTE}
I applied NUTCH-837 before but indeed it does remove references to parts deleted in NUTCH-837. Maybe I should have done it in a separate issue.
{QUOTE}
Also, it would be nice to have a target that sets up an Eclipse project - after this patch is applied the lib/ is nearly empty and you need to run build at least once to bring dependencies - this may be confusing.
{QUOTE}
The jars are put in the build/lib directory so this assumes that the project has been built in order to get the dependencies. I think there are resources in Eclipse for dealing with Ivy configurations. If anyone has any pointers they will be most welcome
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869630#action_12869630 ]
Enis Soztutar commented on NUTCH-821:
-------------------------------------
I believe publishing nutch artifacts to maven repo is another issue. We can open a new issue if there is enough demand. I believe, ivy can generate the necessary pom's for publishing to maven.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-821) Use ivy in nutch builds
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Enis Soztutar updated NUTCH-821:
--------------------------------
Attachment: nutchbase-ivy_v1.patch
I'm attaching a patch which introduces ivy to nutch builds. It is a patch against current nutchbase code base hosted at github.
We can adopt this patch to current nutch trunk, but I see little point in doing so since the two code bases will merge eventually.
The way ivy patch works is as follows :
There are two configurations default and test. Test dependencies are managed at test configuration.
libraries not managed by ivy are still at their old locations ( for example "nutch/lib/" or "nutch/src/plugin/clustering-carrot/lib/")
the root ivy file is located at nutch/ivy/ivy.xml
Each plugin has it's own ivy file, which is located at nutch/src/plugin/<plugin>/ivy.xml
root dependencies are downloaded to build/lib
plugin dependencies are downloaded to build/plugins/<plugin>/
I have upgraded some of the libraries in the process, where only a the release number changed only in minor number (for example lucene-core-2.4.0 -> 2.4.1 )
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869015#action_12869015 ]
Paolo Castagna commented on NUTCH-821:
--------------------------------------
Are the Nutch artifacts published somewhere in a repository available for Maven or Ant+Ivy users?
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Paolo Castagna (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869017#action_12869017 ]
Paolo Castagna commented on NUTCH-821:
--------------------------------------
If your aim is publishing Nutch artifacts in a repository which is compatible with Maven as well as Ivy, you might consider using Maven Ant Tasks (http://maven.apache.org/ant-tasks/) (which IMHO has less pains on the publishing side).
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Closed: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Julien Nioche closed NUTCH-821.
-------------------------------
Resolution: Fixed
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Piet Schrijver (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885452#action_12885452 ]
Piet Schrijver commented on NUTCH-821:
--------------------------------------
+1 for maven, also having HBase in there would be great (=
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Julien Nioche updated NUTCH-821:
--------------------------------
Attachment: NUTCH-821.patch
Adds IVY support for dependencies
The lib/. dir is maintained and will be used to store dependencies which are not accessible via Ivy (e.g. GORA). The libs managed by Ivy are put in the directory build/lib.
This patch also differentiates the _build_ path from the _dist_ path.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869132#action_12869132 ]
Chris A. Mattmann commented on NUTCH-821:
-----------------------------------------
I'm a Maven fan but haven't had time to work up a Nutch Maven build as of yet. :(
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Doğacan Güney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885447#action_12885447 ]
Doğacan Güney commented on NUTCH-821:
-------------------------------------
+1 to Chris. In fact, I would ask to piggyback Gora on this process for now and pushing Gora jars into this repository as well :)
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885463#action_12885463 ]
Julien Nioche commented on NUTCH-821:
-------------------------------------
@Chris : isn't this restricted to the jars *we* produce? I agree with Dogacan that this would be the right way to access the Gora jars
Some of the plugins have their own lib directory as well as ivy dependencies. The plugins currently have unpublished dependencies on : automaton.jar, javaswf.jar, common-feedparser-0.6-fork.jar. Given that some of these plugins will be removed at some stage (feed & parse-swf moving to Tika) it is probably not worth bothering and we can keep them in the plugin libs.
As for the main lib/ directory it currently contains only the native jars for Hadoop but the Gora related jars would have to go there as well unless we put them into Central as you suggested. We should probably discuss how to deal with Hadoop related resources (native jars, conf objects, scripts in bin) in a separate JIRA and whether or not we should keep them at all.
Could you guys review the patch I sent yesterday? Since we'd decide what to do with the Hadoop native jars later and do not need the gora jars just yet it can still be applied as it is
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885188#action_12885188 ]
Andrzej Bialecki commented on NUTCH-821:
-----------------------------------------
I think this patch refers to some parts that were already removed in NUTCH-837 ...
Also, it would be nice to have a target that sets up an Eclipse project - after this patch is applied the lib/ is nearly empty and you need to run build at least once to bring dependencies - this may be confusing.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
> Attachments: NUTCH-821.patch, nutchbase-ivy_v1.patch
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-821) Use ivy in nutch builds
Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Julien Nioche updated NUTCH-821:
--------------------------------
Fix Version/s: 2.0
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-821) Use ivy in nutch builds
Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868997#action_12868997 ]
Andrzej Bialecki commented on NUTCH-821:
-----------------------------------------
+1 for Ivy.
> Use ivy in nutch builds
> -----------------------
>
> Key: NUTCH-821
> URL: https://issues.apache.org/jira/browse/NUTCH-821
> Project: Nutch
> Issue Type: New Feature
> Components: build
> Affects Versions: 2.0
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
>
> Ivy is the de-facto dependency management tool used in conjunction with Ant. It would be nice if we switch to using Ivy in Nutch builds.
> Maven is also an alternative, but I think Nutch will benefit more with an Ant+Ivy architecture.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.