You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Prafulla <pr...@gmail.com> on 2008/01/30 05:44:58 UTC
Reg: Nutch Admin GUI
Hi,
We are looking to develop an Admin GUI for the Nutch Project. We came across
this page http://wiki.apache.org/nutch/NutchAdministrationUserInterface
but most of the links for download and screen shots given there are
outdated. Can we please know the current status of the work in this area and
whether there are any working plugins that can be used to extend the GUI for
Nutch-0.9.
Regards,
Prafulla
Aditya
Re: Reg: Nutch Admin GUI
Posted by Andrzej Bialecki <ab...@getopt.org>.
Prafulla wrote:
> Hi,
>
> We are looking to develop an Admin GUI for the Nutch Project. We came across
> this page http://wiki.apache.org/nutch/NutchAdministrationUserInterface
> but most of the links for download and screen shots given there are
> outdated. Can we please know the current status of the work in this area and
> whether there are any working plugins that can be used to extend the GUI for
> Nutch-0.9.
AFAIK there was no progress on this issue. The patches that implemented
GUI required changes in Hadoop, and even then it was only possible to
run the GUI servlet within the same JVM as the JobTracker.
In my opinion, what is needed to move forward with this issue is the
following:
* work on extending JobSubmissionProtocol in Hadoop to allow for a
greater control and status reporting from JobTracker (this would address
the bulk of Hadoop patches in the original patch-set)
* implement a "segment manager" tool to keep track of segments and their
processing status. This is mostly implemented in the original patch.
This would require that various Nutch tools have a greater consistency
in the way they process segments and databases, and probably needs more
status reporting between the tools.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com