Re: Hadoop Dashboard and XML Status Feed

[Otis Gospodnetic <ot...@yahoo.com>]

One thing that popped into my head when I saw this subject line was "Hadoop node status published as RSS" - for those who spend a lot of time in their feed readers or for easy integration this might be useful.  And maybe something you can easily provide since it sounds like you already have XML generation.


Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch




________________________________
From: James Wilson <ja...@asolutions.com>
To: core-dev@hadoop.apache.org
Sent: Tuesday, October 14, 2008 5:27:57 PM
Subject: Hadoop Dashboard and XML Status Feed

I'm leading a small team that is interested in contributing some work we are doing to enhance the information available from the jetty instance inside JobTracker.  Our end goal is an Ajax enabled dashboard.  We are using Google Web Toolkit for the dashboard.  We are currently working on the dashboard in a separate project space.  Our enhancements to hadoop are for a new web context, servlet,  supporting classes, and JSPs to serve generic xml in a RESTful fashion (that the GWT consumes and displays).

If you're interested in the idea as a contribution, I'd be happy to share all the details of our design.

Thank you,

James Wilson
Asynchrony Solutions, Inc

Re: Hadoop Dashboard and XML Status Feed

[Ted Dunning <te...@gmail.com>]

The chukwa UI widgets are (according to the UG talk last night) going to be
open-sourced next week.

I would love to see some alternative designs for comparison.  The Yahoo crew
have their own special problems in that they are running 4000 nodes and
moving to 10,000 soon.  They need a second hadoop cluster just to munch the
logs.  Most of us use much smaller clusters (dozens of machines or less) and
would be thrilled to just get something slightly nicer than ganglia.  Node
level stats with cluster level rollups would be fantastic.

On Thu, Nov 20, 2008 at 10:38 AM, Otis Gospodnetic <
otis_gospodnetic@yahoo.com> wrote:

> One thing that popped into my head when I saw this subject line was "Hadoop
> node status published as RSS" - for those who spend a lot of time in their
> feed readers or for easy integration this might be useful.  And maybe
> something you can easily provide since it sounds like you already have XML
> generation.
>
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
>
> ________________________________
> From: James Wilson <ja...@asolutions.com>
> To: core-dev@hadoop.apache.org
> Sent: Tuesday, October 14, 2008 5:27:57 PM
> Subject: Hadoop Dashboard and XML Status Feed
>
> I'm leading a small team that is interested in contributing some work we
> are doing to enhance the information available from the jetty instance
> inside JobTracker.  Our end goal is an Ajax enabled dashboard.  We are using
> Google Web Toolkit for the dashboard.  We are currently working on the
> dashboard in a separate project space.  Our enhancements to hadoop are for a
> new web context, servlet,  supporting classes, and JSPs to serve generic xml
> in a RESTful fashion (that the GWT consumes and displays).
>
> If you're interested in the idea as a contribution, I'd be happy to share
> all the details of our design.
>
> Thank you,
>
> James Wilson
> Asynchrony Solutions, Inc
>



-- 
Ted Dunning, CTO
DeepDyve
4600 Bohannon Drive, Suite 220
Menlo Park, CA 94025
www.deepdyve.com
650-324-0110, ext. 738
858-414-0013 (m)