You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Manhee Jo <jo...@nttdocomo.com> on 2009/06/26 04:28:17 UTC

grahical tool for hadoop mapreduce

Hi,

Do you know any graphical tools to show the progress of mapreduce using
the job log under logs/history/ ? The web interface (namenode:50030) gives 
me
similar one. But what I need is more specific ones that show the number of
total running map tasks and reduce tasks at some points of time,
which I've seen from some papers. Any help would be appreciated.


Thanks,
Manhee 



Re: grahical tool for hadoop mapreduce

Posted by Shevek <ha...@anarres.org>.
On Fri, 2009-06-26 at 10:55 -0500, Mark Kerzner wrote:
> Tom, this is so much right on time! Bravo, Karmasphere.
> I installed the plugins, and nothing crashed - in fact, I get the same
> screens as the manual promises.
> 
> It is worth reading this group - they released the plugin two days ago.

Actually, it seems I screwed the pooch with a last minute bugfix - I was
trying to make RawLocalFileSystem work on windows. I'm sorry. It should
work now, and probably also on Windows.

S. (Karmasphere)

> Mark
> 
> On Fri, Jun 26, 2009 at 10:13 AM, Tom Wheeler <to...@gmail.com> wrote:
> 
> > Although it may not support your specific need for log files, I just
> > happened to run across this link today and thought it was relevant for
> > a thread about GUI tools for Hadoop:
> >
> >   http://www.hadoopstudio.org/
> >
> > It's a plugin for working visually with Hadoop in NetBeans.  The page
> > describes it as an alpha release, and while I haven't tried it out
> > yet, the screenshot at least looks very promising.
> >
> > On Thu, Jun 25, 2009 at 9:28 PM, Manhee Jo<jo...@nttdocomo.com> wrote:
> > > Do you know any graphical tools to show the progress of mapreduce using
> > > the job log under logs/history/ ? The web interface (namenode:50030)
> > gives
> > > me similar one. But what I need is more specific ones that show the
> > number
> > > of total running map tasks and reduce tasks at some points of time,
> > > which I've seen from some papers. Any help would be appreciated.
> >
> > --
> > Tom Wheeler
> > http://www.tomwheeler.com/
> >


Re: grahical tool for hadoop mapreduce

Posted by Mark Kerzner <ma...@gmail.com>.
Tom, this is so much right on time! Bravo, Karmasphere.
I installed the plugins, and nothing crashed - in fact, I get the same
screens as the manual promises.

It is worth reading this group - they released the plugin two days ago.

Mark

On Fri, Jun 26, 2009 at 10:13 AM, Tom Wheeler <to...@gmail.com> wrote:

> Although it may not support your specific need for log files, I just
> happened to run across this link today and thought it was relevant for
> a thread about GUI tools for Hadoop:
>
>   http://www.hadoopstudio.org/
>
> It's a plugin for working visually with Hadoop in NetBeans.  The page
> describes it as an alpha release, and while I haven't tried it out
> yet, the screenshot at least looks very promising.
>
> On Thu, Jun 25, 2009 at 9:28 PM, Manhee Jo<jo...@nttdocomo.com> wrote:
> > Do you know any graphical tools to show the progress of mapreduce using
> > the job log under logs/history/ ? The web interface (namenode:50030)
> gives
> > me similar one. But what I need is more specific ones that show the
> number
> > of total running map tasks and reduce tasks at some points of time,
> > which I've seen from some papers. Any help would be appreciated.
>
> --
> Tom Wheeler
> http://www.tomwheeler.com/
>

Re: grahical tool for hadoop mapreduce

Posted by Tom Wheeler <to...@gmail.com>.
Although it may not support your specific need for log files, I just
happened to run across this link today and thought it was relevant for
a thread about GUI tools for Hadoop:

   http://www.hadoopstudio.org/

It's a plugin for working visually with Hadoop in NetBeans.  The page
describes it as an alpha release, and while I haven't tried it out
yet, the screenshot at least looks very promising.

On Thu, Jun 25, 2009 at 9:28 PM, Manhee Jo<jo...@nttdocomo.com> wrote:
> Do you know any graphical tools to show the progress of mapreduce using
> the job log under logs/history/ ? The web interface (namenode:50030) gives
> me similar one. But what I need is more specific ones that show the number
> of total running map tasks and reduce tasks at some points of time,
> which I've seen from some papers. Any help would be appreciated.

-- 
Tom Wheeler
http://www.tomwheeler.com/

Re: grahical tool for hadoop mapreduce

Posted by Kevin Weil <ke...@gmail.com>.
Some people at sun have done some recent work on this -- see a blog post at
http://blogs.sun.com/jgebis/entry/hadoop_resource_utilization_and_performance,
and a subsequent post with more detail at
http://blogs.sun.com/jgebis/entry/hadoop_resource_utilization_monitoring_scripts
.

Kevin

On Thu, Jun 25, 2009 at 7:28 PM, Manhee Jo <jo...@nttdocomo.com> wrote:

> Hi,
>
> Do you know any graphical tools to show the progress of mapreduce using
> the job log under logs/history/ ? The web interface (namenode:50030) gives
> me
> similar one. But what I need is more specific ones that show the number of
> total running map tasks and reduce tasks at some points of time,
> which I've seen from some papers. Any help would be appreciated.
>
>
> Thanks,
> Manhee
>
>