Building Hadoop UI

[fa...@gmail.com]

Hello everyone,

in order to provide our clients a custom UI for their MapReduce jobs and HDFS files, what is the best solution to create a web-based UI for Hadoop?
We are not going to use Cloudera HUE, we need something more user-friendly and shaped for our clients needs.

Thanks,

Fabio Pitzolu

Re: Building Hadoop UI

[fa...@gmail.com]

Hi Harsh,

thanks for your feedback, I'm really interested in the new HUE branch.
Our clients are always looking for something customized, which is difficult to achieve sometimes if we don't have something that we can re-use. Our goal is to create a sort of template structure and build our app on top of it.

I'll let you know about the development, also take a look at the HUE dev community list.

Thanks,

Fabio Pitzolu
fabio.pitzolu@gmail.com

Il giorno 17/feb/2012, alle ore 15:06, Harsh J ha scritto:

> Hi Fabio,
> 
> Hue is OSS and ASL-ed, and you can re-use the thrift bindings it uses
> to communicate with the various daemons via plugins, and then feed
> information into its UIs.
> 
> I do think you can easily separate out the desktop UI and the backend
> (thrift binding) parts, and plug in your own UI layers if you
> absolutely need to do that. If you are still interested in doing that,
> you are welcome to ask your questions at
> https://groups.google.com/a/cloudera.org/group/hue-dev lists. The hue
> community also welcomes any feedback you may have that can help
> improve Hue to address your issues.
> 
> But to answer your specific question, you essentially would need to
> load a plugin at each daemon that you can communicate to, and your UI
> project should use the plugin to fetch what it needs. This is how HUE
> does it and the sources are all at http://github.com/cloudera/hue
> 
> Note: Hue is undergoing a look and feel change (and ditching the
> desktop model, which may be the pain for you here?), which you may
> want to check further at
> https://groups.google.com/a/cloudera.org/group/hue-user/browse_thread/thread/cea3cf743d230d9d#
> -- This work is already available in the hue2 git branch for
> testing/consumption.
> 
> On Fri, Feb 17, 2012 at 3:31 PM,  <fa...@gmail.com> wrote:
>> Hello everyone,
>> 
>> in order to provide our clients a custom UI for their MapReduce jobs and HDFS files, what is the best solution to create a web-based UI for Hadoop?
>> We are not going to use Cloudera HUE, we need something more user-friendly and shaped for our clients needs.
>> 
>> Thanks,
>> 
>> Fabio Pitzolu
> 
> 
> 
> -- 
> Harsh J
> Customer Ops. Engineer
> Cloudera | http://tiny.cloudera.com/about

Re: Building Hadoop UI

[Harsh J <ha...@cloudera.com>]

Hi Fabio,

Hue is OSS and ASL-ed, and you can re-use the thrift bindings it uses
to communicate with the various daemons via plugins, and then feed
information into its UIs.

I do think you can easily separate out the desktop UI and the backend
(thrift binding) parts, and plug in your own UI layers if you
absolutely need to do that. If you are still interested in doing that,
you are welcome to ask your questions at
https://groups.google.com/a/cloudera.org/group/hue-dev lists. The hue
community also welcomes any feedback you may have that can help
improve Hue to address your issues.

But to answer your specific question, you essentially would need to
load a plugin at each daemon that you can communicate to, and your UI
project should use the plugin to fetch what it needs. This is how HUE
does it and the sources are all at http://github.com/cloudera/hue

Note: Hue is undergoing a look and feel change (and ditching the
desktop model, which may be the pain for you here?), which you may
want to check further at
https://groups.google.com/a/cloudera.org/group/hue-user/browse_thread/thread/cea3cf743d230d9d#
-- This work is already available in the hue2 git branch for
testing/consumption.

On Fri, Feb 17, 2012 at 3:31 PM,  <fa...@gmail.com> wrote:
> Hello everyone,
>
> in order to provide our clients a custom UI for their MapReduce jobs and HDFS files, what is the best solution to create a web-based UI for Hadoop?
> We are not going to use Cloudera HUE, we need something more user-friendly and shaped for our clients needs.
>
> Thanks,
>
> Fabio Pitzolu



-- 
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about

Re: Building Hadoop UI

[Arun C Murthy <ac...@hortonworks.com>]

You might want to get involved in Apache Ambari:
http://incubator.apache.org/ambari/

Ambari aims to provide install, configuration and management (including dashboards etc.).

For what you are looking for, Ambari uses metrics from various projects in Hadoop ecosystem (hadoop, hbase etc.) to draw dashboard UI etc., it might be something useful for you.

Arun

On Feb 17, 2012, at 2:01 AM, fabio.pitzolu@gmail.com wrote:

> Hello everyone,
> 
> in order to provide our clients a custom UI for their MapReduce jobs and HDFS files, what is the best solution to create a web-based UI for Hadoop?
> We are not going to use Cloudera HUE, we need something more user-friendly and shaped for our clients needs.
> 
> Thanks,
> 
> Fabio Pitzolu

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/