You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@directory.apache.org by Ersin Er <er...@gmail.com> on 2007/06/01 21:05:35 UTC

[LDAP] LDAP usage in GRID technology

Hi all,

I have been doing some research on GRID technology recently. I saw
that LDAP is being used in a few places in GRID engines. Can someone
clarify how LDAP is being used in GRID technology today?

Thanks.

-- 
Ersin Er

R.A. and Ph.D Student at the Dept. of Computer Eng. in Hacettepe University
http://www.cs.hacettepe.edu.tr

Committer and PMC Member of The Apache Directory Project
http://directory.apache.org

Re: [LDAP] LDAP usage in GRID technology

Posted by Ole Ersoy <ol...@gmail.com>.
Hi Ersin,

I came across this a few days ago:
http://www.gridgain.com/
It's seems to be a fairly well established computational grid for Java.  Hope it's of some use.

Cheers,
- Ole




Ersin Er wrote:
> Hi all,
> 
> I have been doing some research on GRID technology recently. I saw
> that LDAP is being used in a few places in GRID engines. Can someone
> clarify how LDAP is being used in GRID technology today?
> 
> Thanks.
> 

Re: [LDAP] LDAP usage in GRID technology

Posted by Chris Custine <ch...@gmail.com>.
It also looks like Globus uses LDAP for metrics and monitoring and I found
this doc which looked like it answers some of the basic questions:
http://72.14.253.104/search?q=cache:Bl8kdc2iKBYJ:ftp://ftp.globus.org/pub/globus/papers/ldap_in_globus.ps.gz+globus+MDS+ldap&hl=en&ct=clnk&cd=7&gl=us

That doc is a postscript file filtered through the Google text translator.
If you want the full doc it will be available st the to of the page.

Chris

On 6/1/07, Chris Custine <ch...@gmail.com> wrote:
>
> A while back I remember a project called EDG (I think it is Euro Data
> Grid) that used LDAP to store grid job data and grid user data, but I can't
> find any solid information on it.  They had an LDAP schema called GLUE that
> I believe was used to store monitoring information in a central location.  I
> think that effort gave birth to several evolutions of similar ideas.
>
> I also found this http://gridice.forge.cnaf.infn.it/ which looks like it
> uses an extension of the GLUE schema.
>
> Chris
>
> On 6/1/07, Ersin Er <er...@gmail.com> wrote:
> >
> > Hi all,
> >
> > I have been doing some research on GRID technology recently. I saw
> > that LDAP is being used in a few places in GRID engines. Can someone
> > clarify how LDAP is being used in GRID technology today?
> >
> > Thanks.
> >
> > --
> > Ersin Er
> >
> > R.A. and Ph.D Student at the Dept. of Computer Eng. in Hacettepe
> > University
> > http://www.cs.hacettepe.edu.tr
> >
> > Committer and PMC Member of The Apache Directory Project
> > http://directory.apache.org
> >
>
>

Re: [LDAP] LDAP usage in GRID technology

Posted by Chris Custine <ch...@gmail.com>.
A while back I remember a project called EDG (I think it is Euro Data Grid)
that used LDAP to store grid job data and grid user data, but I can't find
any solid information on it.  They had an LDAP schema called GLUE that I
believe was used to store monitoring information in a central location.  I
think that effort gave birth to several evolutions of similar ideas.

I also found this http://gridice.forge.cnaf.infn.it/ which looks like it
uses an extension of the GLUE schema.

Chris

On 6/1/07, Ersin Er <er...@gmail.com> wrote:
>
> Hi all,
>
> I have been doing some research on GRID technology recently. I saw
> that LDAP is being used in a few places in GRID engines. Can someone
> clarify how LDAP is being used in GRID technology today?
>
> Thanks.
>
> --
> Ersin Er
>
> R.A. and Ph.D Student at the Dept. of Computer Eng. in Hacettepe
> University
> http://www.cs.hacettepe.edu.tr
>
> Committer and PMC Member of The Apache Directory Project
> http://directory.apache.org
>

Re: [LDAP] LDAP usage in GRID technology

Posted by Enrique Rodriguez <en...@gmail.com>.
On 6/1/07, Ersin Er <er...@gmail.com> wrote:
> ...
> I have been doing some research on GRID technology recently. I saw
> that LDAP is being used in a few places in GRID engines. Can someone
> clarify how LDAP is being used in GRID technology today?

Hi, Ersin,

I've worked with Sun's GridEngine, with both OpenLDAP and MS Active
Directory for various network infrastructure services.  We
mass-produced Xen hosts and used Kerberos to centralize authentication
and LDAP for storing every bit of infrastructure data we could.  In
the end, you could boot up a Xen host (guest) and have it ready to
accept jobs by as little configuration as setting its MAC address.
You can put users and groups in LDAP or use Samba Winbind to store
mappings of users/groups to Active Directory users/groups by storing
the mappings in LDAP.  In either case you can then configure the
relevant PAM modules in Linux and use those users/groups on any host.
We also put automount information in LDAP and mounted shares using
NFSv4.  MS AD is storing DHCP/DNS in a DIT so you could consider that
as using LDAP, too.

Recently there was a thread on storing sudo information in LDAP.  That
was news to me, but I would probably do that, too.

Though your question was about LDAP I'd like to add that Kerberos
played a role in securing the NFSv4 mounts and in providing
centralized authentication so you could seamlessly SSH between hosts.
Kerberos also secured LDAP itself (via SASL GSSAPI).  Kerberos can be
a requirement when the executing jobs access sensitive data, such as
in national labs.

The benefit of LDAP/Kerberos was that we limited the amount of one-off
configuration we had to do per Xen host and there can be a lot of
hosts in a grid.  Also, we had a lot of different platforms and
processors since the customer was an ISV (independent software vendor)
testing their products and Kerberos/LDAP is widely supported.

Most of my notes are in a raw form but they provide the foundation for
the INTEROP space in Confluence:

http://cwiki.apache.org/confluence/display/DIRxINTEROP/Index

My hope has always been to revisit those notes and simplify what was a
disparate mix of proprietary and open-source infrastructure and really
hone it to make it easier to use, with a focus on ApacheDS.

Enrique