You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oodt.apache.org by Sheryl John <sh...@gmail.com> on 2012/08/06 21:43:57 UTC

Latest trunk updates

Hi everyone,

I've been able to run and test workflow tasks with the resource manager on
0.3 versions. At CHLA, we've been using the 0.4 version without resmgr but
due to runtime issues with workflow, we'd like to send out task jobs with
resmgr and compare the performance.

Is it safe to use the latest trunk updates for workflow, pge and resource
manager?
Also, which versions are you all using for the current projects?


Thanks,
Sheryl

Re: Latest trunk updates

Posted by Cameron Goodale <go...@apache.org>.
Sheryl,

Over in the Snow Data System we are still using OODT 0.3 (full stack) and
it works great.  10K's of jobs and TBs of disk used up in the process.

-Cam

On Mon, Aug 6, 2012 at 12:43 PM, Sheryl John <sh...@gmail.com> wrote:

> Hi everyone,
>
> I've been able to run and test workflow tasks with the resource manager on
> 0.3 versions. At CHLA, we've been using the 0.4 version without resmgr but
> due to runtime issues with workflow, we'd like to send out task jobs with
> resmgr and compare the performance.
>
> Is it safe to use the latest trunk updates for workflow, pge and resource
> manager?
> Also, which versions are you all using for the current projects?
>
>
> Thanks,
> Sheryl
>
>

Re: Latest trunk updates

Posted by Sheryl John <sh...@gmail.com>.
Thanks Cam and Chris!

Looking forward to try out the latest additions in 0.5-trunk.

On Wed, Aug 8, 2012 at 8:42 AM, Mattmann, Chris A (388J) <
chris.a.mattmann@jpl.nasa.gov> wrote:

> Hey Sheryl,
>
> Once we wrap up OODT-215 and OODT-310 for wengine yes it will be totally
> safe and encouraged
> to use 0.5-trunk (and beyond) for workflow + pge + resmgr.
>
> Right now I'd recommend:
>
> 1. Taking an 0.3 release and then overlaying what you want out of 0.4
> (e.g., filemgr, etc.).
> 2. Staying on 0.3.
> 3. Deploying 0.5-trunk, but using 0.3 workflow manager/pge/crawler.
>
> As for what my JPL projects are using, some of them are using 0.5-trunk
> (they are doing mostly
> curation + ingestion + crawling + met extraction, and/or using the new web
> interfaces), the
> rest are using 0.3.
>
> Cheers,
> Chris
>
> On Aug 6, 2012, at 12:43 PM, Sheryl John wrote:
>
> > Hi everyone,
> >
> > I've been able to run and test workflow tasks with the resource manager
> on 0.3 versions. At CHLA, we've been using the 0.4 version without resmgr
> but due to runtime issues with workflow, we'd like to send out task jobs
> with resmgr and compare the performance.
> >
> > Is it safe to use the latest trunk updates for workflow, pge and
> resource manager?
> > Also, which versions are you all using for the current projects?
> >
> >
> > Thanks,
> > Sheryl
> >
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>

-Sheryl

Re: Latest trunk updates

Posted by Sheryl John <sh...@gmail.com>.
Thanks Cam and Chris!

Looking forward to try out the latest additions in 0.5-trunk.

On Wed, Aug 8, 2012 at 8:42 AM, Mattmann, Chris A (388J) <
chris.a.mattmann@jpl.nasa.gov> wrote:

> Hey Sheryl,
>
> Once we wrap up OODT-215 and OODT-310 for wengine yes it will be totally
> safe and encouraged
> to use 0.5-trunk (and beyond) for workflow + pge + resmgr.
>
> Right now I'd recommend:
>
> 1. Taking an 0.3 release and then overlaying what you want out of 0.4
> (e.g., filemgr, etc.).
> 2. Staying on 0.3.
> 3. Deploying 0.5-trunk, but using 0.3 workflow manager/pge/crawler.
>
> As for what my JPL projects are using, some of them are using 0.5-trunk
> (they are doing mostly
> curation + ingestion + crawling + met extraction, and/or using the new web
> interfaces), the
> rest are using 0.3.
>
> Cheers,
> Chris
>
> On Aug 6, 2012, at 12:43 PM, Sheryl John wrote:
>
> > Hi everyone,
> >
> > I've been able to run and test workflow tasks with the resource manager
> on 0.3 versions. At CHLA, we've been using the 0.4 version without resmgr
> but due to runtime issues with workflow, we'd like to send out task jobs
> with resmgr and compare the performance.
> >
> > Is it safe to use the latest trunk updates for workflow, pge and
> resource manager?
> > Also, which versions are you all using for the current projects?
> >
> >
> > Thanks,
> > Sheryl
> >
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>

-Sheryl

Re: Latest trunk updates

Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hey Sheryl,

Once we wrap up OODT-215 and OODT-310 for wengine yes it will be totally safe and encouraged
to use 0.5-trunk (and beyond) for workflow + pge + resmgr.

Right now I'd recommend:

1. Taking an 0.3 release and then overlaying what you want out of 0.4 (e.g., filemgr, etc.).
2. Staying on 0.3.
3. Deploying 0.5-trunk, but using 0.3 workflow manager/pge/crawler.

As for what my JPL projects are using, some of them are using 0.5-trunk (they are doing mostly
curation + ingestion + crawling + met extraction, and/or using the new web interfaces), the
rest are using 0.3.

Cheers,
Chris

On Aug 6, 2012, at 12:43 PM, Sheryl John wrote:

> Hi everyone,
> 
> I've been able to run and test workflow tasks with the resource manager on 0.3 versions. At CHLA, we've been using the 0.4 version without resmgr but due to runtime issues with workflow, we'd like to send out task jobs with resmgr and compare the performance.
> 
> Is it safe to use the latest trunk updates for workflow, pge and resource manager? 
> Also, which versions are you all using for the current projects?
> 
> 
> Thanks,
> Sheryl
> 


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Re: Latest trunk updates

Posted by Cameron Goodale <go...@apache.org>.
Sheryl,

Over in the Snow Data System we are still using OODT 0.3 (full stack) and
it works great.  10K's of jobs and TBs of disk used up in the process.

-Cam

On Mon, Aug 6, 2012 at 12:43 PM, Sheryl John <sh...@gmail.com> wrote:

> Hi everyone,
>
> I've been able to run and test workflow tasks with the resource manager on
> 0.3 versions. At CHLA, we've been using the 0.4 version without resmgr but
> due to runtime issues with workflow, we'd like to send out task jobs with
> resmgr and compare the performance.
>
> Is it safe to use the latest trunk updates for workflow, pge and resource
> manager?
> Also, which versions are you all using for the current projects?
>
>
> Thanks,
> Sheryl
>
>

Re: Latest trunk updates

Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hey Sheryl,

Once we wrap up OODT-215 and OODT-310 for wengine yes it will be totally safe and encouraged
to use 0.5-trunk (and beyond) for workflow + pge + resmgr.

Right now I'd recommend:

1. Taking an 0.3 release and then overlaying what you want out of 0.4 (e.g., filemgr, etc.).
2. Staying on 0.3.
3. Deploying 0.5-trunk, but using 0.3 workflow manager/pge/crawler.

As for what my JPL projects are using, some of them are using 0.5-trunk (they are doing mostly
curation + ingestion + crawling + met extraction, and/or using the new web interfaces), the
rest are using 0.3.

Cheers,
Chris

On Aug 6, 2012, at 12:43 PM, Sheryl John wrote:

> Hi everyone,
> 
> I've been able to run and test workflow tasks with the resource manager on 0.3 versions. At CHLA, we've been using the 0.4 version without resmgr but due to runtime issues with workflow, we'd like to send out task jobs with resmgr and compare the performance.
> 
> Is it safe to use the latest trunk updates for workflow, pge and resource manager? 
> Also, which versions are you all using for the current projects?
> 
> 
> Thanks,
> Sheryl
> 


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++