Re: DUCC SimplePipeline.runPipeline() ?

[Eddie Epstein <ea...@gmail.com>]

A DuccPipeline command sounds like a good idea. The DUCC Flow Controller,
DuccJobProcessFC, is in uima-ducc-common.jar. One should be able to include
that flow controller with uimafit by including that jar and referencing the
right package.

Eddie


On Tue, Nov 26, 2013 at 2:10 PM, Neal R Lewis <nr...@us.ibm.com> wrote:

> I'm running into a convenience issue developing for DUCC - mainly that I'm
> developing  on a different machine than is running the applications.
>
> I really like the ability of uimafit's runPipeline to rapidly develop and
> test UIMA components before I package them into large applications.  But
> with DUCC, I have to either go to the server room to develop, or ssh -X
> into the remote machine to develop and test using AllInOne, which provides
> lots of lag.
>
> I know there are CLI options for developing, like AllInOne, that will
> emulate the DUCC FlowController, but I'd like something I can run in from
> within my java project.
>
> My question is:  If I were to build an equivalent API for DUCC
> Flowcontroller,  one that will emulate running the "--all_in_one local"
> option, where would be the best places to look for what I need?  I've seen
> the org.apache.uima.ducc.cli.aio package, anything else?
>
> I'm don't think it would have to emulate queuing operations necessarily,
> It would just have to emulate what happens in a single DUCC controlled
> pipeline with WorkItem sendToAll, and sendToLast.
>
> Something like:
>
> DuccPipeline.runPipeline(cr, cm, ae, cc)
>
>
> Thanks!
>
> Neal
>
>
>

Re: DUCC SimplePipeline.runPipeline() ?

[Richard Eckart de Castilho <re...@apache.org>]

If it is easy, we could add a uimafit-ducc module to support DUCC,
similar to the uimafit-cpe module we already have. Unless, of course,
this is something which could be provided directly by DUCC.

Any proof-of-concept implementations are welcome!

-- Richard

On 26.11.2013, at 19:09, Neal R Lewis <nr...@us.ibm.com> wrote:

> Thanks Eddie,   I'll get looking into commons. 
> 
> -Neal 
> 
> From:   Eddie Epstein <ea...@gmail.com>
> To:     dev@uima.apache.org
> Date:   11/26/2013 12:28 PM
> Subject:        Re: DUCC SimplePipeline.runPipeline() ?
> 
> 
> 
> A DuccPipeline command sounds like a good idea. The DUCC Flow Controller,
> DuccJobProcessFC, is in uima-ducc-common.jar. One should be able to 
> include
> that flow controller with uimafit by including that jar and referencing 
> the
> right package.
> 
> Eddie
> 
> 
> On Tue, Nov 26, 2013 at 2:10 PM, Neal R Lewis <nr...@us.ibm.com> wrote:
> 
>> I'm running into a convenience issue developing for DUCC - mainly that 
> I'm
>> developing  on a different machine than is running the applications.
>> 
>> I really like the ability of uimafit's runPipeline to rapidly develop 
> and
>> test UIMA components before I package them into large applications.  But
>> with DUCC, I have to either go to the server room to develop, or ssh -X
>> into the remote machine to develop and test using AllInOne, which 
> provides
>> lots of lag.
>> 
>> I know there are CLI options for developing, like AllInOne, that will
>> emulate the DUCC FlowController, but I'd like something I can run in 
> from
>> within my java project.
>> 
>> My question is:  If I were to build an equivalent API for DUCC
>> Flowcontroller,  one that will emulate running the "--all_in_one local"
>> option, where would be the best places to look for what I need?  I've 
> seen
>> the org.apache.uima.ducc.cli.aio package, anything else?
>> 
>> I'm don't think it would have to emulate queuing operations necessarily,
>> It would just have to emulate what happens in a single DUCC controlled
>> pipeline with WorkItem sendToAll, and sendToLast.
>> 
>> Something like:
>> 
>> DuccPipeline.runPipeline(cr, cm, ae, cc)
>> 
>> 
>> Thanks!
>> 
>> Neal

Re: DUCC SimplePipeline.runPipeline() ?

[Neal R Lewis <nr...@us.ibm.com>]

Thanks Eddie,   I'll get looking into commons. 

-Neal 




From:   Eddie Epstein <ea...@gmail.com>
To:     dev@uima.apache.org
Date:   11/26/2013 12:28 PM
Subject:        Re: DUCC SimplePipeline.runPipeline() ?



A DuccPipeline command sounds like a good idea. The DUCC Flow Controller,
DuccJobProcessFC, is in uima-ducc-common.jar. One should be able to 
include
that flow controller with uimafit by including that jar and referencing 
the
right package.

Eddie


On Tue, Nov 26, 2013 at 2:10 PM, Neal R Lewis <nr...@us.ibm.com> wrote:

> I'm running into a convenience issue developing for DUCC - mainly that 
I'm
> developing  on a different machine than is running the applications.
>
> I really like the ability of uimafit's runPipeline to rapidly develop 
and
> test UIMA components before I package them into large applications.  But
> with DUCC, I have to either go to the server room to develop, or ssh -X
> into the remote machine to develop and test using AllInOne, which 
provides
> lots of lag.
>
> I know there are CLI options for developing, like AllInOne, that will
> emulate the DUCC FlowController, but I'd like something I can run in 
from
> within my java project.
>
> My question is:  If I were to build an equivalent API for DUCC
> Flowcontroller,  one that will emulate running the "--all_in_one local"
> option, where would be the best places to look for what I need?  I've 
seen
> the org.apache.uima.ducc.cli.aio package, anything else?
>
> I'm don't think it would have to emulate queuing operations necessarily,
> It would just have to emulate what happens in a single DUCC controlled
> pipeline with WorkItem sendToAll, and sendToLast.
>
> Something like:
>
> DuccPipeline.runPipeline(cr, cm, ae, cc)
>
>
> Thanks!
>
> Neal
>
>
>