You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@uima.apache.org by Wahed Hemati <he...@em.uni-frankfurt.de> on 2019/09/03 15:57:59 UTC
DUCC without shared file system
Hi there,
the release notes of DUCC 3.0.0 indicates, that one major change is,
that DUCC can now run without shared file system.
How do I set this up? In the Duccbook however it says that you need a
shared filesystem to add more nodes
(https://uima.apache.org/d/uima-ducc-3.0.0/duccbook.html#x1-22400012.9).
Thanks in advance.
-Wahed
Re: DUCC without shared file system
Posted by Eddie Epstein <ea...@gmail.com>.
Unless all CLI/API submissions are done from the head node, DUCC still has
a dependency on a shared filesystem to authenticate such requests for
configurations where user processes run with user credentials.
On Wed, Sep 4, 2019 at 9:41 AM Lou DeGenaro <lo...@gmail.com> wrote:
> The DUCC Book for the Apache-UIMA DUCC demo
> http://uima-ducc-demo.apache.org:42133/doc/duccbook.html has been updated
> with respect to Jira 6121. In particular, see section 12.9 for an example
> use of ducc_rsync to install DUCC on an additional worker node when not
> using a shared filesystem for $DUCC_HOME.
>
> On Tue, Sep 3, 2019 at 5:06 PM Lou DeGenaro <lo...@gmail.com>
> wrote:
>
> > I opened Jira https://issues.apache.org/jira/browse/UIMA-6121 to track
> > this issue.
> >
> >
> > On Tue, Sep 3, 2019 at 1:51 PM Lou DeGenaro <lo...@gmail.com>
> > wrote:
> >
> >> You not need do anything special to run DUCC without a shared
> >> filesystem. Simply install it on a local filesystem. However, there is
> >> one caveat. If the user's (e.g. DUCC jobs) log directory is not in a
> >> shared filesystem, then DUCC-Mon will not have access and the contents
> >> won't be viewable. I'll open a Jira to review the DUCC Book and
> fix/clarify
> >> shared file system requirements.
> >>
> >> Lou.
> >>
> >> On Tue, Sep 3, 2019 at 11:58 AM Wahed Hemati <
> hemati@em.uni-frankfurt.de>
> >> wrote:
> >>
> >>> Hi there,
> >>>
> >>> the release notes of DUCC 3.0.0 indicates, that one major change is,
> >>> that DUCC can now run without shared file system.
> >>>
> >>> How do I set this up? In the Duccbook however it says that you need a
> >>> shared filesystem to add more nodes
> >>> (https://uima.apache.org/d/uima-ducc-3.0.0/duccbook.html#x1-22400012.9
> ).
> >>>
> >>> Thanks in advance.
> >>>
> >>> -Wahed
> >>>
> >>>
>
Re: DUCC without shared file system
Posted by Lou DeGenaro <lo...@gmail.com>.
The DUCC Book for the Apache-UIMA DUCC demo
http://uima-ducc-demo.apache.org:42133/doc/duccbook.html has been updated
with respect to Jira 6121. In particular, see section 12.9 for an example
use of ducc_rsync to install DUCC on an additional worker node when not
using a shared filesystem for $DUCC_HOME.
On Tue, Sep 3, 2019 at 5:06 PM Lou DeGenaro <lo...@gmail.com> wrote:
> I opened Jira https://issues.apache.org/jira/browse/UIMA-6121 to track
> this issue.
>
>
> On Tue, Sep 3, 2019 at 1:51 PM Lou DeGenaro <lo...@gmail.com>
> wrote:
>
>> You not need do anything special to run DUCC without a shared
>> filesystem. Simply install it on a local filesystem. However, there is
>> one caveat. If the user's (e.g. DUCC jobs) log directory is not in a
>> shared filesystem, then DUCC-Mon will not have access and the contents
>> won't be viewable. I'll open a Jira to review the DUCC Book and fix/clarify
>> shared file system requirements.
>>
>> Lou.
>>
>> On Tue, Sep 3, 2019 at 11:58 AM Wahed Hemati <he...@em.uni-frankfurt.de>
>> wrote:
>>
>>> Hi there,
>>>
>>> the release notes of DUCC 3.0.0 indicates, that one major change is,
>>> that DUCC can now run without shared file system.
>>>
>>> How do I set this up? In the Duccbook however it says that you need a
>>> shared filesystem to add more nodes
>>> (https://uima.apache.org/d/uima-ducc-3.0.0/duccbook.html#x1-22400012.9).
>>>
>>> Thanks in advance.
>>>
>>> -Wahed
>>>
>>>
Re: DUCC without shared file system
Posted by Lou DeGenaro <lo...@gmail.com>.
I opened Jira https://issues.apache.org/jira/browse/UIMA-6121 to track this
issue.
On Tue, Sep 3, 2019 at 1:51 PM Lou DeGenaro <lo...@gmail.com> wrote:
> You not need do anything special to run DUCC without a shared filesystem.
> Simply install it on a local filesystem. However, there is one caveat. If
> the user's (e.g. DUCC jobs) log directory is not in a shared filesystem,
> then DUCC-Mon will not have access and the contents won't be viewable. I'll
> open a Jira to review the DUCC Book and fix/clarify shared file system
> requirements.
>
> Lou.
>
> On Tue, Sep 3, 2019 at 11:58 AM Wahed Hemati <he...@em.uni-frankfurt.de>
> wrote:
>
>> Hi there,
>>
>> the release notes of DUCC 3.0.0 indicates, that one major change is,
>> that DUCC can now run without shared file system.
>>
>> How do I set this up? In the Duccbook however it says that you need a
>> shared filesystem to add more nodes
>> (https://uima.apache.org/d/uima-ducc-3.0.0/duccbook.html#x1-22400012.9).
>>
>> Thanks in advance.
>>
>> -Wahed
>>
>>
Re: DUCC without shared file system
Posted by Lou DeGenaro <lo...@gmail.com>.
You not need do anything special to run DUCC without a shared filesystem.
Simply install it on a local filesystem. However, there is one caveat. If
the user's (e.g. DUCC jobs) log directory is not in a shared filesystem,
then DUCC-Mon will not have access and the contents won't be viewable. I'll
open a Jira to review the DUCC Book and fix/clarify shared file system
requirements.
Lou.
On Tue, Sep 3, 2019 at 11:58 AM Wahed Hemati <he...@em.uni-frankfurt.de>
wrote:
> Hi there,
>
> the release notes of DUCC 3.0.0 indicates, that one major change is,
> that DUCC can now run without shared file system.
>
> How do I set this up? In the Duccbook however it says that you need a
> shared filesystem to add more nodes
> (https://uima.apache.org/d/uima-ducc-3.0.0/duccbook.html#x1-22400012.9).
>
> Thanks in advance.
>
> -Wahed
>
>