Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

Hi,

Received feedback from couple of folks that IdempotentStorageManager is not
a good name for that component. It is used in some of our input/output
operator for saving per window data.

I was thinking of calling it WindowLogger.

Let me know if anyone has a better suggestion.

Chandni

Re: Renaming Idempotent Storage Manager

[Yogi Devendra <de...@gmail.com>]

Name WindowDataLogger sounds like class is responsible for plain dump log
of data(at window level). It does not reflect if it used for recovery or
any other purpose.

WindowDataManager is more generic name which does not reflect any specific
purpose. It can do any umbrella activity required to manage data.

This looks like a tradeoff between precision and accuracy. Developer may
take a final call.

~ Yogi

On 17 November 2015 at 11:52, Chandni Singh <ch...@datatorrent.com> wrote:

> ---
> I like 1 and 3 but prefer 3 because we may not always be logging data but
> saving meta-data.
> --
>
> We are saving data or meta-data somewhere for recovery. WindowDataManager
> doesn't reflect that data or meta-data is persisted.
>
> Chandni
>
> On Mon, Nov 16, 2015 at 10:12 PM, Yogi Devendra <yo...@apache.org>
> wrote:
>
> > +1 for WindowDataManager
> >
> > On 17 November 2015 at 10:58, Sandeep Deshmukh <sa...@datatorrent.com>
> > wrote:
> >
> > > +1 for 3.
> > > On 17 Nov 2015 07:25, "Timothy Farkas" <ti...@datatorrent.com> wrote:
> > >
> > > > +1 for 1
> > > >
> > > > On Mon, Nov 16, 2015 at 2:35 PM, Pramod Immaneni <
> > pramod@datatorrent.com
> > > >
> > > > wrote:
> > > >
> > > > > I like 1 and 3 but prefer 3 because we may not always be logging
> data
> > > but
> > > > > saving meta-data.
> > > > >
> > > > > On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> > > chandni@datatorrent.com>
> > > > > wrote:
> > > > >
> > > > > > Currently going by Java code, the IdempotentStorageManager
> extends
> > > > > > StorageAgent which is why WindowStorageAgent came up.
> > > > > > It does delete data till window that gets committed.
> > > > > >
> > > > > >
> > > > > > These are some options which I have came across.
> > > > > >
> > > > > > 1. WindowDataLogger
> > > > > > 2. WindowStorageAgent
> > > > > > 3. WindowDataManager
> > > > > >
> > > > > > My vote is for option 1 "WindowDataLogger".
> > > > > >
> > > > > > Thanks,
> > > > > > Chandni
> > > > > >
> > > > > > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> > > > pramod@datatorrent.com
> > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > It would still to manage the log isn't it, like clearing out
> data
> > > > > > > corresponding to committed windows.
> > > > > > >
> > > > > > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> > > > thomas@datatorrent.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > The underlying abstraction is a log. Why shouldn't the name
> > > reflect
> > > > > > that?
> > > > > > > > Or is there anything added that makes it a "manager" or
> > "agent"?
> > > > > > > >
> > > > > > > >
> > > > > > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > > > > > chandni@datatorrent.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > WindowStorageAgent was another suggestion as
> > > > > IdempotentStorageManager
> > > > > > > > > extends StorageAgent.
> > > > > > > > > If no one has any objection will call it that.
> > > > > > > > >
> > > > > > > > > Chandni
> > > > > > > > >
> > > > > > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > > > > > chandni@datatorrent.com>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > @Sandeep Will deprecate old IdempotentStorageManager.
> This
> > > will
> > > > > be
> > > > > > a
> > > > > > > > copy
> > > > > > > > > > of the old one with a different name.
> > > > > > > > > >
> > > > > > > > > > @Sandesh
> > > > > > > > > > A data store, in my opinion, is an entity which store
> data.
> > > > This
> > > > > > > > doesn't
> > > > > > > > > > store data. It is used to save state per window.
> > > > > > > > > >
> > > > > > > > > > @Pramod
> > > > > > > > > > Do you like WindowStateLogger?
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Chandni
> > > > > > > > > >
> > > > > > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > > > > > sandeep@datatorrent.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >> Will there be any issue in semantic versioning because
> of
> > > this
> > > > > > > change?
> > > > > > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> > > > sandesh@datatorrent.com>
> > > > > > > > wrote:
> > > > > > > > > >>
> > > > > > > > > >> > As it is used to store & retrieve data, just call it
> > > > > DataStore.
> > > > > > > > > >> >
> > > > > > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > > > > > pramod@datatorrent.com
> > > > > > > > > >> >
> > > > > > > > > >> > wrote:
> > > > > > > > > >> >
> > > > > > > > > >> > > Since this is mainly for storing information
> > pertaining
> > > to
> > > > > > data
> > > > > > > or
> > > > > > > > > the
> > > > > > > > > >> > data
> > > > > > > > > >> > > itself how about WindowDataManager or something like
> > > that.
> > > > > > > > > >> > >
> > > > > > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > > > > > >> chandni@datatorrent.com>
> > > > > > > > > >> > > wrote:
> > > > > > > > > >> > >
> > > > > > > > > >> > > > Hi,
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > Received feedback from couple of folks that
> > > > > > > > > >> IdempotentStorageManager is
> > > > > > > > > >> > > not
> > > > > > > > > >> > > > a good name for that component. It is used in some
> > of
> > > > our
> > > > > > > > > >> input/output
> > > > > > > > > >> > > > operator for saving per window data.
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > Chandni
> > > > > > > > > >> > > >
> > > > > > > > > >> > >
> > > > > > > > > >> >
> > > > > > > > > >>
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

---
I like 1 and 3 but prefer 3 because we may not always be logging data but
saving meta-data.
--

We are saving data or meta-data somewhere for recovery. WindowDataManager
doesn't reflect that data or meta-data is persisted.

Chandni

On Mon, Nov 16, 2015 at 10:12 PM, Yogi Devendra <yo...@apache.org>
wrote:

> +1 for WindowDataManager
>
> On 17 November 2015 at 10:58, Sandeep Deshmukh <sa...@datatorrent.com>
> wrote:
>
> > +1 for 3.
> > On 17 Nov 2015 07:25, "Timothy Farkas" <ti...@datatorrent.com> wrote:
> >
> > > +1 for 1
> > >
> > > On Mon, Nov 16, 2015 at 2:35 PM, Pramod Immaneni <
> pramod@datatorrent.com
> > >
> > > wrote:
> > >
> > > > I like 1 and 3 but prefer 3 because we may not always be logging data
> > but
> > > > saving meta-data.
> > > >
> > > > On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> > chandni@datatorrent.com>
> > > > wrote:
> > > >
> > > > > Currently going by Java code, the IdempotentStorageManager extends
> > > > > StorageAgent which is why WindowStorageAgent came up.
> > > > > It does delete data till window that gets committed.
> > > > >
> > > > >
> > > > > These are some options which I have came across.
> > > > >
> > > > > 1. WindowDataLogger
> > > > > 2. WindowStorageAgent
> > > > > 3. WindowDataManager
> > > > >
> > > > > My vote is for option 1 "WindowDataLogger".
> > > > >
> > > > > Thanks,
> > > > > Chandni
> > > > >
> > > > > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> > > pramod@datatorrent.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > It would still to manage the log isn't it, like clearing out data
> > > > > > corresponding to committed windows.
> > > > > >
> > > > > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> > > thomas@datatorrent.com>
> > > > > > wrote:
> > > > > >
> > > > > > > The underlying abstraction is a log. Why shouldn't the name
> > reflect
> > > > > that?
> > > > > > > Or is there anything added that makes it a "manager" or
> "agent"?
> > > > > > >
> > > > > > >
> > > > > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > > > > chandni@datatorrent.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > WindowStorageAgent was another suggestion as
> > > > IdempotentStorageManager
> > > > > > > > extends StorageAgent.
> > > > > > > > If no one has any objection will call it that.
> > > > > > > >
> > > > > > > > Chandni
> > > > > > > >
> > > > > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > > > > chandni@datatorrent.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This
> > will
> > > > be
> > > > > a
> > > > > > > copy
> > > > > > > > > of the old one with a different name.
> > > > > > > > >
> > > > > > > > > @Sandesh
> > > > > > > > > A data store, in my opinion, is an entity which store data.
> > > This
> > > > > > > doesn't
> > > > > > > > > store data. It is used to save state per window.
> > > > > > > > >
> > > > > > > > > @Pramod
> > > > > > > > > Do you like WindowStateLogger?
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Chandni
> > > > > > > > >
> > > > > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > > > > sandeep@datatorrent.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >> Will there be any issue in semantic versioning because of
> > this
> > > > > > change?
> > > > > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> > > sandesh@datatorrent.com>
> > > > > > > wrote:
> > > > > > > > >>
> > > > > > > > >> > As it is used to store & retrieve data, just call it
> > > > DataStore.
> > > > > > > > >> >
> > > > > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > > > > pramod@datatorrent.com
> > > > > > > > >> >
> > > > > > > > >> > wrote:
> > > > > > > > >> >
> > > > > > > > >> > > Since this is mainly for storing information
> pertaining
> > to
> > > > > data
> > > > > > or
> > > > > > > > the
> > > > > > > > >> > data
> > > > > > > > >> > > itself how about WindowDataManager or something like
> > that.
> > > > > > > > >> > >
> > > > > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > > > > >> chandni@datatorrent.com>
> > > > > > > > >> > > wrote:
> > > > > > > > >> > >
> > > > > > > > >> > > > Hi,
> > > > > > > > >> > > >
> > > > > > > > >> > > > Received feedback from couple of folks that
> > > > > > > > >> IdempotentStorageManager is
> > > > > > > > >> > > not
> > > > > > > > >> > > > a good name for that component. It is used in some
> of
> > > our
> > > > > > > > >> input/output
> > > > > > > > >> > > > operator for saving per window data.
> > > > > > > > >> > > >
> > > > > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > > > > >> > > >
> > > > > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > > > > >> > > >
> > > > > > > > >> > > > Chandni
> > > > > > > > >> > > >
> > > > > > > > >> > >
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Yogi Devendra <yo...@apache.org>]

+1 for WindowDataManager

On 17 November 2015 at 10:58, Sandeep Deshmukh <sa...@datatorrent.com>
wrote:

> +1 for 3.
> On 17 Nov 2015 07:25, "Timothy Farkas" <ti...@datatorrent.com> wrote:
>
> > +1 for 1
> >
> > On Mon, Nov 16, 2015 at 2:35 PM, Pramod Immaneni <pramod@datatorrent.com
> >
> > wrote:
> >
> > > I like 1 and 3 but prefer 3 because we may not always be logging data
> but
> > > saving meta-data.
> > >
> > > On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> chandni@datatorrent.com>
> > > wrote:
> > >
> > > > Currently going by Java code, the IdempotentStorageManager extends
> > > > StorageAgent which is why WindowStorageAgent came up.
> > > > It does delete data till window that gets committed.
> > > >
> > > >
> > > > These are some options which I have came across.
> > > >
> > > > 1. WindowDataLogger
> > > > 2. WindowStorageAgent
> > > > 3. WindowDataManager
> > > >
> > > > My vote is for option 1 "WindowDataLogger".
> > > >
> > > > Thanks,
> > > > Chandni
> > > >
> > > > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> > pramod@datatorrent.com
> > > >
> > > > wrote:
> > > >
> > > > > It would still to manage the log isn't it, like clearing out data
> > > > > corresponding to committed windows.
> > > > >
> > > > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> > thomas@datatorrent.com>
> > > > > wrote:
> > > > >
> > > > > > The underlying abstraction is a log. Why shouldn't the name
> reflect
> > > > that?
> > > > > > Or is there anything added that makes it a "manager" or "agent"?
> > > > > >
> > > > > >
> > > > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > > > chandni@datatorrent.com>
> > > > > > wrote:
> > > > > >
> > > > > > > WindowStorageAgent was another suggestion as
> > > IdempotentStorageManager
> > > > > > > extends StorageAgent.
> > > > > > > If no one has any objection will call it that.
> > > > > > >
> > > > > > > Chandni
> > > > > > >
> > > > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > > > chandni@datatorrent.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This
> will
> > > be
> > > > a
> > > > > > copy
> > > > > > > > of the old one with a different name.
> > > > > > > >
> > > > > > > > @Sandesh
> > > > > > > > A data store, in my opinion, is an entity which store data.
> > This
> > > > > > doesn't
> > > > > > > > store data. It is used to save state per window.
> > > > > > > >
> > > > > > > > @Pramod
> > > > > > > > Do you like WindowStateLogger?
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Chandni
> > > > > > > >
> > > > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > > > sandeep@datatorrent.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > >> Will there be any issue in semantic versioning because of
> this
> > > > > change?
> > > > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> > sandesh@datatorrent.com>
> > > > > > wrote:
> > > > > > > >>
> > > > > > > >> > As it is used to store & retrieve data, just call it
> > > DataStore.
> > > > > > > >> >
> > > > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > > > pramod@datatorrent.com
> > > > > > > >> >
> > > > > > > >> > wrote:
> > > > > > > >> >
> > > > > > > >> > > Since this is mainly for storing information pertaining
> to
> > > > data
> > > > > or
> > > > > > > the
> > > > > > > >> > data
> > > > > > > >> > > itself how about WindowDataManager or something like
> that.
> > > > > > > >> > >
> > > > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > > > >> chandni@datatorrent.com>
> > > > > > > >> > > wrote:
> > > > > > > >> > >
> > > > > > > >> > > > Hi,
> > > > > > > >> > > >
> > > > > > > >> > > > Received feedback from couple of folks that
> > > > > > > >> IdempotentStorageManager is
> > > > > > > >> > > not
> > > > > > > >> > > > a good name for that component. It is used in some of
> > our
> > > > > > > >> input/output
> > > > > > > >> > > > operator for saving per window data.
> > > > > > > >> > > >
> > > > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > > > >> > > >
> > > > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > > > >> > > >
> > > > > > > >> > > > Chandni
> > > > > > > >> > > >
> > > > > > > >> > >
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Sandeep Deshmukh <sa...@datatorrent.com>]

+1 for 3.
On 17 Nov 2015 07:25, "Timothy Farkas" <ti...@datatorrent.com> wrote:

> +1 for 1
>
> On Mon, Nov 16, 2015 at 2:35 PM, Pramod Immaneni <pr...@datatorrent.com>
> wrote:
>
> > I like 1 and 3 but prefer 3 because we may not always be logging data but
> > saving meta-data.
> >
> > On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <ch...@datatorrent.com>
> > wrote:
> >
> > > Currently going by Java code, the IdempotentStorageManager extends
> > > StorageAgent which is why WindowStorageAgent came up.
> > > It does delete data till window that gets committed.
> > >
> > >
> > > These are some options which I have came across.
> > >
> > > 1. WindowDataLogger
> > > 2. WindowStorageAgent
> > > 3. WindowDataManager
> > >
> > > My vote is for option 1 "WindowDataLogger".
> > >
> > > Thanks,
> > > Chandni
> > >
> > > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> pramod@datatorrent.com
> > >
> > > wrote:
> > >
> > > > It would still to manage the log isn't it, like clearing out data
> > > > corresponding to committed windows.
> > > >
> > > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> thomas@datatorrent.com>
> > > > wrote:
> > > >
> > > > > The underlying abstraction is a log. Why shouldn't the name reflect
> > > that?
> > > > > Or is there anything added that makes it a "manager" or "agent"?
> > > > >
> > > > >
> > > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > > chandni@datatorrent.com>
> > > > > wrote:
> > > > >
> > > > > > WindowStorageAgent was another suggestion as
> > IdempotentStorageManager
> > > > > > extends StorageAgent.
> > > > > > If no one has any objection will call it that.
> > > > > >
> > > > > > Chandni
> > > > > >
> > > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > > chandni@datatorrent.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This will
> > be
> > > a
> > > > > copy
> > > > > > > of the old one with a different name.
> > > > > > >
> > > > > > > @Sandesh
> > > > > > > A data store, in my opinion, is an entity which store data.
> This
> > > > > doesn't
> > > > > > > store data. It is used to save state per window.
> > > > > > >
> > > > > > > @Pramod
> > > > > > > Do you like WindowStateLogger?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Chandni
> > > > > > >
> > > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > > sandeep@datatorrent.com
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Will there be any issue in semantic versioning because of this
> > > > change?
> > > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> sandesh@datatorrent.com>
> > > > > wrote:
> > > > > > >>
> > > > > > >> > As it is used to store & retrieve data, just call it
> > DataStore.
> > > > > > >> >
> > > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > > pramod@datatorrent.com
> > > > > > >> >
> > > > > > >> > wrote:
> > > > > > >> >
> > > > > > >> > > Since this is mainly for storing information pertaining to
> > > data
> > > > or
> > > > > > the
> > > > > > >> > data
> > > > > > >> > > itself how about WindowDataManager or something like that.
> > > > > > >> > >
> > > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > > >> chandni@datatorrent.com>
> > > > > > >> > > wrote:
> > > > > > >> > >
> > > > > > >> > > > Hi,
> > > > > > >> > > >
> > > > > > >> > > > Received feedback from couple of folks that
> > > > > > >> IdempotentStorageManager is
> > > > > > >> > > not
> > > > > > >> > > > a good name for that component. It is used in some of
> our
> > > > > > >> input/output
> > > > > > >> > > > operator for saving per window data.
> > > > > > >> > > >
> > > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > > >> > > >
> > > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > > >> > > >
> > > > > > >> > > > Chandni
> > > > > > >> > > >
> > > > > > >> > >
> > > > > > >> >
> > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Timothy Farkas <ti...@datatorrent.com>]

+1 for 1

On Mon, Nov 16, 2015 at 2:35 PM, Pramod Immaneni <pr...@datatorrent.com>
wrote:

> I like 1 and 3 but prefer 3 because we may not always be logging data but
> saving meta-data.
>
> On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <ch...@datatorrent.com>
> wrote:
>
> > Currently going by Java code, the IdempotentStorageManager extends
> > StorageAgent which is why WindowStorageAgent came up.
> > It does delete data till window that gets committed.
> >
> >
> > These are some options which I have came across.
> >
> > 1. WindowDataLogger
> > 2. WindowStorageAgent
> > 3. WindowDataManager
> >
> > My vote is for option 1 "WindowDataLogger".
> >
> > Thanks,
> > Chandni
> >
> > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <pramod@datatorrent.com
> >
> > wrote:
> >
> > > It would still to manage the log isn't it, like clearing out data
> > > corresponding to committed windows.
> > >
> > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <th...@datatorrent.com>
> > > wrote:
> > >
> > > > The underlying abstraction is a log. Why shouldn't the name reflect
> > that?
> > > > Or is there anything added that makes it a "manager" or "agent"?
> > > >
> > > >
> > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > chandni@datatorrent.com>
> > > > wrote:
> > > >
> > > > > WindowStorageAgent was another suggestion as
> IdempotentStorageManager
> > > > > extends StorageAgent.
> > > > > If no one has any objection will call it that.
> > > > >
> > > > > Chandni
> > > > >
> > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > chandni@datatorrent.com>
> > > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This will
> be
> > a
> > > > copy
> > > > > > of the old one with a different name.
> > > > > >
> > > > > > @Sandesh
> > > > > > A data store, in my opinion, is an entity which store data. This
> > > > doesn't
> > > > > > store data. It is used to save state per window.
> > > > > >
> > > > > > @Pramod
> > > > > > Do you like WindowStateLogger?
> > > > > >
> > > > > > Thanks,
> > > > > > Chandni
> > > > > >
> > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > sandeep@datatorrent.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > >> Will there be any issue in semantic versioning because of this
> > > change?
> > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com>
> > > > wrote:
> > > > > >>
> > > > > >> > As it is used to store & retrieve data, just call it
> DataStore.
> > > > > >> >
> > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > pramod@datatorrent.com
> > > > > >> >
> > > > > >> > wrote:
> > > > > >> >
> > > > > >> > > Since this is mainly for storing information pertaining to
> > data
> > > or
> > > > > the
> > > > > >> > data
> > > > > >> > > itself how about WindowDataManager or something like that.
> > > > > >> > >
> > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > >> chandni@datatorrent.com>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > > Hi,
> > > > > >> > > >
> > > > > >> > > > Received feedback from couple of folks that
> > > > > >> IdempotentStorageManager is
> > > > > >> > > not
> > > > > >> > > > a good name for that component. It is used in some of our
> > > > > >> input/output
> > > > > >> > > > operator for saving per window data.
> > > > > >> > > >
> > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > >> > > >
> > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > >> > > >
> > > > > >> > > > Chandni
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Pramod Immaneni <pr...@datatorrent.com>]

I like 1 and 3 but prefer 3 because we may not always be logging data but
saving meta-data.

On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <ch...@datatorrent.com>
wrote:

> Currently going by Java code, the IdempotentStorageManager extends
> StorageAgent which is why WindowStorageAgent came up.
> It does delete data till window that gets committed.
>
>
> These are some options which I have came across.
>
> 1. WindowDataLogger
> 2. WindowStorageAgent
> 3. WindowDataManager
>
> My vote is for option 1 "WindowDataLogger".
>
> Thanks,
> Chandni
>
> On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <pr...@datatorrent.com>
> wrote:
>
> > It would still to manage the log isn't it, like clearing out data
> > corresponding to committed windows.
> >
> > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <th...@datatorrent.com>
> > wrote:
> >
> > > The underlying abstraction is a log. Why shouldn't the name reflect
> that?
> > > Or is there anything added that makes it a "manager" or "agent"?
> > >
> > >
> > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> chandni@datatorrent.com>
> > > wrote:
> > >
> > > > WindowStorageAgent was another suggestion as IdempotentStorageManager
> > > > extends StorageAgent.
> > > > If no one has any objection will call it that.
> > > >
> > > > Chandni
> > > >
> > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > chandni@datatorrent.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > @Sandeep Will deprecate old IdempotentStorageManager. This will be
> a
> > > copy
> > > > > of the old one with a different name.
> > > > >
> > > > > @Sandesh
> > > > > A data store, in my opinion, is an entity which store data. This
> > > doesn't
> > > > > store data. It is used to save state per window.
> > > > >
> > > > > @Pramod
> > > > > Do you like WindowStateLogger?
> > > > >
> > > > > Thanks,
> > > > > Chandni
> > > > >
> > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> sandeep@datatorrent.com
> > >
> > > > > wrote:
> > > > >
> > > > >> Will there be any issue in semantic versioning because of this
> > change?
> > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com>
> > > wrote:
> > > > >>
> > > > >> > As it is used to store & retrieve data, just call it DataStore.
> > > > >> >
> > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > pramod@datatorrent.com
> > > > >> >
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Since this is mainly for storing information pertaining to
> data
> > or
> > > > the
> > > > >> > data
> > > > >> > > itself how about WindowDataManager or something like that.
> > > > >> > >
> > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > >> chandni@datatorrent.com>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > > Hi,
> > > > >> > > >
> > > > >> > > > Received feedback from couple of folks that
> > > > >> IdempotentStorageManager is
> > > > >> > > not
> > > > >> > > > a good name for that component. It is used in some of our
> > > > >> input/output
> > > > >> > > > operator for saving per window data.
> > > > >> > > >
> > > > >> > > > I was thinking of calling it WindowLogger.
> > > > >> > > >
> > > > >> > > > Let me know if anyone has a better suggestion.
> > > > >> > > >
> > > > >> > > > Chandni
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Amol Kekre <am...@datatorrent.com>]

Chandni,
I am late but my vote is for WindowDataManager too.

Thks
Amol

On Wed, Nov 18, 2015 at 2:35 PM, Chandni Singh <ch...@datatorrent.com>
wrote:

> It has been 72 hours. 4 votes for WindowDataLogger  and 6 votes for
> WindowDataManager.
>
> Will call it WindowDataManager.
>
> Chandni
>
> On Wed, Nov 18, 2015 at 8:27 AM, Munagala Ramanath <ra...@datatorrent.com>
> wrote:
>
> > +1 WindowDataManager
> >
> >
> > Ram
> >
> > On Wed, Nov 18, 2015 at 7:47 AM, Sandesh Hegde <sa...@datatorrent.com>
> > wrote:
> > > +1 WindowDataManager
> > >
> > > On Wed, Nov 18, 2015 at 1:01 AM Gaurav Gupta <ga...@datatorrent.com>
> > wrote:
> > >
> > >> +1 for WindowDataManager. WindowDataLogger feels like another utility
> to
> > >> log but Idempotent Storage Manager is more than that.
> > >>
> > >> Thanks
> > >> - Gaurav
> > >>
> > >> > On Nov 18, 2015, at 12:52 AM, Chandni Singh <
> chandni@datatorrent.com>
> > >> wrote:
> > >> >
> > >> > It had been 2 days and most of the people who had shown any interest
> > in
> > >> > this component had already voted.
> > >> > However, if anyone still has other ideas please bring it up.
> > >> >
> > >> > Chandni
> > >> >
> > >> > On Tue, Nov 17, 2015 at 6:24 PM, Thomas Weise <
> thomas@datatorrent.com
> > >
> > >> > wrote:
> > >> >
> > >> >> If you start discussions that mutate into "voting", you need to
> allow
> > >> for
> > >> >> sufficient time for feedback.
> > >> >>
> > >> >> --
> > >> >> sent from mobile
> > >> >> On Nov 17, 2015 5:37 PM, "Chandni Singh" <ch...@datatorrent.com>
> > >> wrote:
> > >> >>
> > >> >>> Concluding this discussion. There are 4 votes for WindowDataLogger
> > and
> > >> 3
> > >> >>> for WindowDataManager. Will call it WindowDataLogger.
> > >> >>>
> > >> >>> The ticket is created here:
> > >> >>> https://malhar.atlassian.net/browse/MLHR-1902
> > >> >>>
> > >> >>> Thanks,
> > >> >>> Chandni
> > >> >>>
> > >> >>>
> > >> >>> On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <
> siyuan@datatorrent.com
> > >
> > >> >>> wrote:
> > >> >>>
> > >> >>>> +1 for 1
> > >> >>>>
> > >> >>>> On Tue, Nov 17, 2015 at 10:30 AM, David Yan <
> david@datatorrent.com
> > >
> > >> >>> wrote:
> > >> >>>>
> > >> >>>>> +1 for 1
> > >> >>>>>
> > >> >>>>> On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> > >> >>> chandni@datatorrent.com>
> > >> >>>>> wrote:
> > >> >>>>>
> > >> >>>>>> Currently going by Java code, the IdempotentStorageManager
> > extends
> > >> >>>>>> StorageAgent which is why WindowStorageAgent came up.
> > >> >>>>>> It does delete data till window that gets committed.
> > >> >>>>>>
> > >> >>>>>>
> > >> >>>>>> These are some options which I have came across.
> > >> >>>>>>
> > >> >>>>>> 1. WindowDataLogger
> > >> >>>>>> 2. WindowStorageAgent
> > >> >>>>>> 3. WindowDataManager
> > >> >>>>>>
> > >> >>>>>> My vote is for option 1 "WindowDataLogger".
> > >> >>>>>>
> > >> >>>>>> Thanks,
> > >> >>>>>> Chandni
> > >> >>>>>>
> > >> >>>>>> On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> > >> >>>> pramod@datatorrent.com
> > >> >>>>>>
> > >> >>>>>> wrote:
> > >> >>>>>>
> > >> >>>>>>> It would still to manage the log isn't it, like clearing out
> > data
> > >> >>>>>>> corresponding to committed windows.
> > >> >>>>>>>
> > >> >>>>>>> On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> > >> >>>> thomas@datatorrent.com>
> > >> >>>>>>> wrote:
> > >> >>>>>>>
> > >> >>>>>>>> The underlying abstraction is a log. Why shouldn't the name
> > >> >>> reflect
> > >> >>>>>> that?
> > >> >>>>>>>> Or is there anything added that makes it a "manager" or
> > >> >> "agent"?
> > >> >>>>>>>>
> > >> >>>>>>>>
> > >> >>>>>>>> On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > >> >>>>>> chandni@datatorrent.com>
> > >> >>>>>>>> wrote:
> > >> >>>>>>>>
> > >> >>>>>>>>> WindowStorageAgent was another suggestion as
> > >> >>>>> IdempotentStorageManager
> > >> >>>>>>>>> extends StorageAgent.
> > >> >>>>>>>>> If no one has any objection will call it that.
> > >> >>>>>>>>>
> > >> >>>>>>>>> Chandni
> > >> >>>>>>>>>
> > >> >>>>>>>>> On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > >> >>>>>>> chandni@datatorrent.com>
> > >> >>>>>>>>> wrote:
> > >> >>>>>>>>>
> > >> >>>>>>>>>> Hi,
> > >> >>>>>>>>>>
> > >> >>>>>>>>>> @Sandeep Will deprecate old IdempotentStorageManager. This
> > >> >>> will
> > >> >>>>> be
> > >> >>>>>> a
> > >> >>>>>>>> copy
> > >> >>>>>>>>>> of the old one with a different name.
> > >> >>>>>>>>>>
> > >> >>>>>>>>>> @Sandesh
> > >> >>>>>>>>>> A data store, in my opinion, is an entity which store data.
> > >> >>>> This
> > >> >>>>>>>> doesn't
> > >> >>>>>>>>>> store data. It is used to save state per window.
> > >> >>>>>>>>>>
> > >> >>>>>>>>>> @Pramod
> > >> >>>>>>>>>> Do you like WindowStateLogger?
> > >> >>>>>>>>>>
> > >> >>>>>>>>>> Thanks,
> > >> >>>>>>>>>> Chandni
> > >> >>>>>>>>>>
> > >> >>>>>>>>>> On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > >> >>>>>> sandeep@datatorrent.com
> > >> >>>>>>>>
> > >> >>>>>>>>>> wrote:
> > >> >>>>>>>>>>
> > >> >>>>>>>>>>> Will there be any issue in semantic versioning because of
> > >> >>> this
> > >> >>>>>>> change?
> > >> >>>>>>>>>>> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> > >> >>>> sandesh@datatorrent.com>
> > >> >>>>>>>> wrote:
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>>> As it is used to store & retrieve data, just call it
> > >> >>>>> DataStore.
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > >> >>>>>>>>> pramod@datatorrent.com
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>> wrote:
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>>> Since this is mainly for storing information
> > >> >> pertaining
> > >> >>> to
> > >> >>>>>> data
> > >> >>>>>>> or
> > >> >>>>>>>>> the
> > >> >>>>>>>>>>>> data
> > >> >>>>>>>>>>>>> itself how about WindowDataManager or something like
> > >> >>> that.
> > >> >>>>>>>>>>>>>
> > >> >>>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > >> >>>>>>>>>>> chandni@datatorrent.com>
> > >> >>>>>>>>>>>>> wrote:
> > >> >>>>>>>>>>>>>
> > >> >>>>>>>>>>>>>> Hi,
> > >> >>>>>>>>>>>>>>
> > >> >>>>>>>>>>>>>> Received feedback from couple of folks that
> > >> >>>>>>>>>>> IdempotentStorageManager is
> > >> >>>>>>>>>>>>> not
> > >> >>>>>>>>>>>>>> a good name for that component. It is used in some
> > >> >> of
> > >> >>>> our
> > >> >>>>>>>>>>> input/output
> > >> >>>>>>>>>>>>>> operator for saving per window data.
> > >> >>>>>>>>>>>>>>
> > >> >>>>>>>>>>>>>> I was thinking of calling it WindowLogger.
> > >> >>>>>>>>>>>>>>
> > >> >>>>>>>>>>>>>> Let me know if anyone has a better suggestion.
> > >> >>>>>>>>>>>>>>
> > >> >>>>>>>>>>>>>> Chandni
> > >> >>>>>>>>>>>>>>
> > >> >>>>>>>>>>>>>
> > >> >>>>>>>>>>>>
> > >> >>>>>>>>>>>
> > >> >>>>>>>>>>
> > >> >>>>>>>>>
> > >> >>>>>>>>
> > >> >>>>>>>
> > >> >>>>>>
> > >> >>>>>
> > >> >>>>
> > >> >>>
> > >> >>
> > >>
> > >>
> >
>

Re: Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

It has been 72 hours. 4 votes for WindowDataLogger  and 6 votes for
WindowDataManager.

Will call it WindowDataManager.

Chandni

On Wed, Nov 18, 2015 at 8:27 AM, Munagala Ramanath <ra...@datatorrent.com>
wrote:

> +1 WindowDataManager
>
>
> Ram
>
> On Wed, Nov 18, 2015 at 7:47 AM, Sandesh Hegde <sa...@datatorrent.com>
> wrote:
> > +1 WindowDataManager
> >
> > On Wed, Nov 18, 2015 at 1:01 AM Gaurav Gupta <ga...@datatorrent.com>
> wrote:
> >
> >> +1 for WindowDataManager. WindowDataLogger feels like another utility to
> >> log but Idempotent Storage Manager is more than that.
> >>
> >> Thanks
> >> - Gaurav
> >>
> >> > On Nov 18, 2015, at 12:52 AM, Chandni Singh <ch...@datatorrent.com>
> >> wrote:
> >> >
> >> > It had been 2 days and most of the people who had shown any interest
> in
> >> > this component had already voted.
> >> > However, if anyone still has other ideas please bring it up.
> >> >
> >> > Chandni
> >> >
> >> > On Tue, Nov 17, 2015 at 6:24 PM, Thomas Weise <thomas@datatorrent.com
> >
> >> > wrote:
> >> >
> >> >> If you start discussions that mutate into "voting", you need to allow
> >> for
> >> >> sufficient time for feedback.
> >> >>
> >> >> --
> >> >> sent from mobile
> >> >> On Nov 17, 2015 5:37 PM, "Chandni Singh" <ch...@datatorrent.com>
> >> wrote:
> >> >>
> >> >>> Concluding this discussion. There are 4 votes for WindowDataLogger
> and
> >> 3
> >> >>> for WindowDataManager. Will call it WindowDataLogger.
> >> >>>
> >> >>> The ticket is created here:
> >> >>> https://malhar.atlassian.net/browse/MLHR-1902
> >> >>>
> >> >>> Thanks,
> >> >>> Chandni
> >> >>>
> >> >>>
> >> >>> On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <siyuan@datatorrent.com
> >
> >> >>> wrote:
> >> >>>
> >> >>>> +1 for 1
> >> >>>>
> >> >>>> On Tue, Nov 17, 2015 at 10:30 AM, David Yan <david@datatorrent.com
> >
> >> >>> wrote:
> >> >>>>
> >> >>>>> +1 for 1
> >> >>>>>
> >> >>>>> On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> >> >>> chandni@datatorrent.com>
> >> >>>>> wrote:
> >> >>>>>
> >> >>>>>> Currently going by Java code, the IdempotentStorageManager
> extends
> >> >>>>>> StorageAgent which is why WindowStorageAgent came up.
> >> >>>>>> It does delete data till window that gets committed.
> >> >>>>>>
> >> >>>>>>
> >> >>>>>> These are some options which I have came across.
> >> >>>>>>
> >> >>>>>> 1. WindowDataLogger
> >> >>>>>> 2. WindowStorageAgent
> >> >>>>>> 3. WindowDataManager
> >> >>>>>>
> >> >>>>>> My vote is for option 1 "WindowDataLogger".
> >> >>>>>>
> >> >>>>>> Thanks,
> >> >>>>>> Chandni
> >> >>>>>>
> >> >>>>>> On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> >> >>>> pramod@datatorrent.com
> >> >>>>>>
> >> >>>>>> wrote:
> >> >>>>>>
> >> >>>>>>> It would still to manage the log isn't it, like clearing out
> data
> >> >>>>>>> corresponding to committed windows.
> >> >>>>>>>
> >> >>>>>>> On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> >> >>>> thomas@datatorrent.com>
> >> >>>>>>> wrote:
> >> >>>>>>>
> >> >>>>>>>> The underlying abstraction is a log. Why shouldn't the name
> >> >>> reflect
> >> >>>>>> that?
> >> >>>>>>>> Or is there anything added that makes it a "manager" or
> >> >> "agent"?
> >> >>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>> On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> >> >>>>>> chandni@datatorrent.com>
> >> >>>>>>>> wrote:
> >> >>>>>>>>
> >> >>>>>>>>> WindowStorageAgent was another suggestion as
> >> >>>>> IdempotentStorageManager
> >> >>>>>>>>> extends StorageAgent.
> >> >>>>>>>>> If no one has any objection will call it that.
> >> >>>>>>>>>
> >> >>>>>>>>> Chandni
> >> >>>>>>>>>
> >> >>>>>>>>> On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> >> >>>>>>> chandni@datatorrent.com>
> >> >>>>>>>>> wrote:
> >> >>>>>>>>>
> >> >>>>>>>>>> Hi,
> >> >>>>>>>>>>
> >> >>>>>>>>>> @Sandeep Will deprecate old IdempotentStorageManager. This
> >> >>> will
> >> >>>>> be
> >> >>>>>> a
> >> >>>>>>>> copy
> >> >>>>>>>>>> of the old one with a different name.
> >> >>>>>>>>>>
> >> >>>>>>>>>> @Sandesh
> >> >>>>>>>>>> A data store, in my opinion, is an entity which store data.
> >> >>>> This
> >> >>>>>>>> doesn't
> >> >>>>>>>>>> store data. It is used to save state per window.
> >> >>>>>>>>>>
> >> >>>>>>>>>> @Pramod
> >> >>>>>>>>>> Do you like WindowStateLogger?
> >> >>>>>>>>>>
> >> >>>>>>>>>> Thanks,
> >> >>>>>>>>>> Chandni
> >> >>>>>>>>>>
> >> >>>>>>>>>> On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> >> >>>>>> sandeep@datatorrent.com
> >> >>>>>>>>
> >> >>>>>>>>>> wrote:
> >> >>>>>>>>>>
> >> >>>>>>>>>>> Will there be any issue in semantic versioning because of
> >> >>> this
> >> >>>>>>> change?
> >> >>>>>>>>>>> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> >> >>>> sandesh@datatorrent.com>
> >> >>>>>>>> wrote:
> >> >>>>>>>>>>>
> >> >>>>>>>>>>>> As it is used to store & retrieve data, just call it
> >> >>>>> DataStore.
> >> >>>>>>>>>>>>
> >> >>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> >> >>>>>>>>> pramod@datatorrent.com
> >> >>>>>>>>>>>>
> >> >>>>>>>>>>>> wrote:
> >> >>>>>>>>>>>>
> >> >>>>>>>>>>>>> Since this is mainly for storing information
> >> >> pertaining
> >> >>> to
> >> >>>>>> data
> >> >>>>>>> or
> >> >>>>>>>>> the
> >> >>>>>>>>>>>> data
> >> >>>>>>>>>>>>> itself how about WindowDataManager or something like
> >> >>> that.
> >> >>>>>>>>>>>>>
> >> >>>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> >> >>>>>>>>>>> chandni@datatorrent.com>
> >> >>>>>>>>>>>>> wrote:
> >> >>>>>>>>>>>>>
> >> >>>>>>>>>>>>>> Hi,
> >> >>>>>>>>>>>>>>
> >> >>>>>>>>>>>>>> Received feedback from couple of folks that
> >> >>>>>>>>>>> IdempotentStorageManager is
> >> >>>>>>>>>>>>> not
> >> >>>>>>>>>>>>>> a good name for that component. It is used in some
> >> >> of
> >> >>>> our
> >> >>>>>>>>>>> input/output
> >> >>>>>>>>>>>>>> operator for saving per window data.
> >> >>>>>>>>>>>>>>
> >> >>>>>>>>>>>>>> I was thinking of calling it WindowLogger.
> >> >>>>>>>>>>>>>>
> >> >>>>>>>>>>>>>> Let me know if anyone has a better suggestion.
> >> >>>>>>>>>>>>>>
> >> >>>>>>>>>>>>>> Chandni
> >> >>>>>>>>>>>>>>
> >> >>>>>>>>>>>>>
> >> >>>>>>>>>>>>
> >> >>>>>>>>>>>
> >> >>>>>>>>>>
> >> >>>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>
> >> >>>>>>
> >> >>>>>
> >> >>>>
> >> >>>
> >> >>
> >>
> >>
>

Re: Renaming Idempotent Storage Manager

[Munagala Ramanath <ra...@datatorrent.com>]

+1 WindowDataManager


Ram

On Wed, Nov 18, 2015 at 7:47 AM, Sandesh Hegde <sa...@datatorrent.com> wrote:
> +1 WindowDataManager
>
> On Wed, Nov 18, 2015 at 1:01 AM Gaurav Gupta <ga...@datatorrent.com> wrote:
>
>> +1 for WindowDataManager. WindowDataLogger feels like another utility to
>> log but Idempotent Storage Manager is more than that.
>>
>> Thanks
>> - Gaurav
>>
>> > On Nov 18, 2015, at 12:52 AM, Chandni Singh <ch...@datatorrent.com>
>> wrote:
>> >
>> > It had been 2 days and most of the people who had shown any interest in
>> > this component had already voted.
>> > However, if anyone still has other ideas please bring it up.
>> >
>> > Chandni
>> >
>> > On Tue, Nov 17, 2015 at 6:24 PM, Thomas Weise <th...@datatorrent.com>
>> > wrote:
>> >
>> >> If you start discussions that mutate into "voting", you need to allow
>> for
>> >> sufficient time for feedback.
>> >>
>> >> --
>> >> sent from mobile
>> >> On Nov 17, 2015 5:37 PM, "Chandni Singh" <ch...@datatorrent.com>
>> wrote:
>> >>
>> >>> Concluding this discussion. There are 4 votes for WindowDataLogger and
>> 3
>> >>> for WindowDataManager. Will call it WindowDataLogger.
>> >>>
>> >>> The ticket is created here:
>> >>> https://malhar.atlassian.net/browse/MLHR-1902
>> >>>
>> >>> Thanks,
>> >>> Chandni
>> >>>
>> >>>
>> >>> On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <si...@datatorrent.com>
>> >>> wrote:
>> >>>
>> >>>> +1 for 1
>> >>>>
>> >>>> On Tue, Nov 17, 2015 at 10:30 AM, David Yan <da...@datatorrent.com>
>> >>> wrote:
>> >>>>
>> >>>>> +1 for 1
>> >>>>>
>> >>>>> On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
>> >>> chandni@datatorrent.com>
>> >>>>> wrote:
>> >>>>>
>> >>>>>> Currently going by Java code, the IdempotentStorageManager extends
>> >>>>>> StorageAgent which is why WindowStorageAgent came up.
>> >>>>>> It does delete data till window that gets committed.
>> >>>>>>
>> >>>>>>
>> >>>>>> These are some options which I have came across.
>> >>>>>>
>> >>>>>> 1. WindowDataLogger
>> >>>>>> 2. WindowStorageAgent
>> >>>>>> 3. WindowDataManager
>> >>>>>>
>> >>>>>> My vote is for option 1 "WindowDataLogger".
>> >>>>>>
>> >>>>>> Thanks,
>> >>>>>> Chandni
>> >>>>>>
>> >>>>>> On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
>> >>>> pramod@datatorrent.com
>> >>>>>>
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> It would still to manage the log isn't it, like clearing out data
>> >>>>>>> corresponding to committed windows.
>> >>>>>>>
>> >>>>>>> On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
>> >>>> thomas@datatorrent.com>
>> >>>>>>> wrote:
>> >>>>>>>
>> >>>>>>>> The underlying abstraction is a log. Why shouldn't the name
>> >>> reflect
>> >>>>>> that?
>> >>>>>>>> Or is there anything added that makes it a "manager" or
>> >> "agent"?
>> >>>>>>>>
>> >>>>>>>>
>> >>>>>>>> On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
>> >>>>>> chandni@datatorrent.com>
>> >>>>>>>> wrote:
>> >>>>>>>>
>> >>>>>>>>> WindowStorageAgent was another suggestion as
>> >>>>> IdempotentStorageManager
>> >>>>>>>>> extends StorageAgent.
>> >>>>>>>>> If no one has any objection will call it that.
>> >>>>>>>>>
>> >>>>>>>>> Chandni
>> >>>>>>>>>
>> >>>>>>>>> On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
>> >>>>>>> chandni@datatorrent.com>
>> >>>>>>>>> wrote:
>> >>>>>>>>>
>> >>>>>>>>>> Hi,
>> >>>>>>>>>>
>> >>>>>>>>>> @Sandeep Will deprecate old IdempotentStorageManager. This
>> >>> will
>> >>>>> be
>> >>>>>> a
>> >>>>>>>> copy
>> >>>>>>>>>> of the old one with a different name.
>> >>>>>>>>>>
>> >>>>>>>>>> @Sandesh
>> >>>>>>>>>> A data store, in my opinion, is an entity which store data.
>> >>>> This
>> >>>>>>>> doesn't
>> >>>>>>>>>> store data. It is used to save state per window.
>> >>>>>>>>>>
>> >>>>>>>>>> @Pramod
>> >>>>>>>>>> Do you like WindowStateLogger?
>> >>>>>>>>>>
>> >>>>>>>>>> Thanks,
>> >>>>>>>>>> Chandni
>> >>>>>>>>>>
>> >>>>>>>>>> On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
>> >>>>>> sandeep@datatorrent.com
>> >>>>>>>>
>> >>>>>>>>>> wrote:
>> >>>>>>>>>>
>> >>>>>>>>>>> Will there be any issue in semantic versioning because of
>> >>> this
>> >>>>>>> change?
>> >>>>>>>>>>> On 16 Nov 2015 07:35, "Sandesh Hegde" <
>> >>>> sandesh@datatorrent.com>
>> >>>>>>>> wrote:
>> >>>>>>>>>>>
>> >>>>>>>>>>>> As it is used to store & retrieve data, just call it
>> >>>>> DataStore.
>> >>>>>>>>>>>>
>> >>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
>> >>>>>>>>> pramod@datatorrent.com
>> >>>>>>>>>>>>
>> >>>>>>>>>>>> wrote:
>> >>>>>>>>>>>>
>> >>>>>>>>>>>>> Since this is mainly for storing information
>> >> pertaining
>> >>> to
>> >>>>>> data
>> >>>>>>> or
>> >>>>>>>>> the
>> >>>>>>>>>>>> data
>> >>>>>>>>>>>>> itself how about WindowDataManager or something like
>> >>> that.
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
>> >>>>>>>>>>> chandni@datatorrent.com>
>> >>>>>>>>>>>>> wrote:
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>>> Hi,
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> Received feedback from couple of folks that
>> >>>>>>>>>>> IdempotentStorageManager is
>> >>>>>>>>>>>>> not
>> >>>>>>>>>>>>>> a good name for that component. It is used in some
>> >> of
>> >>>> our
>> >>>>>>>>>>> input/output
>> >>>>>>>>>>>>>> operator for saving per window data.
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> I was thinking of calling it WindowLogger.
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> Let me know if anyone has a better suggestion.
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> Chandni
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>
>> >>>>>>>>>>>
>> >>>>>>>>>>
>> >>>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>
>> >>>>>
>> >>>>
>> >>>
>> >>
>>
>>

Re: Renaming Idempotent Storage Manager

[Sandesh Hegde <sa...@datatorrent.com>]

+1 WindowDataManager

On Wed, Nov 18, 2015 at 1:01 AM Gaurav Gupta <ga...@datatorrent.com> wrote:

> +1 for WindowDataManager. WindowDataLogger feels like another utility to
> log but Idempotent Storage Manager is more than that.
>
> Thanks
> - Gaurav
>
> > On Nov 18, 2015, at 12:52 AM, Chandni Singh <ch...@datatorrent.com>
> wrote:
> >
> > It had been 2 days and most of the people who had shown any interest in
> > this component had already voted.
> > However, if anyone still has other ideas please bring it up.
> >
> > Chandni
> >
> > On Tue, Nov 17, 2015 at 6:24 PM, Thomas Weise <th...@datatorrent.com>
> > wrote:
> >
> >> If you start discussions that mutate into "voting", you need to allow
> for
> >> sufficient time for feedback.
> >>
> >> --
> >> sent from mobile
> >> On Nov 17, 2015 5:37 PM, "Chandni Singh" <ch...@datatorrent.com>
> wrote:
> >>
> >>> Concluding this discussion. There are 4 votes for WindowDataLogger and
> 3
> >>> for WindowDataManager. Will call it WindowDataLogger.
> >>>
> >>> The ticket is created here:
> >>> https://malhar.atlassian.net/browse/MLHR-1902
> >>>
> >>> Thanks,
> >>> Chandni
> >>>
> >>>
> >>> On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <si...@datatorrent.com>
> >>> wrote:
> >>>
> >>>> +1 for 1
> >>>>
> >>>> On Tue, Nov 17, 2015 at 10:30 AM, David Yan <da...@datatorrent.com>
> >>> wrote:
> >>>>
> >>>>> +1 for 1
> >>>>>
> >>>>> On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> >>> chandni@datatorrent.com>
> >>>>> wrote:
> >>>>>
> >>>>>> Currently going by Java code, the IdempotentStorageManager extends
> >>>>>> StorageAgent which is why WindowStorageAgent came up.
> >>>>>> It does delete data till window that gets committed.
> >>>>>>
> >>>>>>
> >>>>>> These are some options which I have came across.
> >>>>>>
> >>>>>> 1. WindowDataLogger
> >>>>>> 2. WindowStorageAgent
> >>>>>> 3. WindowDataManager
> >>>>>>
> >>>>>> My vote is for option 1 "WindowDataLogger".
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Chandni
> >>>>>>
> >>>>>> On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> >>>> pramod@datatorrent.com
> >>>>>>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> It would still to manage the log isn't it, like clearing out data
> >>>>>>> corresponding to committed windows.
> >>>>>>>
> >>>>>>> On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> >>>> thomas@datatorrent.com>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> The underlying abstraction is a log. Why shouldn't the name
> >>> reflect
> >>>>>> that?
> >>>>>>>> Or is there anything added that makes it a "manager" or
> >> "agent"?
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> >>>>>> chandni@datatorrent.com>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> WindowStorageAgent was another suggestion as
> >>>>> IdempotentStorageManager
> >>>>>>>>> extends StorageAgent.
> >>>>>>>>> If no one has any objection will call it that.
> >>>>>>>>>
> >>>>>>>>> Chandni
> >>>>>>>>>
> >>>>>>>>> On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> >>>>>>> chandni@datatorrent.com>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi,
> >>>>>>>>>>
> >>>>>>>>>> @Sandeep Will deprecate old IdempotentStorageManager. This
> >>> will
> >>>>> be
> >>>>>> a
> >>>>>>>> copy
> >>>>>>>>>> of the old one with a different name.
> >>>>>>>>>>
> >>>>>>>>>> @Sandesh
> >>>>>>>>>> A data store, in my opinion, is an entity which store data.
> >>>> This
> >>>>>>>> doesn't
> >>>>>>>>>> store data. It is used to save state per window.
> >>>>>>>>>>
> >>>>>>>>>> @Pramod
> >>>>>>>>>> Do you like WindowStateLogger?
> >>>>>>>>>>
> >>>>>>>>>> Thanks,
> >>>>>>>>>> Chandni
> >>>>>>>>>>
> >>>>>>>>>> On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> >>>>>> sandeep@datatorrent.com
> >>>>>>>>
> >>>>>>>>>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>> Will there be any issue in semantic versioning because of
> >>> this
> >>>>>>> change?
> >>>>>>>>>>> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> >>>> sandesh@datatorrent.com>
> >>>>>>>> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> As it is used to store & retrieve data, just call it
> >>>>> DataStore.
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> >>>>>>>>> pramod@datatorrent.com
> >>>>>>>>>>>>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> Since this is mainly for storing information
> >> pertaining
> >>> to
> >>>>>> data
> >>>>>>> or
> >>>>>>>>> the
> >>>>>>>>>>>> data
> >>>>>>>>>>>>> itself how about WindowDataManager or something like
> >>> that.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> >>>>>>>>>>> chandni@datatorrent.com>
> >>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Hi,
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Received feedback from couple of folks that
> >>>>>>>>>>> IdempotentStorageManager is
> >>>>>>>>>>>>> not
> >>>>>>>>>>>>>> a good name for that component. It is used in some
> >> of
> >>>> our
> >>>>>>>>>>> input/output
> >>>>>>>>>>>>>> operator for saving per window data.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> I was thinking of calling it WindowLogger.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Let me know if anyone has a better suggestion.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Chandni
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
>

Re: Renaming Idempotent Storage Manager

[Gaurav Gupta <ga...@datatorrent.com>]

+1 for WindowDataManager. WindowDataLogger feels like another utility to log but Idempotent Storage Manager is more than that. 

Thanks
- Gaurav

> On Nov 18, 2015, at 12:52 AM, Chandni Singh <ch...@datatorrent.com> wrote:
> 
> It had been 2 days and most of the people who had shown any interest in
> this component had already voted.
> However, if anyone still has other ideas please bring it up.
> 
> Chandni
> 
> On Tue, Nov 17, 2015 at 6:24 PM, Thomas Weise <th...@datatorrent.com>
> wrote:
> 
>> If you start discussions that mutate into "voting", you need to allow for
>> sufficient time for feedback.
>> 
>> --
>> sent from mobile
>> On Nov 17, 2015 5:37 PM, "Chandni Singh" <ch...@datatorrent.com> wrote:
>> 
>>> Concluding this discussion. There are 4 votes for WindowDataLogger and 3
>>> for WindowDataManager. Will call it WindowDataLogger.
>>> 
>>> The ticket is created here:
>>> https://malhar.atlassian.net/browse/MLHR-1902
>>> 
>>> Thanks,
>>> Chandni
>>> 
>>> 
>>> On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <si...@datatorrent.com>
>>> wrote:
>>> 
>>>> +1 for 1
>>>> 
>>>> On Tue, Nov 17, 2015 at 10:30 AM, David Yan <da...@datatorrent.com>
>>> wrote:
>>>> 
>>>>> +1 for 1
>>>>> 
>>>>> On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
>>> chandni@datatorrent.com>
>>>>> wrote:
>>>>> 
>>>>>> Currently going by Java code, the IdempotentStorageManager extends
>>>>>> StorageAgent which is why WindowStorageAgent came up.
>>>>>> It does delete data till window that gets committed.
>>>>>> 
>>>>>> 
>>>>>> These are some options which I have came across.
>>>>>> 
>>>>>> 1. WindowDataLogger
>>>>>> 2. WindowStorageAgent
>>>>>> 3. WindowDataManager
>>>>>> 
>>>>>> My vote is for option 1 "WindowDataLogger".
>>>>>> 
>>>>>> Thanks,
>>>>>> Chandni
>>>>>> 
>>>>>> On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
>>>> pramod@datatorrent.com
>>>>>> 
>>>>>> wrote:
>>>>>> 
>>>>>>> It would still to manage the log isn't it, like clearing out data
>>>>>>> corresponding to committed windows.
>>>>>>> 
>>>>>>> On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
>>>> thomas@datatorrent.com>
>>>>>>> wrote:
>>>>>>> 
>>>>>>>> The underlying abstraction is a log. Why shouldn't the name
>>> reflect
>>>>>> that?
>>>>>>>> Or is there anything added that makes it a "manager" or
>> "agent"?
>>>>>>>> 
>>>>>>>> 
>>>>>>>> On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
>>>>>> chandni@datatorrent.com>
>>>>>>>> wrote:
>>>>>>>> 
>>>>>>>>> WindowStorageAgent was another suggestion as
>>>>> IdempotentStorageManager
>>>>>>>>> extends StorageAgent.
>>>>>>>>> If no one has any objection will call it that.
>>>>>>>>> 
>>>>>>>>> Chandni
>>>>>>>>> 
>>>>>>>>> On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
>>>>>>> chandni@datatorrent.com>
>>>>>>>>> wrote:
>>>>>>>>> 
>>>>>>>>>> Hi,
>>>>>>>>>> 
>>>>>>>>>> @Sandeep Will deprecate old IdempotentStorageManager. This
>>> will
>>>>> be
>>>>>> a
>>>>>>>> copy
>>>>>>>>>> of the old one with a different name.
>>>>>>>>>> 
>>>>>>>>>> @Sandesh
>>>>>>>>>> A data store, in my opinion, is an entity which store data.
>>>> This
>>>>>>>> doesn't
>>>>>>>>>> store data. It is used to save state per window.
>>>>>>>>>> 
>>>>>>>>>> @Pramod
>>>>>>>>>> Do you like WindowStateLogger?
>>>>>>>>>> 
>>>>>>>>>> Thanks,
>>>>>>>>>> Chandni
>>>>>>>>>> 
>>>>>>>>>> On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
>>>>>> sandeep@datatorrent.com
>>>>>>>> 
>>>>>>>>>> wrote:
>>>>>>>>>> 
>>>>>>>>>>> Will there be any issue in semantic versioning because of
>>> this
>>>>>>> change?
>>>>>>>>>>> On 16 Nov 2015 07:35, "Sandesh Hegde" <
>>>> sandesh@datatorrent.com>
>>>>>>>> wrote:
>>>>>>>>>>> 
>>>>>>>>>>>> As it is used to store & retrieve data, just call it
>>>>> DataStore.
>>>>>>>>>>>> 
>>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
>>>>>>>>> pramod@datatorrent.com
>>>>>>>>>>>> 
>>>>>>>>>>>> wrote:
>>>>>>>>>>>> 
>>>>>>>>>>>>> Since this is mainly for storing information
>> pertaining
>>> to
>>>>>> data
>>>>>>> or
>>>>>>>>> the
>>>>>>>>>>>> data
>>>>>>>>>>>>> itself how about WindowDataManager or something like
>>> that.
>>>>>>>>>>>>> 
>>>>>>>>>>>>> On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
>>>>>>>>>>> chandni@datatorrent.com>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>> 
>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> Received feedback from couple of folks that
>>>>>>>>>>> IdempotentStorageManager is
>>>>>>>>>>>>> not
>>>>>>>>>>>>>> a good name for that component. It is used in some
>> of
>>>> our
>>>>>>>>>>> input/output
>>>>>>>>>>>>>> operator for saving per window data.
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> I was thinking of calling it WindowLogger.
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> Let me know if anyone has a better suggestion.
>>>>>>>>>>>>>> 
>>>>>>>>>>>>>> Chandni
>>>>>>>>>>>>>> 
>>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 
>> 

Re: Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

It had been 2 days and most of the people who had shown any interest in
this component had already voted.
However, if anyone still has other ideas please bring it up.

Chandni

On Tue, Nov 17, 2015 at 6:24 PM, Thomas Weise <th...@datatorrent.com>
wrote:

> If you start discussions that mutate into "voting", you need to allow for
> sufficient time for feedback.
>
> --
> sent from mobile
> On Nov 17, 2015 5:37 PM, "Chandni Singh" <ch...@datatorrent.com> wrote:
>
> > Concluding this discussion. There are 4 votes for WindowDataLogger and 3
> > for WindowDataManager. Will call it WindowDataLogger.
> >
> > The ticket is created here:
> > https://malhar.atlassian.net/browse/MLHR-1902
> >
> > Thanks,
> > Chandni
> >
> >
> > On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <si...@datatorrent.com>
> > wrote:
> >
> > > +1 for 1
> > >
> > > On Tue, Nov 17, 2015 at 10:30 AM, David Yan <da...@datatorrent.com>
> > wrote:
> > >
> > > > +1 for 1
> > > >
> > > > On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> > chandni@datatorrent.com>
> > > > wrote:
> > > >
> > > > > Currently going by Java code, the IdempotentStorageManager extends
> > > > > StorageAgent which is why WindowStorageAgent came up.
> > > > > It does delete data till window that gets committed.
> > > > >
> > > > >
> > > > > These are some options which I have came across.
> > > > >
> > > > > 1. WindowDataLogger
> > > > > 2. WindowStorageAgent
> > > > > 3. WindowDataManager
> > > > >
> > > > > My vote is for option 1 "WindowDataLogger".
> > > > >
> > > > > Thanks,
> > > > > Chandni
> > > > >
> > > > > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> > > pramod@datatorrent.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > It would still to manage the log isn't it, like clearing out data
> > > > > > corresponding to committed windows.
> > > > > >
> > > > > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> > > thomas@datatorrent.com>
> > > > > > wrote:
> > > > > >
> > > > > > > The underlying abstraction is a log. Why shouldn't the name
> > reflect
> > > > > that?
> > > > > > > Or is there anything added that makes it a "manager" or
> "agent"?
> > > > > > >
> > > > > > >
> > > > > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > > > > chandni@datatorrent.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > WindowStorageAgent was another suggestion as
> > > > IdempotentStorageManager
> > > > > > > > extends StorageAgent.
> > > > > > > > If no one has any objection will call it that.
> > > > > > > >
> > > > > > > > Chandni
> > > > > > > >
> > > > > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > > > > chandni@datatorrent.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This
> > will
> > > > be
> > > > > a
> > > > > > > copy
> > > > > > > > > of the old one with a different name.
> > > > > > > > >
> > > > > > > > > @Sandesh
> > > > > > > > > A data store, in my opinion, is an entity which store data.
> > > This
> > > > > > > doesn't
> > > > > > > > > store data. It is used to save state per window.
> > > > > > > > >
> > > > > > > > > @Pramod
> > > > > > > > > Do you like WindowStateLogger?
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Chandni
> > > > > > > > >
> > > > > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > > > > sandeep@datatorrent.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >> Will there be any issue in semantic versioning because of
> > this
> > > > > > change?
> > > > > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> > > sandesh@datatorrent.com>
> > > > > > > wrote:
> > > > > > > > >>
> > > > > > > > >> > As it is used to store & retrieve data, just call it
> > > > DataStore.
> > > > > > > > >> >
> > > > > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > > > > pramod@datatorrent.com
> > > > > > > > >> >
> > > > > > > > >> > wrote:
> > > > > > > > >> >
> > > > > > > > >> > > Since this is mainly for storing information
> pertaining
> > to
> > > > > data
> > > > > > or
> > > > > > > > the
> > > > > > > > >> > data
> > > > > > > > >> > > itself how about WindowDataManager or something like
> > that.
> > > > > > > > >> > >
> > > > > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > > > > >> chandni@datatorrent.com>
> > > > > > > > >> > > wrote:
> > > > > > > > >> > >
> > > > > > > > >> > > > Hi,
> > > > > > > > >> > > >
> > > > > > > > >> > > > Received feedback from couple of folks that
> > > > > > > > >> IdempotentStorageManager is
> > > > > > > > >> > > not
> > > > > > > > >> > > > a good name for that component. It is used in some
> of
> > > our
> > > > > > > > >> input/output
> > > > > > > > >> > > > operator for saving per window data.
> > > > > > > > >> > > >
> > > > > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > > > > >> > > >
> > > > > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > > > > >> > > >
> > > > > > > > >> > > > Chandni
> > > > > > > > >> > > >
> > > > > > > > >> > >
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Thomas Weise <th...@datatorrent.com>]

If you start discussions that mutate into "voting", you need to allow for
sufficient time for feedback.

--
sent from mobile
On Nov 17, 2015 5:37 PM, "Chandni Singh" <ch...@datatorrent.com> wrote:

> Concluding this discussion. There are 4 votes for WindowDataLogger and 3
> for WindowDataManager. Will call it WindowDataLogger.
>
> The ticket is created here:
> https://malhar.atlassian.net/browse/MLHR-1902
>
> Thanks,
> Chandni
>
>
> On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <si...@datatorrent.com>
> wrote:
>
> > +1 for 1
> >
> > On Tue, Nov 17, 2015 at 10:30 AM, David Yan <da...@datatorrent.com>
> wrote:
> >
> > > +1 for 1
> > >
> > > On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <
> chandni@datatorrent.com>
> > > wrote:
> > >
> > > > Currently going by Java code, the IdempotentStorageManager extends
> > > > StorageAgent which is why WindowStorageAgent came up.
> > > > It does delete data till window that gets committed.
> > > >
> > > >
> > > > These are some options which I have came across.
> > > >
> > > > 1. WindowDataLogger
> > > > 2. WindowStorageAgent
> > > > 3. WindowDataManager
> > > >
> > > > My vote is for option 1 "WindowDataLogger".
> > > >
> > > > Thanks,
> > > > Chandni
> > > >
> > > > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> > pramod@datatorrent.com
> > > >
> > > > wrote:
> > > >
> > > > > It would still to manage the log isn't it, like clearing out data
> > > > > corresponding to committed windows.
> > > > >
> > > > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> > thomas@datatorrent.com>
> > > > > wrote:
> > > > >
> > > > > > The underlying abstraction is a log. Why shouldn't the name
> reflect
> > > > that?
> > > > > > Or is there anything added that makes it a "manager" or "agent"?
> > > > > >
> > > > > >
> > > > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > > > chandni@datatorrent.com>
> > > > > > wrote:
> > > > > >
> > > > > > > WindowStorageAgent was another suggestion as
> > > IdempotentStorageManager
> > > > > > > extends StorageAgent.
> > > > > > > If no one has any objection will call it that.
> > > > > > >
> > > > > > > Chandni
> > > > > > >
> > > > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > > > chandni@datatorrent.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This
> will
> > > be
> > > > a
> > > > > > copy
> > > > > > > > of the old one with a different name.
> > > > > > > >
> > > > > > > > @Sandesh
> > > > > > > > A data store, in my opinion, is an entity which store data.
> > This
> > > > > > doesn't
> > > > > > > > store data. It is used to save state per window.
> > > > > > > >
> > > > > > > > @Pramod
> > > > > > > > Do you like WindowStateLogger?
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Chandni
> > > > > > > >
> > > > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > > > sandeep@datatorrent.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > >> Will there be any issue in semantic versioning because of
> this
> > > > > change?
> > > > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> > sandesh@datatorrent.com>
> > > > > > wrote:
> > > > > > > >>
> > > > > > > >> > As it is used to store & retrieve data, just call it
> > > DataStore.
> > > > > > > >> >
> > > > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > > > pramod@datatorrent.com
> > > > > > > >> >
> > > > > > > >> > wrote:
> > > > > > > >> >
> > > > > > > >> > > Since this is mainly for storing information pertaining
> to
> > > > data
> > > > > or
> > > > > > > the
> > > > > > > >> > data
> > > > > > > >> > > itself how about WindowDataManager or something like
> that.
> > > > > > > >> > >
> > > > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > > > >> chandni@datatorrent.com>
> > > > > > > >> > > wrote:
> > > > > > > >> > >
> > > > > > > >> > > > Hi,
> > > > > > > >> > > >
> > > > > > > >> > > > Received feedback from couple of folks that
> > > > > > > >> IdempotentStorageManager is
> > > > > > > >> > > not
> > > > > > > >> > > > a good name for that component. It is used in some of
> > our
> > > > > > > >> input/output
> > > > > > > >> > > > operator for saving per window data.
> > > > > > > >> > > >
> > > > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > > > >> > > >
> > > > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > > > >> > > >
> > > > > > > >> > > > Chandni
> > > > > > > >> > > >
> > > > > > > >> > >
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

Concluding this discussion. There are 4 votes for WindowDataLogger and 3
for WindowDataManager. Will call it WindowDataLogger.

The ticket is created here:
https://malhar.atlassian.net/browse/MLHR-1902

Thanks,
Chandni


On Tue, Nov 17, 2015 at 2:34 PM, Siyuan Hua <si...@datatorrent.com> wrote:

> +1 for 1
>
> On Tue, Nov 17, 2015 at 10:30 AM, David Yan <da...@datatorrent.com> wrote:
>
> > +1 for 1
> >
> > On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <ch...@datatorrent.com>
> > wrote:
> >
> > > Currently going by Java code, the IdempotentStorageManager extends
> > > StorageAgent which is why WindowStorageAgent came up.
> > > It does delete data till window that gets committed.
> > >
> > >
> > > These are some options which I have came across.
> > >
> > > 1. WindowDataLogger
> > > 2. WindowStorageAgent
> > > 3. WindowDataManager
> > >
> > > My vote is for option 1 "WindowDataLogger".
> > >
> > > Thanks,
> > > Chandni
> > >
> > > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <
> pramod@datatorrent.com
> > >
> > > wrote:
> > >
> > > > It would still to manage the log isn't it, like clearing out data
> > > > corresponding to committed windows.
> > > >
> > > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <
> thomas@datatorrent.com>
> > > > wrote:
> > > >
> > > > > The underlying abstraction is a log. Why shouldn't the name reflect
> > > that?
> > > > > Or is there anything added that makes it a "manager" or "agent"?
> > > > >
> > > > >
> > > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > > chandni@datatorrent.com>
> > > > > wrote:
> > > > >
> > > > > > WindowStorageAgent was another suggestion as
> > IdempotentStorageManager
> > > > > > extends StorageAgent.
> > > > > > If no one has any objection will call it that.
> > > > > >
> > > > > > Chandni
> > > > > >
> > > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > > chandni@datatorrent.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This will
> > be
> > > a
> > > > > copy
> > > > > > > of the old one with a different name.
> > > > > > >
> > > > > > > @Sandesh
> > > > > > > A data store, in my opinion, is an entity which store data.
> This
> > > > > doesn't
> > > > > > > store data. It is used to save state per window.
> > > > > > >
> > > > > > > @Pramod
> > > > > > > Do you like WindowStateLogger?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Chandni
> > > > > > >
> > > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > > sandeep@datatorrent.com
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Will there be any issue in semantic versioning because of this
> > > > change?
> > > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <
> sandesh@datatorrent.com>
> > > > > wrote:
> > > > > > >>
> > > > > > >> > As it is used to store & retrieve data, just call it
> > DataStore.
> > > > > > >> >
> > > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > > pramod@datatorrent.com
> > > > > > >> >
> > > > > > >> > wrote:
> > > > > > >> >
> > > > > > >> > > Since this is mainly for storing information pertaining to
> > > data
> > > > or
> > > > > > the
> > > > > > >> > data
> > > > > > >> > > itself how about WindowDataManager or something like that.
> > > > > > >> > >
> > > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > > >> chandni@datatorrent.com>
> > > > > > >> > > wrote:
> > > > > > >> > >
> > > > > > >> > > > Hi,
> > > > > > >> > > >
> > > > > > >> > > > Received feedback from couple of folks that
> > > > > > >> IdempotentStorageManager is
> > > > > > >> > > not
> > > > > > >> > > > a good name for that component. It is used in some of
> our
> > > > > > >> input/output
> > > > > > >> > > > operator for saving per window data.
> > > > > > >> > > >
> > > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > > >> > > >
> > > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > > >> > > >
> > > > > > >> > > > Chandni
> > > > > > >> > > >
> > > > > > >> > >
> > > > > > >> >
> > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Siyuan Hua <si...@datatorrent.com>]

+1 for 1

On Tue, Nov 17, 2015 at 10:30 AM, David Yan <da...@datatorrent.com> wrote:

> +1 for 1
>
> On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <ch...@datatorrent.com>
> wrote:
>
> > Currently going by Java code, the IdempotentStorageManager extends
> > StorageAgent which is why WindowStorageAgent came up.
> > It does delete data till window that gets committed.
> >
> >
> > These are some options which I have came across.
> >
> > 1. WindowDataLogger
> > 2. WindowStorageAgent
> > 3. WindowDataManager
> >
> > My vote is for option 1 "WindowDataLogger".
> >
> > Thanks,
> > Chandni
> >
> > On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <pramod@datatorrent.com
> >
> > wrote:
> >
> > > It would still to manage the log isn't it, like clearing out data
> > > corresponding to committed windows.
> > >
> > > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <th...@datatorrent.com>
> > > wrote:
> > >
> > > > The underlying abstraction is a log. Why shouldn't the name reflect
> > that?
> > > > Or is there anything added that makes it a "manager" or "agent"?
> > > >
> > > >
> > > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> > chandni@datatorrent.com>
> > > > wrote:
> > > >
> > > > > WindowStorageAgent was another suggestion as
> IdempotentStorageManager
> > > > > extends StorageAgent.
> > > > > If no one has any objection will call it that.
> > > > >
> > > > > Chandni
> > > > >
> > > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > > chandni@datatorrent.com>
> > > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > @Sandeep Will deprecate old IdempotentStorageManager. This will
> be
> > a
> > > > copy
> > > > > > of the old one with a different name.
> > > > > >
> > > > > > @Sandesh
> > > > > > A data store, in my opinion, is an entity which store data. This
> > > > doesn't
> > > > > > store data. It is used to save state per window.
> > > > > >
> > > > > > @Pramod
> > > > > > Do you like WindowStateLogger?
> > > > > >
> > > > > > Thanks,
> > > > > > Chandni
> > > > > >
> > > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> > sandeep@datatorrent.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > >> Will there be any issue in semantic versioning because of this
> > > change?
> > > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com>
> > > > wrote:
> > > > > >>
> > > > > >> > As it is used to store & retrieve data, just call it
> DataStore.
> > > > > >> >
> > > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > > pramod@datatorrent.com
> > > > > >> >
> > > > > >> > wrote:
> > > > > >> >
> > > > > >> > > Since this is mainly for storing information pertaining to
> > data
> > > or
> > > > > the
> > > > > >> > data
> > > > > >> > > itself how about WindowDataManager or something like that.
> > > > > >> > >
> > > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > > >> chandni@datatorrent.com>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > > Hi,
> > > > > >> > > >
> > > > > >> > > > Received feedback from couple of folks that
> > > > > >> IdempotentStorageManager is
> > > > > >> > > not
> > > > > >> > > > a good name for that component. It is used in some of our
> > > > > >> input/output
> > > > > >> > > > operator for saving per window data.
> > > > > >> > > >
> > > > > >> > > > I was thinking of calling it WindowLogger.
> > > > > >> > > >
> > > > > >> > > > Let me know if anyone has a better suggestion.
> > > > > >> > > >
> > > > > >> > > > Chandni
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[David Yan <da...@datatorrent.com>]

+1 for 1

On Mon, Nov 16, 2015 at 2:30 PM, Chandni Singh <ch...@datatorrent.com>
wrote:

> Currently going by Java code, the IdempotentStorageManager extends
> StorageAgent which is why WindowStorageAgent came up.
> It does delete data till window that gets committed.
>
>
> These are some options which I have came across.
>
> 1. WindowDataLogger
> 2. WindowStorageAgent
> 3. WindowDataManager
>
> My vote is for option 1 "WindowDataLogger".
>
> Thanks,
> Chandni
>
> On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <pr...@datatorrent.com>
> wrote:
>
> > It would still to manage the log isn't it, like clearing out data
> > corresponding to committed windows.
> >
> > On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <th...@datatorrent.com>
> > wrote:
> >
> > > The underlying abstraction is a log. Why shouldn't the name reflect
> that?
> > > Or is there anything added that makes it a "manager" or "agent"?
> > >
> > >
> > > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <
> chandni@datatorrent.com>
> > > wrote:
> > >
> > > > WindowStorageAgent was another suggestion as IdempotentStorageManager
> > > > extends StorageAgent.
> > > > If no one has any objection will call it that.
> > > >
> > > > Chandni
> > > >
> > > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> > chandni@datatorrent.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > @Sandeep Will deprecate old IdempotentStorageManager. This will be
> a
> > > copy
> > > > > of the old one with a different name.
> > > > >
> > > > > @Sandesh
> > > > > A data store, in my opinion, is an entity which store data. This
> > > doesn't
> > > > > store data. It is used to save state per window.
> > > > >
> > > > > @Pramod
> > > > > Do you like WindowStateLogger?
> > > > >
> > > > > Thanks,
> > > > > Chandni
> > > > >
> > > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <
> sandeep@datatorrent.com
> > >
> > > > > wrote:
> > > > >
> > > > >> Will there be any issue in semantic versioning because of this
> > change?
> > > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com>
> > > wrote:
> > > > >>
> > > > >> > As it is used to store & retrieve data, just call it DataStore.
> > > > >> >
> > > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > > pramod@datatorrent.com
> > > > >> >
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Since this is mainly for storing information pertaining to
> data
> > or
> > > > the
> > > > >> > data
> > > > >> > > itself how about WindowDataManager or something like that.
> > > > >> > >
> > > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > > >> chandni@datatorrent.com>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > > Hi,
> > > > >> > > >
> > > > >> > > > Received feedback from couple of folks that
> > > > >> IdempotentStorageManager is
> > > > >> > > not
> > > > >> > > > a good name for that component. It is used in some of our
> > > > >> input/output
> > > > >> > > > operator for saving per window data.
> > > > >> > > >
> > > > >> > > > I was thinking of calling it WindowLogger.
> > > > >> > > >
> > > > >> > > > Let me know if anyone has a better suggestion.
> > > > >> > > >
> > > > >> > > > Chandni
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > > >
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

Currently going by Java code, the IdempotentStorageManager extends
StorageAgent which is why WindowStorageAgent came up.
It does delete data till window that gets committed.


These are some options which I have came across.

1. WindowDataLogger
2. WindowStorageAgent
3. WindowDataManager

My vote is for option 1 "WindowDataLogger".

Thanks,
Chandni

On Mon, Nov 16, 2015 at 2:12 PM, Pramod Immaneni <pr...@datatorrent.com>
wrote:

> It would still to manage the log isn't it, like clearing out data
> corresponding to committed windows.
>
> On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <th...@datatorrent.com>
> wrote:
>
> > The underlying abstraction is a log. Why shouldn't the name reflect that?
> > Or is there anything added that makes it a "manager" or "agent"?
> >
> >
> > On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <ch...@datatorrent.com>
> > wrote:
> >
> > > WindowStorageAgent was another suggestion as IdempotentStorageManager
> > > extends StorageAgent.
> > > If no one has any objection will call it that.
> > >
> > > Chandni
> > >
> > > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <
> chandni@datatorrent.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > @Sandeep Will deprecate old IdempotentStorageManager. This will be a
> > copy
> > > > of the old one with a different name.
> > > >
> > > > @Sandesh
> > > > A data store, in my opinion, is an entity which store data. This
> > doesn't
> > > > store data. It is used to save state per window.
> > > >
> > > > @Pramod
> > > > Do you like WindowStateLogger?
> > > >
> > > > Thanks,
> > > > Chandni
> > > >
> > > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <sandeep@datatorrent.com
> >
> > > > wrote:
> > > >
> > > >> Will there be any issue in semantic versioning because of this
> change?
> > > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com>
> > wrote:
> > > >>
> > > >> > As it is used to store & retrieve data, just call it DataStore.
> > > >> >
> > > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > > pramod@datatorrent.com
> > > >> >
> > > >> > wrote:
> > > >> >
> > > >> > > Since this is mainly for storing information pertaining to data
> or
> > > the
> > > >> > data
> > > >> > > itself how about WindowDataManager or something like that.
> > > >> > >
> > > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > > >> chandni@datatorrent.com>
> > > >> > > wrote:
> > > >> > >
> > > >> > > > Hi,
> > > >> > > >
> > > >> > > > Received feedback from couple of folks that
> > > >> IdempotentStorageManager is
> > > >> > > not
> > > >> > > > a good name for that component. It is used in some of our
> > > >> input/output
> > > >> > > > operator for saving per window data.
> > > >> > > >
> > > >> > > > I was thinking of calling it WindowLogger.
> > > >> > > >
> > > >> > > > Let me know if anyone has a better suggestion.
> > > >> > > >
> > > >> > > > Chandni
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Pramod Immaneni <pr...@datatorrent.com>]

It would still to manage the log isn't it, like clearing out data
corresponding to committed windows.

On Mon, Nov 16, 2015 at 2:11 PM, Thomas Weise <th...@datatorrent.com>
wrote:

> The underlying abstraction is a log. Why shouldn't the name reflect that?
> Or is there anything added that makes it a "manager" or "agent"?
>
>
> On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <ch...@datatorrent.com>
> wrote:
>
> > WindowStorageAgent was another suggestion as IdempotentStorageManager
> > extends StorageAgent.
> > If no one has any objection will call it that.
> >
> > Chandni
> >
> > On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <ch...@datatorrent.com>
> > wrote:
> >
> > > Hi,
> > >
> > > @Sandeep Will deprecate old IdempotentStorageManager. This will be a
> copy
> > > of the old one with a different name.
> > >
> > > @Sandesh
> > > A data store, in my opinion, is an entity which store data. This
> doesn't
> > > store data. It is used to save state per window.
> > >
> > > @Pramod
> > > Do you like WindowStateLogger?
> > >
> > > Thanks,
> > > Chandni
> > >
> > > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <sa...@datatorrent.com>
> > > wrote:
> > >
> > >> Will there be any issue in semantic versioning because of this change?
> > >> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com>
> wrote:
> > >>
> > >> > As it is used to store & retrieve data, just call it DataStore.
> > >> >
> > >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> > pramod@datatorrent.com
> > >> >
> > >> > wrote:
> > >> >
> > >> > > Since this is mainly for storing information pertaining to data or
> > the
> > >> > data
> > >> > > itself how about WindowDataManager or something like that.
> > >> > >
> > >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> > >> chandni@datatorrent.com>
> > >> > > wrote:
> > >> > >
> > >> > > > Hi,
> > >> > > >
> > >> > > > Received feedback from couple of folks that
> > >> IdempotentStorageManager is
> > >> > > not
> > >> > > > a good name for that component. It is used in some of our
> > >> input/output
> > >> > > > operator for saving per window data.
> > >> > > >
> > >> > > > I was thinking of calling it WindowLogger.
> > >> > > >
> > >> > > > Let me know if anyone has a better suggestion.
> > >> > > >
> > >> > > > Chandni
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Thomas Weise <th...@datatorrent.com>]

The underlying abstraction is a log. Why shouldn't the name reflect that?
Or is there anything added that makes it a "manager" or "agent"?


On Mon, Nov 16, 2015 at 2:01 PM, Chandni Singh <ch...@datatorrent.com>
wrote:

> WindowStorageAgent was another suggestion as IdempotentStorageManager
> extends StorageAgent.
> If no one has any objection will call it that.
>
> Chandni
>
> On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <ch...@datatorrent.com>
> wrote:
>
> > Hi,
> >
> > @Sandeep Will deprecate old IdempotentStorageManager. This will be a copy
> > of the old one with a different name.
> >
> > @Sandesh
> > A data store, in my opinion, is an entity which store data. This doesn't
> > store data. It is used to save state per window.
> >
> > @Pramod
> > Do you like WindowStateLogger?
> >
> > Thanks,
> > Chandni
> >
> > On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <sa...@datatorrent.com>
> > wrote:
> >
> >> Will there be any issue in semantic versioning because of this change?
> >> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com> wrote:
> >>
> >> > As it is used to store & retrieve data, just call it DataStore.
> >> >
> >> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <
> pramod@datatorrent.com
> >> >
> >> > wrote:
> >> >
> >> > > Since this is mainly for storing information pertaining to data or
> the
> >> > data
> >> > > itself how about WindowDataManager or something like that.
> >> > >
> >> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> >> chandni@datatorrent.com>
> >> > > wrote:
> >> > >
> >> > > > Hi,
> >> > > >
> >> > > > Received feedback from couple of folks that
> >> IdempotentStorageManager is
> >> > > not
> >> > > > a good name for that component. It is used in some of our
> >> input/output
> >> > > > operator for saving per window data.
> >> > > >
> >> > > > I was thinking of calling it WindowLogger.
> >> > > >
> >> > > > Let me know if anyone has a better suggestion.
> >> > > >
> >> > > > Chandni
> >> > > >
> >> > >
> >> >
> >>
> >
>

Re: Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

WindowStorageAgent was another suggestion as IdempotentStorageManager
extends StorageAgent.
If no one has any objection will call it that.

Chandni

On Sun, Nov 15, 2015 at 8:07 PM, Chandni Singh <ch...@datatorrent.com>
wrote:

> Hi,
>
> @Sandeep Will deprecate old IdempotentStorageManager. This will be a copy
> of the old one with a different name.
>
> @Sandesh
> A data store, in my opinion, is an entity which store data. This doesn't
> store data. It is used to save state per window.
>
> @Pramod
> Do you like WindowStateLogger?
>
> Thanks,
> Chandni
>
> On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <sa...@datatorrent.com>
> wrote:
>
>> Will there be any issue in semantic versioning because of this change?
>> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com> wrote:
>>
>> > As it is used to store & retrieve data, just call it DataStore.
>> >
>> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <pramod@datatorrent.com
>> >
>> > wrote:
>> >
>> > > Since this is mainly for storing information pertaining to data or the
>> > data
>> > > itself how about WindowDataManager or something like that.
>> > >
>> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
>> chandni@datatorrent.com>
>> > > wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > > Received feedback from couple of folks that
>> IdempotentStorageManager is
>> > > not
>> > > > a good name for that component. It is used in some of our
>> input/output
>> > > > operator for saving per window data.
>> > > >
>> > > > I was thinking of calling it WindowLogger.
>> > > >
>> > > > Let me know if anyone has a better suggestion.
>> > > >
>> > > > Chandni
>> > > >
>> > >
>> >
>>
>

Re: Renaming Idempotent Storage Manager

[Chandni Singh <ch...@datatorrent.com>]

Hi,

@Sandeep Will deprecate old IdempotentStorageManager. This will be a copy
of the old one with a different name.

@Sandesh
A data store, in my opinion, is an entity which store data. This doesn't
store data. It is used to save state per window.

@Pramod
Do you like WindowStateLogger?

Thanks,
Chandni

On Nov 15, 2015 6:59 PM, "Sandeep Deshmukh" <sa...@datatorrent.com> wrote:

> Will there be any issue in semantic versioning because of this change?
> On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com> wrote:
>
> > As it is used to store & retrieve data, just call it DataStore.
> >
> > On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <pr...@datatorrent.com>
> > wrote:
> >
> > > Since this is mainly for storing information pertaining to data or the
> > data
> > > itself how about WindowDataManager or something like that.
> > >
> > > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <
> chandni@datatorrent.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > Received feedback from couple of folks that IdempotentStorageManager
> is
> > > not
> > > > a good name for that component. It is used in some of our
> input/output
> > > > operator for saving per window data.
> > > >
> > > > I was thinking of calling it WindowLogger.
> > > >
> > > > Let me know if anyone has a better suggestion.
> > > >
> > > > Chandni
> > > >
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Sandeep Deshmukh <sa...@datatorrent.com>]

Will there be any issue in semantic versioning because of this change?
On 16 Nov 2015 07:35, "Sandesh Hegde" <sa...@datatorrent.com> wrote:

> As it is used to store & retrieve data, just call it DataStore.
>
> On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <pr...@datatorrent.com>
> wrote:
>
> > Since this is mainly for storing information pertaining to data or the
> data
> > itself how about WindowDataManager or something like that.
> >
> > On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <ch...@datatorrent.com>
> > wrote:
> >
> > > Hi,
> > >
> > > Received feedback from couple of folks that IdempotentStorageManager is
> > not
> > > a good name for that component. It is used in some of our input/output
> > > operator for saving per window data.
> > >
> > > I was thinking of calling it WindowLogger.
> > >
> > > Let me know if anyone has a better suggestion.
> > >
> > > Chandni
> > >
> >
>

Re: Renaming Idempotent Storage Manager

[Sandesh Hegde <sa...@datatorrent.com>]

As it is used to store & retrieve data, just call it DataStore.

On Sun, Nov 15, 2015 at 3:40 PM Pramod Immaneni <pr...@datatorrent.com>
wrote:

> Since this is mainly for storing information pertaining to data or the data
> itself how about WindowDataManager or something like that.
>
> On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <ch...@datatorrent.com>
> wrote:
>
> > Hi,
> >
> > Received feedback from couple of folks that IdempotentStorageManager is
> not
> > a good name for that component. It is used in some of our input/output
> > operator for saving per window data.
> >
> > I was thinking of calling it WindowLogger.
> >
> > Let me know if anyone has a better suggestion.
> >
> > Chandni
> >
>

Re: Renaming Idempotent Storage Manager

[Pramod Immaneni <pr...@datatorrent.com>]

Since this is mainly for storing information pertaining to data or the data
itself how about WindowDataManager or something like that.

On Sun, Nov 15, 2015 at 3:16 PM, Chandni Singh <ch...@datatorrent.com>
wrote:

> Hi,
>
> Received feedback from couple of folks that IdempotentStorageManager is not
> a good name for that component. It is used in some of our input/output
> operator for saving per window data.
>
> I was thinking of calling it WindowLogger.
>
> Let me know if anyone has a better suggestion.
>
> Chandni
>