You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by David Yu <da...@optimizely.com> on 2016/08/05 18:39:50 UTC
Understand KV store restoring
Within a given container, does the restoration process go through the
changelog topic once to restore ALL stores in that container? From the
logs, I have a feeling that it is going through the changelog multiple
times.
Can anyone confirm?
Thanks,
David
Re: Understand KV store restoring
Posted by David Yu <da...@optimizely.com>.
Sorry, you are right. It is going through the changelog topic partition by
partition, which happens sequentially.
Thanks,
David
On Fri, Aug 5, 2016 at 1:53 PM Navina Ramesh <nr...@linkedin.com.invalid>
wrote:
> Hi David,
>
> For a given container, it should go through the entire changelog only for
> the partitions owned by the tasks in the container. Restoration should
> happen only once and not multiple times.
>
> What logs statements do you see that indicate that it is going through the
> changelog multiple times? Can you please share that ?
>
> Thanks!
> Navina
>
> On Fri, Aug 5, 2016 at 11:39 AM, David Yu <da...@optimizely.com> wrote:
>
> > Within a given container, does the restoration process go through the
> > changelog topic once to restore ALL stores in that container? From the
> > logs, I have a feeling that it is going through the changelog multiple
> > times.
> >
> > Can anyone confirm?
> >
> > Thanks,
> > David
> >
>
>
>
> --
> Navina R.
>
Re: Understand KV store restoring
Posted by Navina Ramesh <nr...@linkedin.com.INVALID>.
Hi David,
For a given container, it should go through the entire changelog only for
the partitions owned by the tasks in the container. Restoration should
happen only once and not multiple times.
What logs statements do you see that indicate that it is going through the
changelog multiple times? Can you please share that ?
Thanks!
Navina
On Fri, Aug 5, 2016 at 11:39 AM, David Yu <da...@optimizely.com> wrote:
> Within a given container, does the restoration process go through the
> changelog topic once to restore ALL stores in that container? From the
> logs, I have a feeling that it is going through the changelog multiple
> times.
>
> Can anyone confirm?
>
> Thanks,
> David
>
--
Navina R.