You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Lukas Steiblys <lu...@doubledutch.me> on 2015/10/30 01:39:33 UTC
Checkpoint tool not working
Hello,
I’m trying to write the checkpoints for a Samza task supplying these arguments to the checkpoint tool:
bin/checkpoint-tool.sh --new-offsets=file:///checkpoints/client-metrics.properties --config-path=file:///checkpoints/task.properties
However, it doesn’t actually write the checkpoints and, instead, prints out the current checkpoints.
Is the tool currently broken? A sample of the client-metrics.properties file:
tasknames.Partition 13.systems.kafka.streams.Sessions.partitions.13 = 7233333
tasknames.Partition 14.systems.kafka.streams.Sessions.partitions.14 = 14589258
tasknames.Partition 15.systems.kafka.streams.Sessions.partitions.15=10886881
Lukas
Re: Checkpoint tool not working
Posted by Navina Ramesh <nr...@linkedin.com>.
Oops.. I just saw your first email with a sample of the offset file.
Can you try escaping the space in the file. For example, I used it as below:
tasknames.Partition\ 13.systems.kafka.streams.Sessions.partitions.13=7233333
This is not the best way to go about it. We will fix it in the new release.
Thanks!
On Fri, Oct 30, 2015 at 2:45 PM, Navina Ramesh <nr...@linkedin.com> wrote:
> Hi Lucas,
>
> What is the format that you are using for re-specifying the offsets? Do
> you specify it with --new-offsets ?
>
> If you can share that, it will be great. It seems to work for me.
>
> Thanks!
> Navina
>
> On Fri, Oct 30, 2015 at 9:11 AM, Roger Hoover <ro...@gmail.com>
> wrote:
>
>> I tried it once with 0.9.1 and it didn't work for me either. I didn't
>> have
>> time to examine it more carefully at the time.
>>
>> Roger
>>
>> On Thu, Oct 29, 2015 at 10:05 PM, Lukas Steiblys <lu...@doubledutch.me>
>> wrote:
>>
>> > I'm using Samza 0.9.1.
>> >
>> > Lukas
>> >
>> > On 10/29/15, Yi Pan <ni...@gmail.com> wrote:
>> > > Hi, Lukas,
>> > >
>> > > Which version of checkpoint-tool are you using?
>> > >
>> > > -Yi
>> > >
>> > > On Thu, Oct 29, 2015 at 5:39 PM, Lukas Steiblys <lukas@doubledutch.me
>> >
>> > > wrote:
>> > >
>> > >> Hello,
>> > >>
>> > >> I’m trying to write the checkpoints for a Samza task supplying these
>> > >> arguments to the checkpoint tool:
>> > >>
>> > >> bin/checkpoint-tool.sh
>> > >> --new-offsets=file:///checkpoints/client-metrics.properties
>> > >> --config-path=file:///checkpoints/task.properties
>> > >>
>> > >> However, it doesn’t actually write the checkpoints and, instead,
>> prints
>> > >> out the current checkpoints.
>> > >>
>> > >> Is the tool currently broken? A sample of the
>> client-metrics.properties
>> > >> file:
>> > >>
>> > >> tasknames.Partition 13.systems.kafka.streams.Sessions.partitions.13 =
>> > >> 7233333
>> > >> tasknames.Partition 14.systems.kafka.streams.Sessions.partitions.14 =
>> > >> 14589258
>> > >> tasknames.Partition
>> > >> 15.systems.kafka.streams.Sessions.partitions.15=10886881
>> > >>
>> > >> Lukas
>> > >
>> >
>>
>
>
>
> --
> Navina R.
>
--
Navina R.
Re: Checkpoint tool not working
Posted by Navina Ramesh <nr...@linkedin.com>.
Hi Lucas,
What is the format that you are using for re-specifying the offsets? Do you
specify it with --new-offsets ?
If you can share that, it will be great. It seems to work for me.
Thanks!
Navina
On Fri, Oct 30, 2015 at 9:11 AM, Roger Hoover <ro...@gmail.com>
wrote:
> I tried it once with 0.9.1 and it didn't work for me either. I didn't have
> time to examine it more carefully at the time.
>
> Roger
>
> On Thu, Oct 29, 2015 at 10:05 PM, Lukas Steiblys <lu...@doubledutch.me>
> wrote:
>
> > I'm using Samza 0.9.1.
> >
> > Lukas
> >
> > On 10/29/15, Yi Pan <ni...@gmail.com> wrote:
> > > Hi, Lukas,
> > >
> > > Which version of checkpoint-tool are you using?
> > >
> > > -Yi
> > >
> > > On Thu, Oct 29, 2015 at 5:39 PM, Lukas Steiblys <lu...@doubledutch.me>
> > > wrote:
> > >
> > >> Hello,
> > >>
> > >> I’m trying to write the checkpoints for a Samza task supplying these
> > >> arguments to the checkpoint tool:
> > >>
> > >> bin/checkpoint-tool.sh
> > >> --new-offsets=file:///checkpoints/client-metrics.properties
> > >> --config-path=file:///checkpoints/task.properties
> > >>
> > >> However, it doesn’t actually write the checkpoints and, instead,
> prints
> > >> out the current checkpoints.
> > >>
> > >> Is the tool currently broken? A sample of the
> client-metrics.properties
> > >> file:
> > >>
> > >> tasknames.Partition 13.systems.kafka.streams.Sessions.partitions.13 =
> > >> 7233333
> > >> tasknames.Partition 14.systems.kafka.streams.Sessions.partitions.14 =
> > >> 14589258
> > >> tasknames.Partition
> > >> 15.systems.kafka.streams.Sessions.partitions.15=10886881
> > >>
> > >> Lukas
> > >
> >
>
--
Navina R.
Re: Checkpoint tool not working
Posted by Roger Hoover <ro...@gmail.com>.
I tried it once with 0.9.1 and it didn't work for me either. I didn't have
time to examine it more carefully at the time.
Roger
On Thu, Oct 29, 2015 at 10:05 PM, Lukas Steiblys <lu...@doubledutch.me>
wrote:
> I'm using Samza 0.9.1.
>
> Lukas
>
> On 10/29/15, Yi Pan <ni...@gmail.com> wrote:
> > Hi, Lukas,
> >
> > Which version of checkpoint-tool are you using?
> >
> > -Yi
> >
> > On Thu, Oct 29, 2015 at 5:39 PM, Lukas Steiblys <lu...@doubledutch.me>
> > wrote:
> >
> >> Hello,
> >>
> >> I’m trying to write the checkpoints for a Samza task supplying these
> >> arguments to the checkpoint tool:
> >>
> >> bin/checkpoint-tool.sh
> >> --new-offsets=file:///checkpoints/client-metrics.properties
> >> --config-path=file:///checkpoints/task.properties
> >>
> >> However, it doesn’t actually write the checkpoints and, instead, prints
> >> out the current checkpoints.
> >>
> >> Is the tool currently broken? A sample of the client-metrics.properties
> >> file:
> >>
> >> tasknames.Partition 13.systems.kafka.streams.Sessions.partitions.13 =
> >> 7233333
> >> tasknames.Partition 14.systems.kafka.streams.Sessions.partitions.14 =
> >> 14589258
> >> tasknames.Partition
> >> 15.systems.kafka.streams.Sessions.partitions.15=10886881
> >>
> >> Lukas
> >
>
Re: Checkpoint tool not working
Posted by Lukas Steiblys <lu...@doubledutch.me>.
I'm using Samza 0.9.1.
Lukas
On 10/29/15, Yi Pan <ni...@gmail.com> wrote:
> Hi, Lukas,
>
> Which version of checkpoint-tool are you using?
>
> -Yi
>
> On Thu, Oct 29, 2015 at 5:39 PM, Lukas Steiblys <lu...@doubledutch.me>
> wrote:
>
>> Hello,
>>
>> I’m trying to write the checkpoints for a Samza task supplying these
>> arguments to the checkpoint tool:
>>
>> bin/checkpoint-tool.sh
>> --new-offsets=file:///checkpoints/client-metrics.properties
>> --config-path=file:///checkpoints/task.properties
>>
>> However, it doesn’t actually write the checkpoints and, instead, prints
>> out the current checkpoints.
>>
>> Is the tool currently broken? A sample of the client-metrics.properties
>> file:
>>
>> tasknames.Partition 13.systems.kafka.streams.Sessions.partitions.13 =
>> 7233333
>> tasknames.Partition 14.systems.kafka.streams.Sessions.partitions.14 =
>> 14589258
>> tasknames.Partition
>> 15.systems.kafka.streams.Sessions.partitions.15=10886881
>>
>> Lukas
>
Re: Checkpoint tool not working
Posted by Yi Pan <ni...@gmail.com>.
Hi, Lukas,
Which version of checkpoint-tool are you using?
-Yi
On Thu, Oct 29, 2015 at 5:39 PM, Lukas Steiblys <lu...@doubledutch.me>
wrote:
> Hello,
>
> I’m trying to write the checkpoints for a Samza task supplying these
> arguments to the checkpoint tool:
>
> bin/checkpoint-tool.sh
> --new-offsets=file:///checkpoints/client-metrics.properties
> --config-path=file:///checkpoints/task.properties
>
> However, it doesn’t actually write the checkpoints and, instead, prints
> out the current checkpoints.
>
> Is the tool currently broken? A sample of the client-metrics.properties
> file:
>
> tasknames.Partition 13.systems.kafka.streams.Sessions.partitions.13 =
> 7233333
> tasknames.Partition 14.systems.kafka.streams.Sessions.partitions.14 =
> 14589258
> tasknames.Partition
> 15.systems.kafka.streams.Sessions.partitions.15=10886881
>
> Lukas