You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Dumitru-Nicolae Marasoui <Ni...@kaluza.com> on 2020/07/10 11:34:55 UTC
help needed, kafka-streams 2.5.0 does not support Named on reduce?
Hello kafka community,
Hi, kafka-streams 2.5.0 does not support Named on reduce? I configured it
but it does not take it..the grouped ones takes the named & see the
repartitioned topics with that name but the reduced does not take that
name; i would need in order to be able to demo nicely azkarra streams when
browsing the state store , do you have any idea? thanks
--
Dumitru-Nicolae Marasoui
Software Engineer
w kaluza.com <https://www.kaluza.com/>
LinkedIn <https://www.linkedin.com/company/kaluza> | Twitter
<https://twitter.com/Kaluza_tech>
Kaluza Ltd. registered in England and Wales No. 08785057
VAT No. 100119879
Help save paper - do you need to print this email?
Re: help needed, kafka-streams 2.5.0 does not support Named on reduce?
Posted by Dumitru-Nicolae Marasoui <Ni...@kaluza.com>.
I think it does help thank you very much
On Fri, 10 Jul 2020 at 17:29, Matthias J. Sax <mj...@apache.org> wrote:
> It should be possible to name all processors/stores/topics.
>
> However, it's not always clear how the API works -- in fact, some
> `Named` parameters "overlap". It's a know issue and not well documented.
> We need to fix this at some point.
>
> If you want to name a changelog topic, you can name the corresponding
> store, via `Materialized`, and the store name will be reused for the
> changelog topic.
>
> If you want to name a repartition topic, you can pass a name via the
> `Grouped` parameter of `groupBy()` or `groupByKey()`.
>
> Does that help?
>
>
> -Matthias
>
> On 7/10/20 4:46 AM, Dumitru-Nicolae Marasoui wrote:
> > Hello kafka community,
> > I understand, the Named argument i used is used to config used to name
> the
> > processor in the topology,
> > But is there any way I can give a custom, more readable name to an
> > intermediate topic like kstream-aggregate-... ?
> > Thanks
> >
> > On Fri, 10 Jul 2020 at 12:34, Dumitru-Nicolae Marasoui <
> > Nicolae.Marasoiu@kaluza.com> wrote:
> >
> >> Hello kafka community,
> >> Hi, kafka-streams 2.5.0 does not support Named on reduce? I configured
> it
> >> but it does not take it..the grouped ones takes the named & see the
> >> repartitioned topics with that name but the reduced does not take that
> >> name; i would need in order to be able to demo nicely azkarra streams
> when
> >> browsing the state store , do you have any idea? thanks
> >>
> >> --
> >>
> >> Dumitru-Nicolae Marasoui
> >>
> >> Software Engineer
> >>
> >>
> >>
> >> w kaluza.com <https://www.kaluza.com/>
> >>
> >> LinkedIn <https://www.linkedin.com/company/kaluza> | Twitter
> >> <https://twitter.com/Kaluza_tech>
> >>
> >> Kaluza Ltd. registered in England and Wales No. 08785057
> >>
> >> VAT No. 100119879
> >>
> >> Help save paper - do you need to print this email?
> >>
> >
> >
>
>
--
Dumitru-Nicolae Marasoui
Software Engineer
w kaluza.com <https://www.kaluza.com/>
LinkedIn <https://www.linkedin.com/company/kaluza> | Twitter
<https://twitter.com/Kaluza_tech>
Kaluza Ltd. registered in England and Wales No. 08785057
VAT No. 100119879
Help save paper - do you need to print this email?
Re: help needed, kafka-streams 2.5.0 does not support Named on
reduce?
Posted by "Matthias J. Sax" <mj...@apache.org>.
It should be possible to name all processors/stores/topics.
However, it's not always clear how the API works -- in fact, some
`Named` parameters "overlap". It's a know issue and not well documented.
We need to fix this at some point.
If you want to name a changelog topic, you can name the corresponding
store, via `Materialized`, and the store name will be reused for the
changelog topic.
If you want to name a repartition topic, you can pass a name via the
`Grouped` parameter of `groupBy()` or `groupByKey()`.
Does that help?
-Matthias
On 7/10/20 4:46 AM, Dumitru-Nicolae Marasoui wrote:
> Hello kafka community,
> I understand, the Named argument i used is used to config used to name the
> processor in the topology,
> But is there any way I can give a custom, more readable name to an
> intermediate topic like kstream-aggregate-... ?
> Thanks
>
> On Fri, 10 Jul 2020 at 12:34, Dumitru-Nicolae Marasoui <
> Nicolae.Marasoiu@kaluza.com> wrote:
>
>> Hello kafka community,
>> Hi, kafka-streams 2.5.0 does not support Named on reduce? I configured it
>> but it does not take it..the grouped ones takes the named & see the
>> repartitioned topics with that name but the reduced does not take that
>> name; i would need in order to be able to demo nicely azkarra streams when
>> browsing the state store , do you have any idea? thanks
>>
>> --
>>
>> Dumitru-Nicolae Marasoui
>>
>> Software Engineer
>>
>>
>>
>> w kaluza.com <https://www.kaluza.com/>
>>
>> LinkedIn <https://www.linkedin.com/company/kaluza> | Twitter
>> <https://twitter.com/Kaluza_tech>
>>
>> Kaluza Ltd. registered in England and Wales No. 08785057
>>
>> VAT No. 100119879
>>
>> Help save paper - do you need to print this email?
>>
>
>
Re: help needed, kafka-streams 2.5.0 does not support Named on reduce?
Posted by Dumitru-Nicolae Marasoui <Ni...@kaluza.com>.
Hello kafka community,
I understand, the Named argument i used is used to config used to name the
processor in the topology,
But is there any way I can give a custom, more readable name to an
intermediate topic like kstream-aggregate-... ?
Thanks
On Fri, 10 Jul 2020 at 12:34, Dumitru-Nicolae Marasoui <
Nicolae.Marasoiu@kaluza.com> wrote:
> Hello kafka community,
> Hi, kafka-streams 2.5.0 does not support Named on reduce? I configured it
> but it does not take it..the grouped ones takes the named & see the
> repartitioned topics with that name but the reduced does not take that
> name; i would need in order to be able to demo nicely azkarra streams when
> browsing the state store , do you have any idea? thanks
>
> --
>
> Dumitru-Nicolae Marasoui
>
> Software Engineer
>
>
>
> w kaluza.com <https://www.kaluza.com/>
>
> LinkedIn <https://www.linkedin.com/company/kaluza> | Twitter
> <https://twitter.com/Kaluza_tech>
>
> Kaluza Ltd. registered in England and Wales No. 08785057
>
> VAT No. 100119879
>
> Help save paper - do you need to print this email?
>
--
Dumitru-Nicolae Marasoui
Software Engineer
w kaluza.com <https://www.kaluza.com/>
LinkedIn <https://www.linkedin.com/company/kaluza> | Twitter
<https://twitter.com/Kaluza_tech>
Kaluza Ltd. registered in England and Wales No. 08785057
VAT No. 100119879
Help save paper - do you need to print this email?