You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Damian Guy <da...@gmail.com> on 2016/10/01 07:42:59 UTC
Re: Kafka streaming and topic filter whitelist
That is correct.
On Fri, 30 Sep 2016 at 18:00 Gary Ogden <go...@gmail.com> wrote:
> So how exactly would that work? For example, I can currently do this:
>
> KStream<String, String>
> textLines = builder.stream(stringSerde, stringSerde, SYSTEM_TOPIC);
>
> Are you saying that I could put a regex in place of the SYSTEM_TOPIC and
> that one KStream would be streaming from multiple topics that match that
> regex?
>
> If so, that could be useful.
>
> Gary
>
>
> On 30 September 2016 at 13:35, Damian Guy <da...@gmail.com> wrote:
>
> > Hi Gary,
> >
> > In the upcoming 0.10.1 release you can do regex subscription - will that
> > help?
> >
> > Thanks,
> > Damian
> >
> > On Fri, 30 Sep 2016 at 14:57 Gary Ogden <go...@gmail.com> wrote:
> >
> > > Is it possible to use the topic filter whitelist within a Kafka
> Streaming
> > > application? Or can it only be done in a consumer job?
> > >
> >
>
Re: Kafka streaming and topic filter whitelist
Posted by Damian Guy <da...@gmail.com>.
They will be automatically added and removed.
On Mon, 3 Oct 2016 at 14:59 Gary Ogden <go...@gmail.com> wrote:
> What if topics are created or deleted after the application has started?
> Will they be added/removed automatically, or do we need to restart the
> application to pick up the changes?
>
> On 1 October 2016 at 04:42, Damian Guy <da...@gmail.com> wrote:
>
> > That is correct.
> >
> > On Fri, 30 Sep 2016 at 18:00 Gary Ogden <go...@gmail.com> wrote:
> >
> > > So how exactly would that work? For example, I can currently do this:
> > >
> > > KStream<String, String>
> > > textLines = builder.stream(stringSerde, stringSerde,
> > SYSTEM_TOPIC);
> > >
> > > Are you saying that I could put a regex in place of the SYSTEM_TOPIC
> and
> > > that one KStream would be streaming from multiple topics that match
> that
> > > regex?
> > >
> > > If so, that could be useful.
> > >
> > > Gary
> > >
> > >
> > > On 30 September 2016 at 13:35, Damian Guy <da...@gmail.com>
> wrote:
> > >
> > > > Hi Gary,
> > > >
> > > > In the upcoming 0.10.1 release you can do regex subscription - will
> > that
> > > > help?
> > > >
> > > > Thanks,
> > > > Damian
> > > >
> > > > On Fri, 30 Sep 2016 at 14:57 Gary Ogden <go...@gmail.com> wrote:
> > > >
> > > > > Is it possible to use the topic filter whitelist within a Kafka
> > > Streaming
> > > > > application? Or can it only be done in a consumer job?
> > > > >
> > > >
> > >
> >
>
Re: Kafka streaming and topic filter whitelist
Posted by Gary Ogden <go...@gmail.com>.
What if topics are created or deleted after the application has started?
Will they be added/removed automatically, or do we need to restart the
application to pick up the changes?
On 1 October 2016 at 04:42, Damian Guy <da...@gmail.com> wrote:
> That is correct.
>
> On Fri, 30 Sep 2016 at 18:00 Gary Ogden <go...@gmail.com> wrote:
>
> > So how exactly would that work? For example, I can currently do this:
> >
> > KStream<String, String>
> > textLines = builder.stream(stringSerde, stringSerde,
> SYSTEM_TOPIC);
> >
> > Are you saying that I could put a regex in place of the SYSTEM_TOPIC and
> > that one KStream would be streaming from multiple topics that match that
> > regex?
> >
> > If so, that could be useful.
> >
> > Gary
> >
> >
> > On 30 September 2016 at 13:35, Damian Guy <da...@gmail.com> wrote:
> >
> > > Hi Gary,
> > >
> > > In the upcoming 0.10.1 release you can do regex subscription - will
> that
> > > help?
> > >
> > > Thanks,
> > > Damian
> > >
> > > On Fri, 30 Sep 2016 at 14:57 Gary Ogden <go...@gmail.com> wrote:
> > >
> > > > Is it possible to use the topic filter whitelist within a Kafka
> > Streaming
> > > > application? Or can it only be done in a consumer job?
> > > >
> > >
> >
>