You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by "Meenakshi.S" <me...@inspirisys.com> on 2019/03/28 10:45:54 UTC
Syslog5424 topic missing in kafka
Hi ,
Due to some node issues I have to reinstall metron. Now I am not able to find the topic syslog5424 in the list of kafka topics .
Any idea how to get the missing topic .
Regards,
Meenakshi
Re: Syslog5424 topic missing in kafka
Posted by Stefan Kupstaitis-Dunkler <st...@gmail.com>.
Hi Meenakshi,
I don't think so, as mentioned, you want to create your Kafka topics based
on your requirements of number of replicas and number of partitions.
Best,
Stefan
On Thu, Mar 28, 2019 at 11:38 AM Meenakshi.S <
meenakshi.subramanian@inspirisys.com> wrote:
> Hi Stefan ,
>
>
>
> I reinstalled from the step1 via ambari. It is like a fresh installation
> of metron . When I installed previously I was able to see the syslog topic
> but now after my fresh installation this topic was missing . I just wanted
> to know I missed anything during the installation
>
>
>
> Regards,
>
> Meenakshi
>
>
>
> *From:* Stefan Kupstaitis-Dunkler [mailto:stefan.dun@gmail.com]
> *Sent:* 28 March 2019 16:42
> *To:* user@metron.apache.org; meenakshi.subramanian@inspirisys.com
> *Subject:* Re: Syslog5424 topic missing in kafka
>
>
>
> Hi Meenakshi,
>
>
>
> When you say re-install I assume for my answer that you also installed new
> Kafka brokers (correct me if I'm wrong).
>
>
>
> Did you create the syslog5424 topic in your first cluster? If not it
> probably was created automatically when you tried to read from/write to it.
>
>
>
> Generally it's better to create your Kafka topics manually to ensure it
> has the number of partitions you need and the number of replicas you want.
>
>
>
> Best,
>
> Stefan
>
>
>
> On Thu, Mar 28, 2019 at 10:46 AM Meenakshi.S <
> meenakshi.subramanian@inspirisys.com> wrote:
>
> Hi ,
>
> Due to some node issues I have to reinstall metron. Now I am not able to
> find the topic syslog5424 in the list of kafka topics .
>
> Any idea how to get the missing topic .
>
>
>
> Regards,
>
> Meenakshi
>
>
>
>
> --
>
> Stefan Kupstaitis-Dunkler
>
> https://datahovel.com/
>
> https://twitter.com/StefanDunkler
>
--
Stefan Kupstaitis-Dunkler
https://datahovel.com/
https://twitter.com/StefanDunkler
Re: Syslog5424 topic missing in kafka
Posted by Michael Miklavcic <mi...@gmail.com>.
There are a series of flag files we create in the metron home directory to
assist with managing state on restarts. Look there for any flag files
pertaining to Kafka/parsers. Deleting the file will inform Ambari to
reinstall.
On Thu, Mar 28, 2019, 5:38 AM Meenakshi.S <
meenakshi.subramanian@inspirisys.com> wrote:
> Hi Stefan ,
>
>
>
> I reinstalled from the step1 via ambari. It is like a fresh installation
> of metron . When I installed previously I was able to see the syslog topic
> but now after my fresh installation this topic was missing . I just wanted
> to know I missed anything during the installation
>
>
>
> Regards,
>
> Meenakshi
>
>
>
> *From:* Stefan Kupstaitis-Dunkler [mailto:stefan.dun@gmail.com]
> *Sent:* 28 March 2019 16:42
> *To:* user@metron.apache.org; meenakshi.subramanian@inspirisys.com
> *Subject:* Re: Syslog5424 topic missing in kafka
>
>
>
> Hi Meenakshi,
>
>
>
> When you say re-install I assume for my answer that you also installed new
> Kafka brokers (correct me if I'm wrong).
>
>
>
> Did you create the syslog5424 topic in your first cluster? If not it
> probably was created automatically when you tried to read from/write to it.
>
>
>
> Generally it's better to create your Kafka topics manually to ensure it
> has the number of partitions you need and the number of replicas you want.
>
>
>
> Best,
>
> Stefan
>
>
>
> On Thu, Mar 28, 2019 at 10:46 AM Meenakshi.S <
> meenakshi.subramanian@inspirisys.com> wrote:
>
> Hi ,
>
> Due to some node issues I have to reinstall metron. Now I am not able to
> find the topic syslog5424 in the list of kafka topics .
>
> Any idea how to get the missing topic .
>
>
>
> Regards,
>
> Meenakshi
>
>
>
>
> --
>
> Stefan Kupstaitis-Dunkler
>
> https://datahovel.com/
>
> https://twitter.com/StefanDunkler
>
RE: Syslog5424 topic missing in kafka
Posted by "Meenakshi.S" <me...@inspirisys.com>.
Hi Stefan ,
I reinstalled from the step1 via ambari. It is like a fresh installation of metron . When I installed previously I was able to see the syslog topic but now after my fresh installation this topic was missing . I just wanted to know I missed anything during the installation
Regards,
Meenakshi
From: Stefan Kupstaitis-Dunkler [mailto:stefan.dun@gmail.com]
Sent: 28 March 2019 16:42
To: user@metron.apache.org; meenakshi.subramanian@inspirisys.com
Subject: Re: Syslog5424 topic missing in kafka
Hi Meenakshi,
When you say re-install I assume for my answer that you also installed new Kafka brokers (correct me if I'm wrong).
Did you create the syslog5424 topic in your first cluster? If not it probably was created automatically when you tried to read from/write to it.
Generally it's better to create your Kafka topics manually to ensure it has the number of partitions you need and the number of replicas you want.
Best,
Stefan
On Thu, Mar 28, 2019 at 10:46 AM Meenakshi.S <meenakshi.subramanian@inspirisys.com <ma...@inspirisys.com> > wrote:
Hi ,
Due to some node issues I have to reinstall metron. Now I am not able to find the topic syslog5424 in the list of kafka topics .
Any idea how to get the missing topic .
Regards,
Meenakshi
--
Stefan Kupstaitis-Dunkler
https://datahovel.com/
https://twitter.com/StefanDunkler
Re: Syslog5424 topic missing in kafka
Posted by Stefan Kupstaitis-Dunkler <st...@gmail.com>.
Hi Meenakshi,
When you say re-install I assume for my answer that you also installed new
Kafka brokers (correct me if I'm wrong).
Did you create the syslog5424 topic in your first cluster? If not it
probably was created automatically when you tried to read from/write to it.
Generally it's better to create your Kafka topics manually to ensure it has
the number of partitions you need and the number of replicas you want.
Best,
Stefan
On Thu, Mar 28, 2019 at 10:46 AM Meenakshi.S <
meenakshi.subramanian@inspirisys.com> wrote:
> Hi ,
>
> Due to some node issues I have to reinstall metron. Now I am not able to
> find the topic syslog5424 in the list of kafka topics .
>
> Any idea how to get the missing topic .
>
>
>
> Regards,
>
> Meenakshi
>
--
Stefan Kupstaitis-Dunkler
https://datahovel.com/
https://twitter.com/StefanDunkler