Re: CSV formatted data to Metron and deploying ML models

[Hema malini <nh...@gmail.com>]

Thanks Tom ..i am trying it out..

On Fri, 1 Nov, 2019, 12:09 AM Yerex, Tom, <to...@ubc.ca> wrote:

> Hi Hema,
>
>
>
> I think the CSV formatted data can be imported into HBase and then applied
> from there. I don’t know how accurate this is, but I was able to do some
> very basic enrichment using the steps here:
>
>
>
> hxxps://
> cwiki.apache.org/confluence/display/METRON/2016/06/16/Metron+Tutorial+-+Fundamentals+Part+6%3A+Streaming+Enrichment
>
>
>
> To quote: “As you can see, we are using a stock CSVParser implemented in
> Metron and a writer to write out to HBase in the key/value format suitable
> for use in the enrichment topology.”
>
>
>
> I think the idea is you will take your streaming information from one of
> your Kafka topics into Metron, where it will be enriched with your data
> from the CSV file, which you have imported into HBase. The machine learning
> you can perform using Stellar.
>
>
>
> Mind you, I haven’t done it myself (yet), so I’m eager to learn if I got
> this wrong.
>
>
>
> 😊
>
>
>
> Tom.
>
>
>
> *From: *Hema malini <nh...@gmail.com>
> *Reply-To: *"user@metron.apache.org" <us...@metron.apache.org>
> *Date: *Thursday, October 31, 2019 at 8:28 AM
> *To: *"user@metron.apache.org" <us...@metron.apache.org>
> *Subject: *CSV formatted data to Metron and deploying ML models
>
>
>
> Hi,
>
>
>
> We have logs collected from devices defined in csv format and we need to
> stream the logs to Metron pipeline and apply our ml models. Tried sending
> bro logs and able to see jivana dashboard. To which Kafka topic i need to
> send the CSV formatted logs and visualise in Kibana. How can i deploy the
> ml models in metron to determine the alerts .Can someone provide any link .
>
>
>
> Thanks and Regards,
>
>
>
> Hema
>
>
>
>
>
>
>
>
>
>
>
>
>