You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Madhukar Thota <ma...@gmail.com> on 2016/07/26 08:52:03 UTC
Syslog to avro format
Friends,
What is the best way to get Syslog data into avro format without converting
to JSON?
Any suggestions?
Re: Syslog to avro format
Posted by Madhukar Thota <ma...@gmail.com>.
HI Conrad
Thanks for your response. I am not opposed to convert into JSON. Just
checking to see if there is a way to get direct Avro conversion from
attributes.
-Madhu
On Tue, Jul 26, 2016 at 4:55 AM, Conrad Crampton <
conrad.crampton@secdata.com> wrote:
> Why not converting to JSON?
>
> I do exactly this, parse the syslog (into attributes), convert attributes
> to JSON, JSON->Avro.
>
> I had to have an intermediate Avro schema that was only strings due to a
> problem converting JSON integers into equivalent Avro, then convert Avro
> schema to final one (that included ints).
>
> HTH,
>
> Conrad
>
>
>
> *From: *Madhukar Thota <ma...@gmail.com>
> *Reply-To: *"users@nifi.apache.org" <us...@nifi.apache.org>
> *Date: *Tuesday, 26 July 2016 at 09:52
> *To: *"users@nifi.apache.org" <us...@nifi.apache.org>
> *Subject: *Syslog to avro format
>
>
>
> Friends,
>
>
>
> What is the best way to get Syslog data into avro format without
> converting to JSON?
>
>
>
> Any suggestions?
>
>
>
>
>
> ***This email originated outside SecureData***
>
> Click here <https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ==> to
> report this email as spam.
>
>
> SecureData, combating cyber threats
>
> ------------------------------
>
> The information contained in this message or any of its attachments may be
> privileged and confidential and intended for the exclusive use of the
> intended recipient. If you are not the intended recipient any disclosure,
> reproduction, distribution or other dissemination or use of this
> communications is strictly prohibited. The views expressed in this email
> are those of the individual and not necessarily of SecureData Europe Ltd.
> Any prices quoted are only valid if followed up by a formal written quote.
>
> SecureData Europe Limited. Registered in England & Wales 04365896.
> Registered Address: SecureData House, Hermitage Court, Hermitage Lane,
> Maidstone, Kent, ME16 9NT
>
Re: Syslog to avro format
Posted by Conrad Crampton <co...@SecData.com>.
Why not converting to JSON?
I do exactly this, parse the syslog (into attributes), convert attributes to JSON, JSON->Avro.
I had to have an intermediate Avro schema that was only strings due to a problem converting JSON integers into equivalent Avro, then convert Avro schema to final one (that included ints).
HTH,
Conrad
From: Madhukar Thota <ma...@gmail.com>
Reply-To: "users@nifi.apache.org" <us...@nifi.apache.org>
Date: Tuesday, 26 July 2016 at 09:52
To: "users@nifi.apache.org" <us...@nifi.apache.org>
Subject: Syslog to avro format
Friends,
What is the best way to get Syslog data into avro format without converting to JSON?
Any suggestions?
***This email originated outside SecureData***
Click here<https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ==> to report this email as spam.
SecureData, combating cyber threats
______________________________________________________________________
The information contained in this message or any of its attachments may be privileged and confidential and intended for the exclusive use of the intended recipient. If you are not the intended recipient any disclosure, reproduction, distribution or other dissemination or use of this communications is strictly prohibited. The views expressed in this email are those of the individual and not necessarily of SecureData Europe Ltd. Any prices quoted are only valid if followed up by a formal written quote.
SecureData Europe Limited. Registered in England & Wales 04365896. Registered Address: SecureData House, Hermitage Court, Hermitage Lane, Maidstone, Kent, ME16 9NT