You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Gitendra Chaudhari <ma...@yahoo.co.in.INVALID> on 2016/07/19 21:39:39 UTC
Apache NiFi - Supported file formats/types
Hi,
I know Apache NiFi support various file formats/types like txt etc. I am trying to get the official list of various file formats supported by Apache NiFi. I am not able to find such list in documentation or anywhere else.
Can someone please direct me to such supported file format list if it is available.
Hoping positive response and thanks in advance for response.
Thanks and Regards,Gitendra
Re: Apache NiFi - Supported file formats/types
Posted by Gitendra Chaudhari <ma...@yahoo.co.in.INVALID>.
ok thanks Matt.
Thanks and Regards,Gitendra
On Tuesday, 19 July 2016 6:57 PM, Matt Burgess <ma...@gmail.com> wrote:
Gitendra,
NiFi is technically a format-agnostic system, meaning it can support
any type of content. Having said that, there are processors to make
transformation/manipulation easier for various formats such as Avro,
JSON, XML, CSV, SQL, and for others there are processors like
ReplaceText and ExtractText that can work with the powerful regular
expression concept. There are also processors like ListenUDP/TCP and
MergeContent that can handle binary data. In addition, many community
contributors have offered processors (either in Apache NiFi or
externally) that handle other formats (such as Object Recognition in
images or Metadata extract from various formats using Apache Tika).
IMO there is no official list of file formats supported by NiFi, nor
are there technically any limitations on the formats it can support. I
think the best "list" is the official documentation
(https://nifi.apache.org/docs.html), the list of processors on the
left should show the level of support for various formats.
Regards,
Matt
On Tue, Jul 19, 2016 at 5:39 PM, Gitendra Chaudhari
<ma...@yahoo.co.in.invalid> wrote:
> Hi,
> I know Apache NiFi support various file formats/types like txt etc. I am trying to get the official list of various file formats supported by Apache NiFi. I am not able to find such list in documentation or anywhere else.
> Can someone please direct me to such supported file format list if it is available.
> Hoping positive response and thanks in advance for response.
> Thanks and Regards,Gitendra
>
Re: Apache NiFi - Supported file formats/types
Posted by Matt Burgess <ma...@gmail.com>.
Gitendra,
NiFi is technically a format-agnostic system, meaning it can support
any type of content. Having said that, there are processors to make
transformation/manipulation easier for various formats such as Avro,
JSON, XML, CSV, SQL, and for others there are processors like
ReplaceText and ExtractText that can work with the powerful regular
expression concept. There are also processors like ListenUDP/TCP and
MergeContent that can handle binary data. In addition, many community
contributors have offered processors (either in Apache NiFi or
externally) that handle other formats (such as Object Recognition in
images or Metadata extract from various formats using Apache Tika).
IMO there is no official list of file formats supported by NiFi, nor
are there technically any limitations on the formats it can support. I
think the best "list" is the official documentation
(https://nifi.apache.org/docs.html), the list of processors on the
left should show the level of support for various formats.
Regards,
Matt
On Tue, Jul 19, 2016 at 5:39 PM, Gitendra Chaudhari
<ma...@yahoo.co.in.invalid> wrote:
> Hi,
> I know Apache NiFi support various file formats/types like txt etc. I am trying to get the official list of various file formats supported by Apache NiFi. I am not able to find such list in documentation or anywhere else.
> Can someone please direct me to such supported file format list if it is available.
> Hoping positive response and thanks in advance for response.
> Thanks and Regards,Gitendra
>
Re: Apache NiFi - Supported file formats/types
Posted by Andy LoPresto <al...@apache.org>.
Hi Gitendra,
Can you please clarify what you are attempting to accomplish? NiFi can ingest a file of any arbitrary format from a file system and pass its contents, in binary or text, through the data flow. If you would like to parse a specific native format, you can look at the list of processors that ship with NiFi by default [1]. You can also write your own processors [2], or use the ExecuteScript or InvokeScriptedProcessor to run a script to parse the contents.
If you can be more specific with your question, someone on the list will likely be able to offer suggestions on which processors to examine or an alternate workflow.
[1] https://nifi.apache.org/docs.html <https://nifi.apache.org/docs.html>
[2] https://nifi.apache.org/developer-guide.html <https://nifi.apache.org/developer-guide.html>
Andy LoPresto
alopresto@apache.org
alopresto.apache@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
> On Jul 19, 2016, at 2:39 PM, Gitendra Chaudhari <ma...@yahoo.co.in.INVALID> wrote:
>
> Hi,
> I know Apache NiFi support various file formats/types like txt etc. I am trying to get the official list of various file formats supported by Apache NiFi. I am not able to find such list in documentation or anywhere else.
> Can someone please direct me to such supported file format list if it is available.
> Hoping positive response and thanks in advance for response.
> Thanks and Regards,Gitendra
>