[jira] [Commented] (NIFI-7770) CSV reader configuration options missing from CSV Lookup Services

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192048#comment-17192048 ] 

ASF subversion and git services commented on NIFI-7770:
-------------------------------------------------------

Commit 73b7ff8fd4a5f4b0b4e7ff4bdf1b7f97728df9f5 in nifi's branch refs/heads/main from Tamás Bunth
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=73b7ff8 ]

NIFI-7770 Add features to csv lookup services

Add the following functionalities:
- Custom value separator (default is comma)
- Custom quote char to use (default is " i.e. quote sign)
- Quote mode
- Escape character to use (default is no escape character)
- Comment marker
- Trim fields
- Character set to use

The above features use a common implementation with "CSVReader".

Also append a sentence to the capability description that first line of
csv file is considered header. Setting custom header instead of using
the first line is not supported (yet).

Also, a minor refactor: CSVRecordLoopkupService and
SimpleCsvFileLookupService now share common logic in implementation.

CSV Format is extended to the same list as CSVReader. In addition,
lookup services still have the "default" csv format for compatibility
reasons.

Signed-off-by: Pierre Villard <pi...@gmail.com>

This closes #4494.


> CSV reader configuration options missing from CSV Lookup Services
> -----------------------------------------------------------------
>
>                 Key: NIFI-7770
>                 URL: https://issues.apache.org/jira/browse/NIFI-7770
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>    Affects Versions: 1.13.0
>            Reporter: Tamás Bunth
>            Assignee: Tamás Bunth
>            Priority: Minor
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> We have discovered that {{CSVRecordLookupService}} and {{SimpleCsvFileLookupService}} don't expose the same set of CSV formatter options and aren't flexible enough for our use case. Were trying to load a lookup CSV table with | (pipe) as a delimiter, but it's impossible.
>  
> Expected: enhance these 2 lookup services to expose same CSV reader configuration options as a {{CSVReader}} in terms of ingest formats, value delimiter, etc.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)