You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Philipp Korniets (Jira)" <ji...@apache.org> on 2021/07/20 16:07:00 UTC
[jira] [Created] (NIFI-8932) Add feature to CSVReader to skip N
lines at top/bottom of the file
Philipp Korniets created NIFI-8932:
--------------------------------------
Summary: Add feature to CSVReader to skip N lines at top/bottom of the file
Key: NIFI-8932
URL: https://issues.apache.org/jira/browse/NIFI-8932
Project: Apache NiFi
Issue Type: Improvement
Reporter: Philipp Korniets
We have a lot of CSV files where provider add custom header/footer to valid CSV content.
CSV header is actually second row.
To remove unnecessary data we can use
* ReplaceText
* splitText->RouteOnAttribute -> MergeContent
It would be great to have an option in CSVReader controller to skip N rows from top/bottom in order to get5 clean data.
* skip N from the top
* skip M from the bottom
Data Example:
|7/20/21 2:48:47 AM GMT-04:00 ABB: Blended Rate Calc (X)| | | | | | |
|distribution_id|Distribution Id|settle_date|group_code|company_name|currency_code|common_account_name|business_date|prod_code|security|class|asset_type|
|-1|all|20210719|Repo 21025226|qwerty |EUR|TPSL_21025226 |19-Jul-21|BRM96ST7 |ABC 14/09/24|NR|BOND |
|-1|all|20210719|Repo 21025226|qwerty |GBP|RPSS_21025226 |19-Jul-21| |Total @ -0.11| | |
--
This message was sent by Atlassian Jira
(v8.3.4#803005)