You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Nico Kruber (Jira)" <ji...@apache.org> on 2021/03/03 11:02:00 UTC
[jira] [Created] (FLINK-21583) Allow comments in CSV format without
having to ignore parse errors
Nico Kruber created FLINK-21583:
-----------------------------------
Summary: Allow comments in CSV format without having to ignore parse errors
Key: FLINK-21583
URL: https://issues.apache.org/jira/browse/FLINK-21583
Project: Flink
Issue Type: Improvement
Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
Affects Versions: 1.12.1
Reporter: Nico Kruber
Currently, when you pass {{'csv.allow-comments' = 'true'}} to a table definition, you also have to set {{'csv.ignore-parse-errors' = 'true'}} to actually skip the commented-out line (and the docs mention this prominently as well). This, however, may mask actual parsing errors that you want to be notified of.
I would like to propose that {{allow-comments}} actually also skips the commented-out lines automatically because these shouldn't be used anyway.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)