You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2021/03/03 14:10:00 UTC
[jira] [Commented] (FLINK-21583) Allow comments in CSV format
without having to ignore parse errors
[ https://issues.apache.org/jira/browse/FLINK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294548#comment-17294548 ]
Jark Wu commented on FLINK-21583:
---------------------------------
+1
> Allow comments in CSV format without having to ignore parse errors
> ------------------------------------------------------------------
>
> Key: FLINK-21583
> URL: https://issues.apache.org/jira/browse/FLINK-21583
> Project: Flink
> Issue Type: Improvement
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
> Affects Versions: 1.12.1
> Reporter: Nico Kruber
> Priority: Major
>
> Currently, when you pass {{'csv.allow-comments' = 'true'}} to a table definition, you also have to set {{'csv.ignore-parse-errors' = 'true'}} to actually skip the commented-out line (and the docs mention this prominently as well). This, however, may mask actual parsing errors that you want to be notified of.
> I would like to propose that {{allow-comments}} actually also skips the commented-out lines automatically because these shouldn't be used anyway.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)