You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "zoucao (Jira)" <ji...@apache.org> on 2021/01/01 10:40:00 UTC

[jira] [Commented] (FLINK-20795) add a parameter to decide whether print dirty record when `ignore-parse-errors` is true

    [ https://issues.apache.org/jira/browse/FLINK-20795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257167#comment-17257167 ] 

zoucao commented on FLINK-20795:
--------------------------------

hi [~xiaozilong], thanks for your attention, I quite agree with your opinion, it is matter to add  a metric to count the number of errors and print the error record and I think it is important to control printing frequency, but add too many parameters will make the format system bloated and sometimes be unfriendly to new comers ?  Maybe we should listen to more people's opinions.

> add a parameter to decide whether print dirty record when `ignore-parse-errors` is true
> ---------------------------------------------------------------------------------------
>
>                 Key: FLINK-20795
>                 URL: https://issues.apache.org/jira/browse/FLINK-20795
>             Project: Flink
>          Issue Type: Improvement
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>    Affects Versions: 1.13.0
>            Reporter: zoucao
>            Priority: Major
>
> add a parameter to decide whether print dirty data when `ignore-parse-errors`=true, some users want to make his task stability and know the dirty record to fix the upstream, too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)