You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Carl (Jira)" <ji...@apache.org> on 2021/08/24 08:41:00 UTC
[jira] [Created] (FLINK-23939) The result of validation and parsing
failure does not match the document description
Carl created FLINK-23939:
----------------------------
Summary: The result of validation and parsing failure does not match the document description
Key: FLINK-23939
URL: https://issues.apache.org/jira/browse/FLINK-23939
Project: Flink
Issue Type: Bug
Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
Affects Versions: 1.12.1
Reporter: Carl
Attachments: image-2021-08-24-16-12-48-465.png, image-2021-08-24-16-15-47-714.png, image-2021-08-24-16-21-05-386.png, image-2021-08-24-16-21-23-228.png, image-2021-08-24-16-24-13-246.png, image-2021-08-24-16-26-32-560.png, image-2021-08-24-16-34-48-347.png, image-2021-08-24-16-37-00-740.png
*table options as follows,*
!image-2021-08-24-16-12-48-465.png!
*kafka source table ddl as follows：*
!image-2021-08-24-16-15-47-714.png!
*kafka message for test:*
*message A:*
!image-2021-08-24-16-21-05-386.png!
*message B:*
!image-2021-08-24-16-21-23-228.png!
*1. Test 1：*
json.fail-on-missing-field = *false*
json.ignore-parse-errors = *false*
produce test kafka message and result as follows，
!image-2021-08-24-16-24-13-246.png!
*As described in the documentation, the program should throw an exception？*
*2. Test 2：*
json.fail-on-missing-field = *false*
json.ignore-parse-errors = *true*
!image-2021-08-24-16-26-32-560.png!
*As described in the documentation, the program should throw an exception？*
*3. Test 3：*
json.fail-on-missing-field = *true*
json.ignore-parse-errors = *false*
!image-2021-08-24-16-34-48-347.png!
4. Test 4 :
json.fail-on-missing-field = *true*
json.ignore-parse-errors = *true*
!image-2021-08-24-16-37-00-740.png!
*As described in the documentation, why should'n both be true？*
As above, the results of the above experiments make me confused. Can I achieve such an effect? When the parsing fails, skip this data, and do not throw an exception, and the program continues to run?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)