[jira] [Comment Edited] (FLINK-20170) json deserialize loses precision

["Timo Walther (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-20170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17232726#comment-17232726 ] 

Timo Walther edited comment on FLINK-20170 at 11/16/20, 12:39 PM:
------------------------------------------------------------------

[~ana4] {{'connector.type' = 'kafka'}} uses the old connector and format stack. Did you try out the new one {{'connector' = 'kafka'}}? It is also better integrated with the new type system. In the new format you should be able to declare correct precision and scale.


was (Author: twalthr):
[~ana4] {{'connector.type' = 'kafka'}} uses the old connector and format stack. Did you try out the new one {{'connector' = 'kafka'}}? It is also better integrated with the new type system.

> json deserialize loses precision
> --------------------------------
>
>                 Key: FLINK-20170
>                 URL: https://issues.apache.org/jira/browse/FLINK-20170
>             Project: Flink
>          Issue Type: Improvement
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / API
>            Reporter: Mulan
>            Priority: Major
>
> {code:java}
> CREATE TABLE ods (
>     id BIGINT,
>     factor DECIMAL(38, 18)
> ) WITH (
>     'connector.type' = 'kafka',
>     'connector.version' = 'universal',
>     'connector.topic' = '_foo',
>     'connector.topic?' = '_foo',
>     'connector.properties.bootstrap.servers' = 'localhost:9092',
>     'connector.properties.group.id' = 'g',
>     'format.type' = 'json',
>     'update-mode' = 'append'
> );
> {code}
> this following is input data.
> {code:json}
> {"id": 1, "factor": 799.929496989092949698}
> {code}
> this following is output data and loses precision.
> {code:json}
> 1, 799.929496989093000000
> {code}
> This following code call readTree() method. This method make value loses precision.
> {code:java}
> 	public Row deserialize(byte[] message) throws IOException {
> 		try {
> 			final JsonNode root = objectMapper.readTree(message);
> 			return (Row) runtimeConverter.convert(objectMapper, root);
> 		} catch (Throwable t) {
> 			throw new IOException("Failed to deserialize JSON object.", t);
> 		}
> 	}
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)