You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Mahendran Ponnusamy (Jira)" <ji...@apache.org> on 2021/10/10 23:51:00 UTC

[jira] [Updated] (FLINK-24494) Avro conluent Resigry SQL not fails to write to the topic with schema with default value for int

     [ https://issues.apache.org/jira/browse/FLINK-24494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahendran Ponnusamy updated FLINK-24494:
----------------------------------------
    Description: 
 

Given a schema registered to a topic with default value as '0' for int,

when the flink sql with upsert-kafka connector writes to the topic,

it fails coz the schema registered is not compatible with the data [schema] it is producing where there is not default value [{color:#9876aa}"default" {color}{color:#cc7832}: {color}{color:#6897bb}0{color}] for the int.

{color:#cc7832} {color}

{
 {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"record"{color}{color:#cc7832},{color} {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"SimpleCustomer"{color}{color:#cc7832},{color} {color:#9876aa}"namespace" {color}{color:#cc7832}: {color}{color:#6a8759}"com.nordstrom.nap.onehop.example.model"{color}{color:#cc7832},{color} {color:#9876aa}"fields" {color}{color:#cc7832}: {color}[ {
 {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"customerId"{color}{color:#cc7832},{color} {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"string"{color} }{color:#cc7832}, {color}{
 {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"age"{color}{color:#cc7832},{color} {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"int"{color}{color:#cc7832},{color} {color:#9876aa}"default" {color}{color:#cc7832}: {color}{color:#6897bb}0{color} }]
 }

 

The full code is here [^KafkaTableTumbling.java]

  was:
 

Given a schema registered to a topic with default value as '0' for int,

when the flink sql with upsert-kafka connector writes to the topic,

it fails coz the schema registered is not compatible with the data [schema] it is producing where there is not default value [{color:#9876aa}"default" {color}{color:#cc7832}: {color}{color:#6897bb}0{color}] for the int.

{color:#cc7832} {color}

{
 {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"record"{color}{color:#cc7832},
{color} {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"SimpleCustomer"{color}{color:#cc7832},
{color} {color:#9876aa}"namespace" {color}{color:#cc7832}: {color}{color:#6a8759}"com.nordstrom.nap.onehop.example.model"{color}{color:#cc7832},
{color} {color:#9876aa}"fields" {color}{color:#cc7832}: {color}[ {
 {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"customerId"{color}{color:#cc7832},
{color} {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"string"
{color} }{color:#cc7832}, {color}{
 {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"age"{color}{color:#cc7832},
{color} {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"int"{color}{color:#cc7832},
{color} {color:#9876aa}"default" {color}{color:#cc7832}: {color}{color:#6897bb}0
{color} } ][^KafkaTableTumbling.java]
}


> Avro conluent Resigry SQL not fails to write to the topic with schema with default value for int
> ------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-24494
>                 URL: https://issues.apache.org/jira/browse/FLINK-24494
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / API
>    Affects Versions: 1.13.2
>            Reporter: Mahendran Ponnusamy
>            Priority: Critical
>         Attachments: KafkaTableTumbling.java
>
>
>  
> Given a schema registered to a topic with default value as '0' for int,
> when the flink sql with upsert-kafka connector writes to the topic,
> it fails coz the schema registered is not compatible with the data [schema] it is producing where there is not default value [{color:#9876aa}"default" {color}{color:#cc7832}: {color}{color:#6897bb}0{color}] for the int.
> {color:#cc7832} {color}
> {
>  {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"record"{color}{color:#cc7832},{color} {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"SimpleCustomer"{color}{color:#cc7832},{color} {color:#9876aa}"namespace" {color}{color:#cc7832}: {color}{color:#6a8759}"com.nordstrom.nap.onehop.example.model"{color}{color:#cc7832},{color} {color:#9876aa}"fields" {color}{color:#cc7832}: {color}[ {
>  {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"customerId"{color}{color:#cc7832},{color} {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"string"{color} }{color:#cc7832}, {color}{
>  {color:#9876aa}"name" {color}{color:#cc7832}: {color}{color:#6a8759}"age"{color}{color:#cc7832},{color} {color:#9876aa}"type" {color}{color:#cc7832}: {color}{color:#6a8759}"int"{color}{color:#cc7832},{color} {color:#9876aa}"default" {color}{color:#cc7832}: {color}{color:#6897bb}0{color} }]
>  }
>  
> The full code is here [^KafkaTableTumbling.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)