You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@bahir.apache.org by "zyong (Jira)" <ji...@apache.org> on 2021/04/08 08:47:01 UTC

[jira] [Created] (BAHIR-271) flink 操作kudu写入时候，序列化异常

zyong created BAHIR-271:
---------------------------

             Summary: flink 操作kudu写入时候，序列化异常
                 Key: BAHIR-271
                 URL: https://issues.apache.org/jira/browse/BAHIR-271
             Project: Bahir
          Issue Type: Bug
          Components: Flink Streaming Connectors
    Affects Versions: Flink-1.0
         Environment: Flink1.12.2
            Reporter: zyong
         Attachments: image-2021-04-08-00-42-41-303.png, image-2021-04-08-00-46-08-041.png

!image-2021-04-08-00-42-41-303.png!

以上为本地代码，当我使用  

new KuduSink[AccountFlow](build,
 KuduTableInfo.forTable("impala::ads.account_flow_view"),
new PojoOperationMapper(classOf[AccountFlow],
 Array("id","sender_num","fee_type"),KuduOperation.UPSERT))
resDf.addSink(sinkFunction)//序列化异常 我查看是Array存在序列化风险，但后续改用new Array[String] 翻看源码发现这是序列化的。后续操作还会报序列化异常，我自身的AccountFLow也是序列化的，经查看，在pojo操作ColumnSchema  kudu-cline自带的时候该类无序列。导致了整个sink不能正常

!image-2021-04-08-00-46-08-041.png!

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)