You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/02/11 21:37:25 UTC

[GitHub] [hudi] jiangok2006 commented on issue #2537: [SUPPORT] delta streamer sql transformer does not work for my kafka data

jiangok2006 commented on issue #2537:
URL: https://github.com/apache/hudi/issues/2537#issuecomment-777808336


   @nsivabalan It is not about the sql statement I think. If I use a simpler dataframe, sql transformer works fine with my or Sudha's sql query. But my kafka data seems to cause deSer issue for sql transformer. I admit that my kafka data is special because each of them is big and has complex data type (e.g. logical type). Flink 1.11 cannot handle it after two bugs are fixed in Flink 1.12.
   https://issues.apache.org/jira/browse/FLINK-19491
   https://issues.apache.org/jira/browse/FLINK-19339
   
   I guess the easier way is to provide sample avro from my kafka for trouble shooting. If so, I may need to work with my team for exposing sample data. Thought?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org