You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/11/03 20:01:49 UTC

[GitHub] [hudi] awsalialem commented on issue #3707: [SUPPORT] Flink Hudi write on S3 DataStreamSinkProvider error

awsalialem commented on issue #3707:
URL: https://github.com/apache/hudi/issues/3707#issuecomment-959920794


   Thank you for you attention to this issue. It seems that AWS Kinesis Data Analytics Studio (KDA) now supports both flink versions (1.11 and 1.13). 
   I created two applications with either versions. I used Hudi 0.9.0 with flink 1.11 and Hudi 0.10.0-SNAPSHOT (master branch) with flink 1.13. 
   
   With Hudi 0.9.0 and flink 1.11 I get the above mentioned error.
   With Hudi 0.10.0-SNAPSHOT and Flink 1.13 I get a different error when trying to read a Hudi table. 
   ```
   Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
   	at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:471)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
   	at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64)
   	at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65)
   	at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
   	... 36 more
   ```
   Any dependency am I missing when building the flink bundle? Any help would be appreciated.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org