You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/12/16 10:16:01 UTC

[GitHub] [iceberg] thirdparty-core opened a new issue #1940: Hadoop catalog can't consume kafka data on iceberg 0.10.0 ,flink 1.11.2

thirdparty-core opened a new issue #1940:
URL: https://github.com/apache/iceberg/issues/1940


   Hi!
   I use iceberg-flink to consume kafka data like http://iceberg.apache.org/flink/,
   but it can't normal consumption without any exceptions.
   
   code:
   ```
   CREATE CATALOG hadoop_catalog WITH (
     'type'='iceberg',
     'catalog-type'='hadoop',
     'warehouse'='hdfs://hostname:8020/data-lake/iceberg',
     'property-version'='1'
   );
   
   use catalog hadoop_catalog;
   
   CREATE DATABASE iceberg_db;
   
   use iceberg_db;
   
   create table kafka_order(
   order_id string,
   order_price decimal(10,2),
   order_time timestamp(3)
   )
   with(
   'connector' = 'kafka',
   'topic' = 'iceberg.order',
   'properties.bootstrap.servers' = 'hostname:9092',
   'format' = 'json',
   'properties.group.id' = 'data-lake',
   'scan.startup.mode' = 'earliest-offset',
   'json.ignore-parse-errors' = 'false'
   );
   
   create table ice_t_order(
   order_id string,
   order_price decimal(10,2),
   order_time timestamp(3)
   );
   
   insert into ice_t_order
   select * from kafka_order;
   ```
   
   my iceberg version is 0.10.0,flink version is 1.11.2
   
   where i am wrong?
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] thirdparty-core commented on issue #1940: Hadoop catalog can't consume kafka data on iceberg 0.10.0 ,flink 1.11.2

Posted by GitBox <gi...@apache.org>.
thirdparty-core commented on issue #1940:
URL: https://github.com/apache/iceberg/issues/1940#issuecomment-747169900


   According to your tips, it's working. 
   Thank you very much.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] zhangjun0x01 edited a comment on issue #1940: Hadoop catalog can't consume kafka data on iceberg 0.10.0 ,flink 1.11.2

Posted by GitBox <gi...@apache.org>.
zhangjun0x01 edited a comment on issue #1940:
URL: https://github.com/apache/iceberg/issues/1940#issuecomment-747142066


   do not create the kafka table on iceberg catalog , on the default catalog


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] thirdparty-core closed issue #1940: Hadoop catalog can't consume kafka data on iceberg 0.10.0 ,flink 1.11.2

Posted by GitBox <gi...@apache.org>.
thirdparty-core closed issue #1940:
URL: https://github.com/apache/iceberg/issues/1940


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] zhangjun0x01 commented on issue #1940: Hadoop catalog can't consume kafka data on iceberg 0.10.0 ,flink 1.11.2

Posted by GitBox <gi...@apache.org>.
zhangjun0x01 commented on issue #1940:
URL: https://github.com/apache/iceberg/issues/1940#issuecomment-747142066


   donot create the kafka table on iceberg catalog , on the default catalog


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org