[GitHub] [iceberg] xhtnb opened a new issue #3538: Hadoop catalog can't consume kafka data on iceberg

[GitBox <gi...@apache.org>]

xhtnb opened a new issue #3538:
URL: https://github.com/apache/iceberg/issues/3538


   CREATE CATALOG hive_catalog_11 WITH (
   'type'='iceberg',
   'catalog-type'='hadoop',
   'uri'='thrift://cdh-1:9083',
   'warehouse'='hdfs://cdh-1/user/hive/warehouse',
   'clients'='5',
   'property-version'='1'
   );
   
   use catalog hive_catalog_11;
   create database iceberg_db_11;
   use iceberg_db_11;
   
   CREATE TABLE  hive_catalog_11.iceberg_db_11.iceberg01 ( 
   user_id STRING COMMENT 'user_id', 
   order_amount DOUBLE COMMENT 'order_amount'
   );
   
   kafka-console-producer.sh --broker-list cdh-1:9092 --topic xht_test
   {"user_id":"a1","order_amount":1.0}
   {"user_id":"a2","order_amount":2.0}
   {"user_id":"a3","order_amount":3.0}
   {"user_id":"a4","order_amount":4.0}
   {"user_id":"a5","order_amount":5.0}
   {"user_id":"a6","order_amount":6.0}
   
   
   CREATE CATALOG myhive_11 WITH (
   'type'='iceberg',
   'catalog-type'='hadoop',
   'uri'='thrift://cdh-1:9083',
   'warehouse'='hdfs://cdh-1/user/hive/warehouse',
   'clients'='5',
   'property-version'='1'
   );
   
   use catalog myhive_11;
   create database mydatabase_11;
   use mydatabase_11;
   
   CREATE TABLE myhive_11.mydatabase_11.kafkaSource32 (
       user_id STRING, 
   	order_amount DOUBLE
   ) WITH (
       'connector.type' = 'kafka', 
       'connector.version' = 'universal', 
       'connector.topic' = 'xht_test', 
       'connector.properties.group.id' = 'flink_im02_new',
       'connector.startup-mode' = 'latest-offset', 
       'connector.properties.zookeeper.connect' = 'cdh-1:2181',
       'connector.properties.bootstrap.servers' = 'cdh-1:9092',    
       'format.type' = 'json'
   );
   
   insert into hive_catalog_11.iceberg_db_11.iceberg01 select * from kafkaSource32;
   select * from hive_catalog_11.iceberg_db_11.iceberg01;
   
   Data can be read on the kafka table normally ,but can't read on iceberg table


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] xhtnb closed issue #3538: qqw

[GitBox <gi...@apache.org>]

xhtnb closed issue #3538:
URL: https://github.com/apache/iceberg/issues/3538


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org