You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/05/09 10:13:41 UTC

[GitHub] [incubator-doris] ZhangHuirui opened a new issue #3543: Doris ROUTINE LOAD使用kafka做数据源,导入是否保证分区有序?

ZhangHuirui opened a new issue #3543:
URL: https://github.com/apache/incubator-doris/issues/3543


   **场景:**
   
   - kafka中的数据(单个分区):
   
   `user_id = 1, user_name = zhangsan, user_status = 0
   user_id = 1, user_name = zhangsan, user_status = 2
   user_id = 1, user_name = zhangsan_bak, user_status = 2`
   
   - Doris表结构:
   
   `
   CREATE TABLE `user_info` (
                           `user_id` bigint(20) NULL COMMENT "",
                           `user_name` varchar(200) REPLACE NULL COMMENT "",
                           `user_status` bigint(20) REPLACE NULL COMMENT ""
   ) ENGINE=OLAP
       AGGREGATE KEY(`user_id`)
   COMMENT "OLAP"
   DISTRIBUTED BY HASH(`user_id`) BUCKETS 128
   PROPERTIES (
   "storage_type" = "COLUMN"
   );`
   
   - 问题
   
   使用Doris ROUTINE LOAD导入保证顺序吗?结果是`user_id = 1, user_name = zhangsan_bak, user_status = 2`吗?还是不一定?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] imay commented on issue #3543: Doris ROUTINE LOAD使用kafka做数据源,导入是否保证分区有序?

Posted by GitBox <gi...@apache.org>.
imay commented on issue #3543:
URL: https://github.com/apache/incubator-doris/issues/3543#issuecomment-626186358


   If these rows are in the same kafka partition, the order may be kept.
   If they are in different partitions, the order can not be kept


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] ZhangHuirui commented on issue #3543: Doris ROUTINE LOAD使用kafka做数据源,导入是否保证分区有序?

Posted by GitBox <gi...@apache.org>.
ZhangHuirui commented on issue #3543:
URL: https://github.com/apache/incubator-doris/issues/3543#issuecomment-630713658


   I see. Ordered Message is Not Supported?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org