[GitHub] [incubator-doris] kangpinghuang commented on issue #2086: Compressor comparison of segment v1 and segment v2

[GitBox <gi...@apache.org>]

kangpinghuang commented on issue #2086: Compressor comparison of segment v1 and segment v2
URL: https://github.com/apache/incubator-doris/issues/2086#issuecomment-548237258
 
 
   I have analyse the two problems of this test.
   1. char65535 load job is failed. This is becasue there is max_body_size limit for brpc message. The batch sent  between BE for char65535 when loading data is too large which lead to failure when rpc. This can be fixed by limit the batch size under the max_body_size or set brpc_max_body_size to a bigger number in BE.
   2. char10 is too big. The reason is that the dict page's size limit is default to 1M and the dict is too large, DictEncoding automatically switch to BinaryPlainEncoding. BinaryPlainEncoding is less effiecient than V1. I will optimize the PlainEncoding later.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org