[GitHub] [pinot] dongxiaoman commented on issue #7704: Error with Data size larger than 1M, will not write to zk. Data (first 1k)

[GitBox <gi...@apache.org>]

dongxiaoman commented on issue #7704:
URL: https://github.com/apache/pinot/issues/7704#issuecomment-962081829


   I just realized that it is probably because I have 192 partitions and `"replication": "2"` setting, while I have only 4 hosts to process them. I believe the real time servers is trying to go online for all the 192*2/4 segments at the same time (in one message) which generates a very large JSON file that exceeds the 1MB size.
   Right now if I add more hosts it should solve the problem for me.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org