Apache Pinot Daily Email Digest (2020-09-28)

[Pinot Slack Email Digest <sn...@apache.org>]

<h3><u>#general</u></h3><br><strong>@adrian.f.cole: </strong>can I talk about slow startup? :smile:<br><strong>@mongche.lee: </strong>@mongche.lee has joined the channel<br><strong>@hunterelbourn: </strong>@hunterelbourn has joined the channel<br><strong>@hunterelbourn: </strong>Howdy! Apologies if anyone has asked this before, but we’ve been using Pinot for a little bit at our org and we are now talking a little bit about multi-regional availability for our Pinot setup (satisfying queries in other regions mainly) and was curious if anyone here has put some thought or setup into how to run a Pinot cluster in multiple regions (even if it’s a duplicate cluster in another region ingesting replicated source or something along those lines). Thanks!<br><h3><u>#random</u></h3><br><strong>@mongche.lee: </strong>@mongche.lee has joined the channel<br><strong>@hunterelbourn: </strong>@hunterelbourn has joined the channel<br><h3><u>#roadmap</u></h3><br><strong>@aorashi: </strong>@aorashi has joined the channel<br><h3><u>#multi-region-setup</u></h3><br><strong>@g.kishore: </strong>@g.kishore has joined the channel<br><strong>@hunterelbourn: </strong>@hunterelbourn has joined the channel<br><strong>@hunterelbourn: </strong>Hiya! curious what your thoughts are around a multi-regional setup for pinot might look, @g.kishore. Our org has been toying with the idea of doing multiple clusters in multiple regions, and replicating our source of truth for updates (kafka) to each respective region. So, eventual consistency across regions, but seems a little heavy, but might just be how it is. Curious if there is another way y’all have seen this accomplished<br><strong>@g.kishore: </strong>Is this real-time use case only or hybrid<br><strong>@g.kishore: </strong>Or batch <br><strong>@g.kishore: </strong>Can you draw rough diagram of your setup?<br><strong>@hunterelbourn: </strong>for this particular use-case, real-time, but I can see us wanting hybrid within 6 months<br><strong>@g.kishore: </strong>Got it <br><strong>@hunterelbourn: </strong>yeah, of course. Will get back to you later with a diagram<br><strong>@g.kishore: </strong>Ok. I will also draw a diagram on multi region setup for each mode <br><strong>@hunterelbourn: </strong>that would be excellent! much appreciated<br><strong>@g.kishore: </strong>:+1:<br><strong>@mailtobuchi: </strong>@mailtobuchi has joined the channel<br>