Apache Pinot Daily Email Digest (2020-07-25)

[Pinot Slack Email Digest <sn...@apache.org>]

<h3><u>#general</u></h3><br><strong>@anand.shyamkumar: </strong>@anand.shyamkumar has joined the channel<br><h3><u>#random</u></h3><br><strong>@anand.shyamkumar: </strong>@anand.shyamkumar has joined the channel<br><h3><u>#troubleshooting</u></h3><br><strong>@pradeepgv42: </strong>@kharekartik or anyoneelse take a look at this MR when you get a chance?
<https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMSfW2QiSG4bkQpnpkSL7FiK3MHb8libOHmhAW89nP5XKW24q3rQO41-2BW-2BTqWKCybLQ-3D-3Dfl5x_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTyfAhvaCc5Wn61TxfVSctIyJUygcnoIA81s2Q6IWrJgcJCZ0roehdSw1Xs6oCwQuRcHDqtEiNIGMvlRhtuYoWOfaJS2bIt-2BcULyPIX6uBfKJkyh9RhNXJxnYGsQeSM4ruWSfjcb07YAxLflfyD-2BTtun9T-2Fh2tXIw1pcxCYOXIzr1nnFHMUiGIUJCgviiaTPwrE-3D>
(Adding default credentials provider, uses common credential provider chain and a bug fix)<br><strong>@elon.azoulay: </strong>We upgraded to pinot-0.4.0 and one of the tables is not ingesting. The external view shows the bad segments and we see error messages like this:
```2020/07/23 22:02:12.981 ERROR [LLRealtimeSegmentDataManager_oas_integration_operation_event__2__1309__20200723T2158Z] [oas_integration_operation_event__2__1309__20200723T2158Z] Holding after response from Controller: {"buildTimeSec":-1,"isSplitCommitType":false,"status":"NOT_SENT","offset":-1}```<br><strong>@elon.azoulay: </strong>and
```ERROR [ServerSegmentCompletionProtocolHandler] [oas_integration_operation_event__1__1309__20200723T2200Z] Could not send request <https://u17000708.ct.sendgrid.net/ls/click?upn=iSrCRfgZvz-2BV64a3Rv7HYatTHeqKcLaMSt8ep4ihF7S15aoAmeINWhSdVw7SqjxLJ5bSuxMRVwXQ90C1iJwu69CzSqKcq8-2Fnsk1g8w8enrEoCPX7ZdpVn2zSSAD6T1iLbV3ictGAilMlhqFKdZgMf6-2BabJjdjFjr3aNDF2TRI4EWSxaUyRJd69j-2FVyINS3PRvBUZsMSOcNuYnI3XfznwE8qcNrppjWq6NJ2DqOulSiyrqf7f9UbtVS-2BJTx9WQaC3AKXrt5ZEBNc40mpHQ9ixYUNv7E3fcwR-2F30bL7-2BLq9geSAkiXzMiZwgRfAEC2QIS-2FqatM3Hap-2BSBM3QKcYhXBRyyiGMEPsNDgco5vaXYYNou21nQJoaxCE7MjxDeoMnwKC5nWWUPrD1O2kgpOOuNkXBahebWoVJeqp2JzS9zrVNM-3DlH5u_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTyfAhvaCc5Wn61TxfVSctIyRXkM0wY7YKCjEZIcxrRfC9FRVkkfoCqszzudFuhykQWZDaNBuC4H2PGoYScNlCCwCUiTR2tyyTkNSWgAbB8JdYM9UmAV7aTBi8pJIin-2F1SQioq38XgNgOV-2BzVRTlZPQ2dZ2xdqn-2BVcNPl-2Fy-2BkwxBK1eOS3s2hwGa96YdxHIPTds-3D>
" ```<br><strong>@elon.azoulay: </strong>Now when I send the same request I get the following message:<br><strong>@elon.azoulay: </strong>```{"status":"FAILED","isSplitCommitType":false,"streamPartitionMsgOffset":null,"buildTimeSec":-1,"offset":-1}```<br><strong>@elon.azoulay: </strong>Is there a way we can delete the realtime segments that show up in error state in the external view and get them to be reingested?<br><strong>@g.kishore: </strong>there is a validation manager that will fix stuck segments<br><strong>@fx19880617: </strong>segment deletion api should work for deleting the current consuming segment <br><strong>@fx19880617: </strong>Controller should fix this<br><strong>@elon.azoulay: </strong>Thanks! So I just delete those segments?<br><strong>@fx19880617: </strong>do you get any meaningful log from the controller-1?<br><strong>@fx19880617: </strong>Yes, you can just delete those<br><strong>@fx19880617: </strong>so all the consuming segments are stopped?<br><strong>@singalravi: </strong>we are running pinot on a kubernetes cluster. the pinot server pods takes a lot of time to come up during rolling restart. each pod is taking around 4-5 minutes. Is this time proportional to number of segments in the server? How can I reduce the startup time of the servers?<br><strong>@pradeepgv42: </strong>Hi, I am trying to use `KafkaConfluentSchemaRegistryAvroMessageDecoder`
We have a schema registry set up with SSL authentication.  I am getting `SSLHandshakeException`
Wondering what is the proper way to pass the SSL certs config for the schema registry client?

I digged a bit into the code, it seems like pinot needs to update the schema-registry-client
to include this (<https://u17000708.ct.sendgrid.net/ls/click?upn=1BiFF0-2FtVRazUn1cLzaiMfClwcXpa5UD7WHoPo9iErwoXMxKcgld3Jd5Cqi7KDBe7Sj-2FMuOszoHsfpaJMWd8N7PDSCBEqgsAidT8pYa4oKY-3DXbx1_vGLQYiKGfBLXsUt3KGBrxeq6BCTMpPOLROqAvDqBeTyfAhvaCc5Wn61TxfVSctIyDok1C-2Fl7PlOmRLuos3xc4NhnNTrTEeXOWgWQH3Dkw3KXiG262Jm2eWPTJ0szZCvuTBUYyHhGCBwyXrS8lcPEPDM29ZlAvx9g-2FmVPx5uHDrE2rxO-2BM6TlN5DOgRk21kKJOO170cuyMvCK8zDTGMx9eg8PiraWCgoOPQ47suCxUdU-3D>)
with some code changes. Can be accomplished without it too.

Wanted to check before if there is an alternative way to accomplish this?<br><strong>@g.kishore: </strong>@elon.azoulay can probably help you on this.<br>