Apache Pinot Daily Email Digest (2021-05-17)

[Pinot Slack Email Digest <sn...@apache.org>]

### _#general_

  
 **@mohitdubey95:** HI, Is the cloud pubsub driver available with apache
pinot?  
**@g.kishore:** Not as of now.  
**@mohitdubey95:** Any plans for supporting that in future?  
**@g.kishore:** yes, if there is enough interest, it should be possible. we
recently added Kinesis  
 **@patidar.rahul8392:** Can anyone explain me what is the issue here.i have
started Pinot controller broker and server.since last 2 weeks it is working
fine but today suddenly that UI part is not loading.  
**@aiyer:** did you try to load in incognito ? I had a similar issue .  
**@patidar.rahul8392:** Yes tried.but same issue  
**@aiyer:** hmm.. ok.. i will let the experts reply then
:slightly_smiling_face:  
**@mayanks:** Is the controller up and running?  
**@patidar.rahul8392:** Yes up and running  
**@dlavoie:** the console is trying to reach the 8008 port. checkout out
<#C011C9JHN7R|troubleshooting>  
**@dlavoie:** Wondering if that is not a bug present on the 0.7.0 release.  
 **@patidar.rahul8392:** I have attached the video also.its not stable loading
for milliseconds and then again showing blank  
**@mayanks:** I don’t see the video file, it was deleted  
**@patidar.rahul8392:** Attached again  
 **@patidar.rahul8392:**  
 **@mayanks:** Hmm, can you file an issue? Also check if restarting helps  
**@patidar.rahul8392:** Restarted everything , and tried but still no luck  
 **@mohamedkashifuddin:** @mohamedkashifuddin has joined the channel  
 **@patidar.rahul8392:** Is there any other way to update this server instance
so it can reach port 8098 instead of 8008?  
 **@prince2015999:** @prince2015999 has joined the channel  
 **@hrsripad:** @hrsripad has joined the channel  
 **@btripathy:** Hello everyone... We are new to Pinot and exploring the OLAP
possibilities. We want to increase the performance of some of our dashboard
queries running on Presto involving typical joins ,aggregations and filters.
We already have dimensions and Facts on S3/Presto and use spark to populate
those. Is it worth to pre compute in 1 more layer and push it to Pinot for
slice and dice only with fat table structure or use Presto to join the Pinot
offline tables. How you guys have solved the problem.Any pointers is
appreciated.  
 **@mayanks:** We have seen both models in deployment. It depends on your use
case. If you are going to just server dashboards and are ok with sub-second
latencies, Pinot+Presto might work (note that complex joins/nested queries may
make the latency higher than expected). If you are looking for high-throughput
at low latency, perhaps using Pinot would be better option.  
**@btripathy:** Thanks  
 **@machhindra.nale:** @machhindra.nale has joined the channel  
 **@zlchen.ken:** @zlchen.ken has joined the channel  
 **@cyril:** @cyril has joined the channel  

###  _#random_

  
 **@mohamedkashifuddin:** @mohamedkashifuddin has joined the channel  
 **@prince2015999:** @prince2015999 has joined the channel  
 **@hrsripad:** @hrsripad has joined the channel  
 **@machhindra.nale:** @machhindra.nale has joined the channel  
 **@zlchen.ken:** @zlchen.ken has joined the channel  
 **@cyril:** @cyril has joined the channel  

###  _#troubleshooting_

  
 **@patidar.rahul8392:** Someone kindly help here. "PINOT UI LOADING FOR A
SECOND AND THEN SHOWING BLANK PAGE" Hi starting pinot in cluster mode and
started controller , server and broker. Since last 2 weeks it is working fine
but today suddenly I am facing this issue.UI is not loading properly it's
coming for a second and showing blank. I tried in all the browsers, cleared
cache and cookies tried in different laptop but still the issue is same.
Kindly suggest.  
 **@dlavoie:** What does the browser dev console has to say? Any error?  
 **@patidar.rahul8392:** No error let me attach the short video  
 **@patidar.rahul8392:**  
 **@dlavoie:** There is no output in the dev console?  
 **@patidar.rahul8392:** No  
 **@dlavoie:** To be sure we are on the same page I’m talking of this:  
 **@patidar.rahul8392:** Actually on UI server tab I changed server one of the
server host from 8089 to 8008 and now in dev console it's showing same as not
found but after that I cleared everything and updated again stated controller
server and broker but not sure why it's still looking for same url  
 **@dlavoie:** Can you show a complete screenshot of the first error? It’s
cropped  
 **@dlavoie:** Which revision of pinot are you running?  
 **@patidar.rahul8392:** 0.7  
 **@dlavoie:** Have you tried running the latest version of pinot?  
 **@patidar.rahul8392:** No, I have done all the setups with this 0.7 so using
this for now  
 **@patidar.rahul8392:** This is the latest one right? 0.7.1 I am using this
only  
 **@dlavoie:** I would suggest upgrading to 0.7.1 first. I’m not sure but I
think there was a bug in 0.7.0 that justified releasing 0.7.1 right after.  
 **@dlavoie:** Might not be related but that’s going to be a better place to
start with  
 **@patidar.rahul8392:** Yes I am using 0.7.1  
 **@mohamedkashifuddin:** @mohamedkashifuddin has joined the channel  
 **@prince2015999:** @prince2015999 has joined the channel  
 **@hrsripad:** @hrsripad has joined the channel  
 **@patidar.rahul8392:** @npawar @slack1 @tingchen kindly suggest for one of
the instance it's taking 8008 port is there any way to fixed it. I have
checked configuration files.but couldn't find to update this
pinot.server.netty.port value as 8098. I am not able to understand from where
for one of the instance this is taking value as 8008 instead of 8098. I have
restarted everything but still it's taking this value.  
**@patidar.rahul8392:** Server_hostname_8008 4th line  
**@dlavoie:** Is it possible that at some point you had a server runing with
8008? If that server is still registered in Helix you might have to manually
clean it in Zookeeper.  
**@patidar.rahul8392:** Yes earlier it for one of the server manulaay I
changed it to 8008 .but after that I restarted everything.  
**@dlavoie:** Can you trash everything and restart? Including your data dirs.  
**@dlavoie:** Otherwise you can clean the instance in zookeeper  
 **@machhindra.nale:** @machhindra.nale has joined the channel  
 **@zlchen.ken:** @zlchen.ken has joined the channel  
 **@cyril:** @cyril has joined the channel  

###  _#pinot-dev_

  
 **@khushbu.agarwal:** Hi, My use case is to query pinot, and data fetched
should be stored in S3 in CSV format. Is there any support which pinot
provides to store query result in S3?  
**@fx19880617:** You can follow this doc:  to setup pinot and ingest data from
s3 to pinot  

###  _#getting-started_

  
 **@prince2015999:** @prince2015999 has joined the channel  
\--------------------------------------------------------------------- To
unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org For additional commands,
e-mail: dev-help@pinot.apache.org