You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pinot.apache.org by Pinot Slack Email Digest <sn...@apache.org> on 2021/05/30 02:00:17 UTC

Apache Pinot Daily Email Digest (2021-05-29)

### _#general_

  
 **@anirudhananda:** @anirudhananda has joined the channel  
 **@kewei.shang:** @kewei.shang has joined the channel  

###  _#random_

  
 **@anirudhananda:** @anirudhananda has joined the channel  
 **@kewei.shang:** @kewei.shang has joined the channel  

###  _#troubleshooting_

  
 **@anirudhananda:** @anirudhananda has joined the channel  
 **@kewei.shang:** @kewei.shang has joined the channel  

###  _#minion-improvements_

  
 **@laxman:** Trying to recollect all the observations and notes I made while
moving this to production. So, will keep adding them here in this thread. •
Decouple the tasks for the tables: Right now controller schedules conversion
tasks of tables as a single table. If one table conversion is slow, then other
tables conversion tasks will not be scheduled till slowest one gets completed.
Instead, we can schedule individual task for each table. In our case, 5 out of
7 tables are taking under 10 minutes to convert each bucket. But the other 2
takes nearly an hour. Because of coupling all tables, other tables conversion
is not able to proceed till the slowest ones gets completed. • Workflow status
is SUCCEEDED even when one of the sub task fails or times out..  
\--------------------------------------------------------------------- To
unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org For additional commands,
e-mail: dev-help@pinot.apache.org