You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "minwoo-jung (via GitHub)" <gi...@apache.org> on 2024/01/08 06:17:46 UTC
[I] I'm curious about the sequence for a graceful shutdown between the overall components of PINOT. [pinot]
minwoo-jung opened a new issue, #12234:
URL: https://github.com/apache/pinot/issues/12234
hello
We are deploying/operating pinot through helm chart.
# Problem
We restarted helm chart to upgrade pinot,
After restarting, some consuming segments of the realtime table were not consuming.
So I used the pause/resume api to solve the problem.
I am experiencing a similar problem sometimes when restarting pinot.
I would like to know how to prevent the problem from recurring.
**question 1**
When we restart pinot, we restart the whole pinot with helm uninstall command.
Is there a startup or shutdown order for each PINOT component when restarting?
**In other words, I'm curious about the sequence for a graceful shutdown between the overall components of PINOT.**
**qeustion 2**
Is there anything else I need to do on restart to avoid the above issue?
If so, I'd be curious to know.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] I'm curious about the sequence for a graceful shutdown between the overall components of PINOT. [pinot]
Posted by "walterddr (via GitHub)" <gi...@apache.org>.
walterddr commented on issue #12234:
URL: https://github.com/apache/pinot/issues/12234#issuecomment-1889585178
for q&a's we generally encourage to ask in the slack channel https://github.com/apache/pinot?tab=readme-ov-file#join-the-community
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] I'm curious about the sequence for a graceful shutdown between the overall components of PINOT. [pinot]
Posted by "minwoo-jung (via GitHub)" <gi...@apache.org>.
minwoo-jung commented on issue #12234:
URL: https://github.com/apache/pinot/issues/12234#issuecomment-1888356575
@walterddr
Thank you for your response.
Are you a core developer of pinot?
**I would like to ask a question to the core developers, in what cases consuming may not work properly when restarting.**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] I'm curious about the sequence for a graceful shutdown between the overall components of PINOT. [pinot]
Posted by "minwoo-jung (via GitHub)" <gi...@apache.org>.
minwoo-jung commented on issue #12234:
URL: https://github.com/apache/pinot/issues/12234#issuecomment-1886229208
@walterddr
Thank you for your response.
When running a service that is composed of multiple components, we have found that the order of shutdown is very important.
**When shutting down,
would it be correct to shut down in the order server -> broker -> controller as opposed to the order at startup?**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] I'm curious about the sequence for a graceful shutdown between the overall components of PINOT. [pinot]
Posted by "walterddr (via GitHub)" <gi...@apache.org>.
walterddr closed issue #12234: I'm curious about the sequence for a graceful shutdown between the overall components of PINOT.
URL: https://github.com/apache/pinot/issues/12234
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] I'm curious about the sequence for a graceful shutdown between the overall components of PINOT. [pinot]
Posted by "walterddr (via GitHub)" <gi...@apache.org>.
walterddr commented on issue #12234:
URL: https://github.com/apache/pinot/issues/12234#issuecomment-1887773774
AFAIK there's no shutdown ordering required. but i would recommend shutting down controller last b/c that's the metadata manager, if you shut it down earlier than servers. it is likely you will have to rewind your streaming ingestion to when the controller shutdown and restart from there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] I'm curious about the sequence for a graceful shutdown between the overall components of PINOT. [pinot]
Posted by "walterddr (via GitHub)" <gi...@apache.org>.
walterddr commented on issue #12234:
URL: https://github.com/apache/pinot/issues/12234#issuecomment-1885171554
you can checkout the operational documents in https://docs.pinot.apache.org/operators/operating-pinot/setup-cluster
generally speaking you should ensure the ordering is controller/broker/server on start
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org