You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/04/16 22:27:46 UTC
[GitHub] [incubator-pinot] npawar opened a new issue #5263: Run the
RealtimeSegmentvalidationManager on demand
npawar opened a new issue #5263: Run the RealtimeSegmentvalidationManager on demand
URL: https://github.com/apache/incubator-pinot/issues/5263
When realtime consumption goes into some erroneous state, we rely on the RealtimeSegmentValidationManager to fix it. This by default runs at an hourly frequency.
There have been frequent asks for being able to run it on demand, in order to fix problems faster if they've been spotted.
@kishoreg @mcvsubbu
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] mcvsubbu commented on issue #5263: Run the
RealtimeSegmentvalidationManager on demand
Posted by GitBox <gi...@apache.org>.
mcvsubbu commented on issue #5263: Run the RealtimeSegmentvalidationManager on demand
URL: https://github.com/apache/incubator-pinot/issues/5263#issuecomment-614946478
Once a pinot cluster is up and running in production, we really do NOT want to do these runs manually triggered. There are race conditions that can happen if these are run together or within a short period of interval (we only fix segments if they are in the state for a long time).
For someone just starting out to experiment with a table, it should be simple to just drop the table and re-create it, right?
Or, am I missing something here?
We can provide a command-line based fixer (with a note that you run it at your own risk if your table is in production), maybe.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] kishoreg commented on issue #5263: Run the RealtimeSegmentvalidationManager on demand
Posted by GitBox <gi...@apache.org>.
kishoreg commented on issue #5263:
URL: https://github.com/apache/incubator-pinot/issues/5263#issuecomment-628456216
This has been requested too many times - what are the scenarios a segment will get into error state or stop consumption and what does the validation manager do internally?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] mcvsubbu commented on issue #5263: Run the RealtimeSegmentvalidationManager on demand
Posted by GitBox <gi...@apache.org>.
mcvsubbu commented on issue #5263:
URL: https://github.com/apache/incubator-pinot/issues/5263#issuecomment-628728532
https://cwiki.apache.org/confluence/display/PINOT/Consuming+and+Indexing+rows+in+Realtime#ConsumingandIndexingrowsinRealtime-Self-healingconsumption
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] npawar commented on issue #5263: Run the RealtimeSegmentvalidationManager on demand
Posted by GitBox <gi...@apache.org>.
npawar commented on issue #5263:
URL: https://github.com/apache/incubator-pinot/issues/5263#issuecomment-827928129
Closing this issue, as this is a subset of https://github.com/apache/incubator-pinot/issues/6812. Looks like there is agreement to add this feature on 6812, so we don't need to continue this old thread anymore.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] npawar closed issue #5263: Run the RealtimeSegmentvalidationManager on demand
Posted by GitBox <gi...@apache.org>.
npawar closed issue #5263:
URL: https://github.com/apache/incubator-pinot/issues/5263
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org