You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "jadami10 (via GitHub)" <gi...@apache.org> on 2023/09/07 02:10:30 UTC
[GitHub] [pinot] jadami10 opened a new issue, #11533: Increase in ingestion lag when servers are shutting down
jadami10 opened a new issue, #11533:
URL: https://github.com/apache/pinot/issues/11533
The initial conversation happened in https://github.com/apache/pinot/pull/9994#discussion_r1312419841.
The ingestion lag metric continues to tick up while the consuming thread is shutdown. This makes using this metric to track/alert on ingestion lag more difficult as these servers aren't actually serving queries at this time.
I've tried a few fixes on a QA cluster without success:
- move `_ingestionDelayTracker.shutdown()` to before segments are destroyed
- stop reporting the metric when `_isServerReadyToServeQueries` goes from true -> false
Neither of those worked, and I kept seeing the lag. But I think it's mostly because I'm still not shutting the ingestion tracker down at the right spot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] jadami10 closed issue #11533: Increase in ingestion lag when servers are shutting down
Posted by "jadami10 (via GitHub)" <gi...@apache.org>.
jadami10 closed issue #11533: Increase in ingestion lag when servers are shutting down
URL: https://github.com/apache/pinot/issues/11533
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org