You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "mneedham (via GitHub)" <gi...@apache.org> on 2023/02/13 09:49:55 UTC
[GitHub] [pinot] mneedham opened a new pull request, #10272: Fix bug with time based segment relocator where it would try to move …
mneedham opened a new pull request, #10272:
URL: https://github.com/apache/pinot/pull/10272
In 0.12 the segment relocator tries to move consuming segments, resulting in the following error:
```
pinot-controller-multidir-blog | 2023/02/13 09:48:27.735 ERROR [SegmentRelocator] [async-task-thread-75] Caught exception/error while rebalancing table: events_REALTIME
pinot-controller-multidir-blog | java.lang.IllegalStateException: Invalid endTimeMs: -1 for segment: events__0__31__20230213T0943Z of table: events_REALTIME
pinot-controller-multidir-blog | at org.apache.pinot.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:738) ~[pinot-all-0.12.0-jar-with-dependencies.jar:0.12.0-118f5e065cb258c171d97a586183759fbc61e2bf]
pinot-controller-multidir-blog | at org.apache.pinot.common.tier.TimeBasedTierSegmentSelector.selectSegment(TimeBasedTierSegmentSelector.java:63) ~[pinot-all-0.12.0-jar-with-dependencies.jar:0.12.0-118f5e065cb258c171d97a586183759fbc61e2bf]
pinot-controller-multidir-blog | at org.apache.pinot.controller.helix.core.relocation.SegmentRelocator.updateSegmentTargetTier(SegmentRelocator.java:212) ~[pinot-all-0.12.0-jar-with-dependencies.jar:0.12.0-118f5e065cb258c171d97a586183759fbc61e2bf]
pinot-controller-multidir-blog | at org.apache.pinot.controller.helix.core.relocation.SegmentRelocator.updateTargetTier(SegmentRelocator.java:173) ~[pinot-all-0.12.0-jar-with-dependencies.jar:0.12.0-118f5e065cb258c171d97a586183759fbc61e2bf]
pinot-controller-multidir-blog | at org.apache.pinot.controller.helix.core.relocation.SegmentRelocator.lambda$processTable$0(SegmentRelocator.java:134) ~[pinot-all-0.12.0-jar-with-dependencies.jar:0.12.0-118f5e065cb258c171d97a586183759fbc61e2bf]
pinot-controller-multidir-blog | at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
pinot-controller-multidir-blog | at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
pinot-controller-multidir-blog | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
pinot-controller-multidir-blog | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
pinot-controller-multidir-blog | at java.lang.Thread.run(Thread.java:829) [?:?]
```
And also aborting the segment relocator job.
This PR fixes that bug.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang merged pull request #10272: Bug with time based segment relocator on real-time segments
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang merged PR #10272:
URL: https://github.com/apache/pinot/pull/10272
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org