You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/09/01 18:09:55 UTC
[GitHub] [incubator-pinot] dongxiaoman edited a comment on issue #5955: Kafka ingestion by plugin not picking up latest messages with auto.offset.reset=smallest
dongxiaoman edited a comment on issue #5955:
URL: https://github.com/apache/incubator-pinot/issues/5955#issuecomment-685040939
Error Log when set property to `latest`: (sorry for the bad format)
```
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853256] 2020/09/01 17:09:46.852 ERROR [PinotTableRestletResource] [grizzly-http-server-5] Failed to fetch the offset for topic: ledger.v2, partition: 0 with criteria: OffsetCriteria{_off$
etType=CUSTOM, _offsetString='latest'}
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853299] java.lang.IllegalStateException: Failed to fetch the offset for topic: ledger.v2, partition: 0 with criteria: OffsetCriteria{_offsetType=CUSTOM, _offsetString='latest'}
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853351] at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getPartitionOffset(PinotLLCRealtimeSegmentManager.java:612) ~[pinot-all-0.5.0-2020-08-13-$
NAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853392] at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setupNewPartition(PinotLLCRealtimeSegmentManager.java:1012) ~[pinot-all-0.5.0-2020-08-13-$
NAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853430] at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:226) ~[pinot-all-0.5.0-2020-08-13-SNAPS$
OT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853479] at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-2020-08-13$
SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853516] at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1284) ~[pinot-all-0.5.0-2020-08-13-SNAPSHOT$
jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853552] at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1139) ~[pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependenci$
s.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853582] at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:128) ~[pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependenc
ies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853600] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853623] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853644] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853655] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853678] at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-2020-
08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853699] at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) [pinot-all-0.5.0-2020-08-13-SNAPSHOT
-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853751] at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) [pinot-all-0.5.0-2020-08-13-SNAPSHO
T-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853789] at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) [pinot-all-0.5.0
-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853820] at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) [pinot-all-0.5.0-2020-08-13-SNAPSH
OT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853850] at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-
08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853877] at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-0
8-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853897] at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08
-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853929] at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1
a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853950] at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c
76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853970] at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c
76d81d138cac29d0d3d4e
....
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853877] at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-0
8-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853897] at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08
-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853929] at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1
a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853950] at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c
76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853970] at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c
76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.853987] at org.glassfish.jersey.internal.Errors.process(Errors.java:292) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0
c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854011] at org.glassfish.jersey.internal.Errors.process(Errors.java:274) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0
c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854032] at org.glassfish.jersey.internal.Errors.process(Errors.java:244) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0
c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854052] at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAP
SHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854070] at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67e
b1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854088] at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSH
OT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854121] at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0
-2020-08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854141] at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-13-SNAPSHOT-5ac67e
b1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854172] at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-
08-13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854198] at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) [pinot-all-0.5.0-2020-08-13-SNAPSHOT-jar-with-dependencies.jar:0.5.0-2020-08-
13-SNAPSHOT-5ac67eb1a1210cb6c0c76d81d138cac29d0d3d4e]
@^ r=ledger a=unilog-host $@[2020-09-01 17:09:46.854208] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org