You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ZhouKang (Jira)" <ji...@apache.org> on 2020/01/31 03:40:00 UTC
[jira] [Comment Edited] (KYLIN-4363) Query failed with "I failed to
find one of the right cookies" error
[ https://issues.apache.org/jira/browse/KYLIN-4363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17027166#comment-17027166 ]
ZhouKang edited comment on KYLIN-4363 at 1/31/20 3:39 AM:
----------------------------------------------------------
I will revert this commit.
In my test cases, the setting seems worked( did not upgrade coprocessor). Coprocessor's log is
{code:java}
// code placeholder
# kylin.storage.hbase.endpoint-compress-result=TRUE
2020-01-31,10:01:18,005 INFO [RpcServer.default.RWQ.Fifo.read.handler=315,queue=7,port=24600] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: start query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0 in thread RpcServer.default.RWQ.Fifo.read.handler=315,queue=7,port=24600
2020-01-31,10:01:18,015 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTScanRequest: pre aggregating results before returning
2020-01-31,10:01:18,015 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTAggregateScanner: setting IGTBypassChecker of child
2020-01-31,10:01:18,468 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTAggregateScanner: GTAggregateScanner input rows: 399
2020-01-31,10:01:18,639 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTAggregateScanner: closing aggrCache
2020-01-31,10:01:18,639 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Total scanned 399 rows and 150930080 bytes
2020-01-31,10:01:23,903 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Size of final result = 76890905 (82646392 before compressing)
# kylin.storage.hbase.endpoint-compress-result=FALSE
2020-01-31,10:59:54,657 INFO [RpcServer.default.RWQ.Fifo.read.handler=406,queue=6,port=24600] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: start query 3645d35d-cb78-10c4-c327-a04acc9ff2a4 in thread RpcServer.default.RWQ.Fifo.read.handler=406,queue=6,port=24600
2020-01-31,10:59:54,666 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTScanRequest: pre aggregating results before returning
2020-01-31,10:59:54,666 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTAggregateScanner: setting IGTBypassChecker of child
2020-01-31,10:59:58,772 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTAggregateScanner: GTAggregateScanner input rows: 399
2020-01-31,11:00:00,064 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTAggregateScanner: closing aggrCache
2020-01-31,11:00:00,064 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Total scanned 399 rows and 150930080 bytes
2020-01-31,11:00:00,103 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Size of final result = 71950057 (71950057 before compressing){code}
I will test it fully and repair it later.
was (Author: zhoukangcn):
I will revert this commit.
In my test cases, the setting seems worked( have note upgrade coprocessor). Coprocessor's log is
{code:java}
// code placeholder
# kylin.storage.hbase.endpoint-compress-result=TRUE
2020-01-31,10:01:18,005 INFO [RpcServer.default.RWQ.Fifo.read.handler=315,queue=7,port=24600] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: start query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0 in thread RpcServer.default.RWQ.Fifo.read.handler=315,queue=7,port=24600
2020-01-31,10:01:18,015 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTScanRequest: pre aggregating results before returning
2020-01-31,10:01:18,015 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTAggregateScanner: setting IGTBypassChecker of child
2020-01-31,10:01:18,468 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTAggregateScanner: GTAggregateScanner input rows: 399
2020-01-31,10:01:18,639 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.gridtable.GTAggregateScanner: closing aggrCache
2020-01-31,10:01:18,639 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Total scanned 399 rows and 150930080 bytes
2020-01-31,10:01:23,903 INFO [Query 745eb1e9-992e-e4ac-ce15-951ca5b3eae0-401] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Size of final result = 76890905 (82646392 before compressing)
# kylin.storage.hbase.endpoint-compress-result=FALSE
2020-01-31,10:59:54,657 INFO [RpcServer.default.RWQ.Fifo.read.handler=406,queue=6,port=24600] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: start query 3645d35d-cb78-10c4-c327-a04acc9ff2a4 in thread RpcServer.default.RWQ.Fifo.read.handler=406,queue=6,port=24600
2020-01-31,10:59:54,666 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTScanRequest: pre aggregating results before returning
2020-01-31,10:59:54,666 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTAggregateScanner: setting IGTBypassChecker of child
2020-01-31,10:59:58,772 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTAggregateScanner: GTAggregateScanner input rows: 399
2020-01-31,11:00:00,064 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.gridtable.GTAggregateScanner: closing aggrCache
2020-01-31,11:00:00,064 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Total scanned 399 rows and 150930080 bytes
2020-01-31,11:00:00,103 INFO [Query 3645d35d-cb78-10c4-c327-a04acc9ff2a4-492] org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: Size of final result = 71950057 (71950057 before compressing){code}
I will test it fully and repair it later.
> Query failed with "I failed to find one of the right cookies" error
> -------------------------------------------------------------------
>
> Key: KYLIN-4363
> URL: https://issues.apache.org/jira/browse/KYLIN-4363
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
> Affects Versions: v3.1.0
> Reporter: Shao Feng Shi
> Assignee: ZhouKang
> Priority: Major
> Fix For: v3.1.0
>
>
> {code:java}
> // code placeholder
> Caused by: java.lang.RuntimeException: I failed to find one of the right cookies. 1701223222Caused by: java.lang.RuntimeException: I failed to find one of the right cookies. 1701223222 at org.roaringbitmap.buffer.ImmutableRoaringArray.<init>(ImmutableRoaringArray.java:46) at org.roaringbitmap.buffer.ImmutableRoaringBitmap.<init>(ImmutableRoaringBitmap.java:908) at org.apache.kylin.measure.bitmap.RoaringBitmapCounter.peekLength(RoaringBitmapCounter.java:141) at org.apache.kylin.measure.bitmap.BitmapSerializer.peekLength(BitmapSerializer.java:69) at org.apache.kylin.cube.gridtable.CubeCodeSystem.codeLength(CubeCodeSystem.java:100) at org.apache.kylin.gridtable.GTRecord.loadColumns(GTRecord.java:279) at org.apache.kylin.storage.gtrecord.PartitionResultIterator.next(PartitionResultIterator.java:56) at org.apache.kylin.storage.gtrecord.PartitionResultIterator.next(PartitionResultIterator.java:35) at com.google.common.collect.Iterators$PeekingImpl.next(Iterators.java:1222) at org.apache.kylin.storage.gtrecord.SortMergedPartitionResultIterator.next(SortMergedPartitionResultIterator.java:93) at org.apache.kylin.storage.gtrecord.SortMergedPartitionResultIterator.next(SortMergedPartitionResultIterator.java:38) at com.google.common.collect.Iterators$PeekingImpl.next(Iterators.java:1222) at org.apache.kylin.gridtable.GTStreamAggregateScanner$AbstractStreamMergeIterator.next(GTStreamAggregateScanner.java:102) at org.apache.kylin.storage.gtrecord.SegmentCubeTupleIterator.hasNext(SegmentCubeTupleIterator.java:162) at org.apache.kylin.storage.gtrecord.PeekingImpl.hasNext(PeekingImpl.java:45) at org.apache.kylin.storage.gtrecord.SortedIteratorMerger.getHeap(SortedIteratorMerger.java:52) at org.apache.kylin.storage.gtrecord.SortedIteratorMergerWithLimit$MergedIteratorWithLimit.hasNext(SortedIteratorMergerWithLimit.java:81) at org.apache.kylin.storage.gtrecord.SequentialCubeTupleIterator.hasNext(SequentialCubeTupleIterator.java:144) at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:63) at Baz$1$1.moveNext(Unknown Source) at org.apache.calcite.linq4j.EnumerableDefaults.aggregate(EnumerableDefaults.java:116) at org.apache.calcite.linq4j.DefaultEnumerable.aggregate(DefaultEnumerable.java:107) at Baz.bind(Unknown Source) at org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:365) at org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:301) at org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:559) at org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:550) at org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:182) at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:67)
> {code}
> I build a cube with an older version of Kylin, and then query the cube from the latest master version, and then got this error. With some analysis, I think it is related with KYLIN-4322
--
This message was sent by Atlassian Jira
(v8.3.4#803005)