You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Samarth Jain (JIRA)" <ji...@apache.org> on 2017/06/13 23:52:00 UTC

[jira] [Updated] (PHOENIX-3890) UnknownScannerException/IllegalArgumentException encountered when running Phoenix Web Stat example

     [ https://issues.apache.org/jira/browse/PHOENIX-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Samarth Jain updated PHOENIX-3890:
----------------------------------
    Attachment: PHOENIX-3890.patch

It looks like the EncodedColumnQualiferList's list iterator() implementation doesn't work correctly when there are multiple column families in the table. The hbase sort order of key values takes into consideration the column family and column qualifier for comparison where as the EncodedColumnQualiferList stores cells sorted by the column qualifier only. I would need to think a bit more about to tweak the list to handle this scenario. For now, it would make sense to disable the optimization when a table has more than one column family.

[~jamestaylor], please review. I would like to get this in 4.11 since this is a serious issue.

> UnknownScannerException/IllegalArgumentException encountered when running Phoenix Web Stat example
> --------------------------------------------------------------------------------------------------
>
>                 Key: PHOENIX-3890
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3890
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.10.0
>            Reporter: Craig Foster
>         Attachments: PHOENIX-3890.patch
>
>
> Command I ran:
> /usr/lib/phoenix/bin/psql.py localhost /usr/share/doc/phoenix-4.10.0/examples/WEB_STAT.sql /usr/share/doc/phoenix-4.10.0/examples/WEB_STAT.csv /usr/share/doc/phoenix-4.10.0/examples/WEB_STAT_QUERIES.sql
> results in this stacktrace:
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/usr/lib/phoenix/phoenix-4.10.0-HBase-1.2-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> org.apache.phoenix.exception.PhoenixIOException: org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.UnknownScannerException: Throwing UnknownScannerException to reset the client scanner state for clients older than 1.3.
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2893)
>                 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34950)
>                 at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
>                 at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
> Caused by: java.lang.IllegalArgumentException: Cell EUSalesforce.com\x00Login\x00\x80\x00\x01<,F(\xC8/STATS:\x80\x0D/1495228147548/Put/vlen=4/seqid=4 with column qualifier 13 belongs at index 13. It cannot be added at the position 11 to which the previous next() or previous() was pointing to.
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:528)
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:473)
>                 at java.util.List.sort(List.java:482)
>                 at java.util.Collections.sort(Collections.java:175)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateFromJoinedHeap(HRegion.java:5893)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6146)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5858)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5844)
>                 at org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver$1.next(GroupedAggregateRegionObserver.java:497)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.next(BaseRegionScanner.java:44)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.nextRaw(BaseRegionScanner.java:59)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:283)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2629)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2833)
>                 ... 5 more
>  
>                 at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:113)
>                 at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:852)
>                 at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:796)
>                 at org.apache.phoenix.iterate.RowKeyOrderedAggregateResultIterator.getIterators(RowKeyOrderedAggregateResultIterator.java:61)
>                 at org.apache.phoenix.iterate.RowKeyOrderedAggregateResultIterator.nextTuple(RowKeyOrderedAggregateResultIterator.java:108)
>                 at org.apache.phoenix.iterate.RowKeyOrderedAggregateResultIterator.advance(RowKeyOrderedAggregateResultIterator.java:146)
>                 at org.apache.phoenix.iterate.LookAheadResultIterator.init(LookAheadResultIterator.java:59)
>                 at org.apache.phoenix.iterate.LookAheadResultIterator.next(LookAheadResultIterator.java:65)
>                 at org.apache.phoenix.iterate.RowKeyOrderedAggregateResultIterator.next(RowKeyOrderedAggregateResultIterator.java:133)
>                 at org.apache.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:778)
>                 at org.apache.phoenix.jdbc.PhoenixConnection.executeStatements(PhoenixConnection.java:372)
>                 at org.apache.phoenix.util.PhoenixRuntime.executeStatements(PhoenixRuntime.java:318)
>                 at org.apache.phoenix.util.PhoenixRuntime.main(PhoenixRuntime.java:265)
> Caused by: java.util.concurrent.ExecutionException: org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.UnknownScannerException: Throwing UnknownScannerException to reset the client scanner state for clients older than 1.3.
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2893)
>                 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34950)
>                 at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
>                 at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
> Caused by: java.lang.IllegalArgumentException: Cell EUSalesforce.com\x00Login\x00\x80\x00\x01<,F(\xC8/STATS:\x80\x0D/1495228147548/Put/vlen=4/seqid=4 with column qualifier 13 belongs at index 13. It cannot be added at the position 11 to which the previous next() or previous() was pointing to.
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:528)
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:473)
>                 at java.util.List.sort(List.java:482)
>                 at java.util.Collections.sort(Collections.java:175)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateFromJoinedHeap(HRegion.java:5893)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6146)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5858)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5844)
>                 at org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver$1.next(GroupedAggregateRegionObserver.java:497)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.next(BaseRegionScanner.java:44)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.nextRaw(BaseRegionScanner.java:59)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:283)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2629)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2833)
>                 ... 5 more
>  
>                 at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>                 at java.util.concurrent.FutureTask.get(FutureTask.java:206)
>                 at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:847)
>                 ... 11 more
> Caused by: org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.UnknownScannerException: Throwing UnknownScannerException to reset the client scanner state for clients older than 1.3.
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2893)
>                 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34950)
>                 at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
>                 at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
> Caused by: java.lang.IllegalArgumentException: Cell EUSalesforce.com\x00Login\x00\x80\x00\x01<,F(\xC8/STATS:\x80\x0D/1495228147548/Put/vlen=4/seqid=4 with column qualifier 13 belongs at index 13. It cannot be added at the position 11 to which the previous next() or previous() was pointing to.
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:528)
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:473)
>                 at java.util.List.sort(List.java:482)
>                 at java.util.Collections.sort(Collections.java:175)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateFromJoinedHeap(HRegion.java:5893)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6146)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5858)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5844)
>                 at org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver$1.next(GroupedAggregateRegionObserver.java:497)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.next(BaseRegionScanner.java:44)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.nextRaw(BaseRegionScanner.java:59)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:283)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2629)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2833)
>                 ... 5 more
>  
>                 at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:113)
>                 at org.apache.phoenix.iterate.TableResultIterator.next(TableResultIterator.java:146)
>                 at org.apache.phoenix.iterate.LookAheadResultIterator$1.advance(LookAheadResultIterator.java:47)
>                 at org.apache.phoenix.iterate.LookAheadResultIterator.init(LookAheadResultIterator.java:59)
>                 at org.apache.phoenix.iterate.LookAheadResultIterator.peek(LookAheadResultIterator.java:73)
>                 at org.apache.phoenix.iterate.ParallelIterators$1.call(ParallelIterators.java:121)
>                 at org.apache.phoenix.iterate.ParallelIterators$1.call(ParallelIterators.java:106)
>                 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>                 at org.apache.phoenix.job.JobManager$InstrumentedJobFutureTask.run(JobManager.java:183)
>                 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>                 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>                 at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.UnknownScannerException: Throwing UnknownScannerException to reset the client scanner state for clients older than 1.3.
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2893)
>                 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34950)
>                 at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
>                 at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
> Caused by: java.lang.IllegalArgumentException: Cell EUSalesforce.com\x00Login\x00\x80\x00\x01<,F(\xC8/STATS:\x80\x0D/1495228147548/Put/vlen=4/seqid=4 with column qualifier 13 belongs at index 13. It cannot be added at the position 11 to which the previous next() or previous() was pointing to.
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:528)
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:473)
>                 at java.util.List.sort(List.java:482)
>                 at java.util.Collections.sort(Collections.java:175)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateFromJoinedHeap(HRegion.java:5893)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6146)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5858)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5844)
>                 at org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver$1.next(GroupedAggregateRegionObserver.java:497)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.next(BaseRegionScanner.java:44)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.nextRaw(BaseRegionScanner.java:59)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:283)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2629)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2833)
>                 ... 5 more
>  
>                 at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:113)
>                 at org.apache.phoenix.iterate.ScanningResultIterator.next(ScanningResultIterator.java:65)
>                 at org.apache.phoenix.iterate.TableResultIterator.next(TableResultIterator.java:139)
>                 ... 10 more
> Caused by: org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Throwing UnknownScannerException to reset the client scanner state for clients older than 1.3.
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2893)
>                 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34950)
>                 at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
>                 at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
> Caused by: java.lang.IllegalArgumentException: Cell EUSalesforce.com\x00Login\x00\x80\x00\x01<,F(\xC8/STATS:\x80\x0D/1495228147548/Put/vlen=4/seqid=4 with column qualifier 13 belongs at index 13. It cannot be added at the position 11 to which the previous next() or previous() was pointing to.
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:528)
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:473)
>                 at java.util.List.sort(List.java:482)
>                 at java.util.Collections.sort(Collections.java:175)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateFromJoinedHeap(HRegion.java:5893)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6146)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5858)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5844)
>                 at org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver$1.next(GroupedAggregateRegionObserver.java:497)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.next(BaseRegionScanner.java:44)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.nextRaw(BaseRegionScanner.java:59)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:283)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2629)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2833)
>                 ... 5 more
>  
>                 at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown Source)
>                 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>                 at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
>                 at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
>                 at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
>                 at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
>                 at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:267)
>                 at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:65)
>                 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:212)
>                 at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:364)
>                 at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:338)
>                 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
>                 at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
>                 ... 3 more
> Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.UnknownScannerException): org.apache.hadoop.hbase.UnknownScannerException: Throwing UnknownScannerException to reset the client scanner state for clients older than 1.3.
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2893)
>                 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34950)
>                 at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
>                 at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
>                 at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
> Caused by: java.lang.IllegalArgumentException: Cell EUSalesforce.com\x00Login\x00\x80\x00\x01<,F(\xC8/STATS:\x80\x0D/1495228147548/Put/vlen=4/seqid=4 with column qualifier 13 belongs at index 13. It cannot be added at the position 11 to which the previous next() or previous() was pointing to.
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:528)
>                 at org.apache.phoenix.schema.tuple.EncodedColumnQualiferCellsList$ListItr.set(EncodedColumnQualiferCellsList.java:473)
>                 at java.util.List.sort(List.java:482)
>                 at java.util.Collections.sort(Collections.java:175)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateFromJoinedHeap(HRegion.java:5893)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6146)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5858)
>                 at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5844)
>                 at org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver$1.next(GroupedAggregateRegionObserver.java:497)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.next(BaseRegionScanner.java:44)
>                 at org.apache.phoenix.coprocessor.BaseRegionScanner.nextRaw(BaseRegionScanner.java:59)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.DelegateRegionScanner.nextRaw(DelegateRegionScanner.java:77)
>                 at org.apache.phoenix.coprocessor.BaseScannerRegionObserver$RegionScannerHolder.nextRaw(BaseScannerRegionObserver.java:283)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2629)
>                 at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2833)
>                 ... 5 more
>  
>                 at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1270)
>                 at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
>                 at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
>                 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:35396)
>                 at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:224)
>                 ... 9 more
> Command exiting with ret '1'
>  
> PHOENIX-3754 suggests that I set the rpc timeout higher, but that suggestion doesn't work and I'm not seeing the same stacktrace in any event, so I believe this is a different issue.  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)