You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Pedro Gandola <pe...@gmail.com> on 2016/01/19 01:51:50 UTC

Create new local index failed!

Hi,

I'm trying to create a new local index on *Phoenix4.4* over an existing
table containing ~2 billion rows. During the process I get a some warnings
and then after  ~1 hour I get an error from Phoenix.

My table has TTL defined and I'm assuming the warnings might be caused by
expired data.

*Warnings:*

16/01/18 23:36:43 WARN client.ScannerCallable: Ignore, probably already
> closed
> org.apache.hadoop.hbase.UnknownScannerException:
> org.apache.hadoop.hbase.UnknownScannerException: Name: 1856, already closed?
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2223)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> at java.lang.Thread.run(Thread.java:745)


Error:

Error: org.apache.phoenix.exception.PhoenixIOException: Failed after
> attempts=36, exceptions:
> Mon Jan 18 23:38:04 UTC 2016, null, java.net.SocketTimeoutException:
> callTimeout=60000, callDuration=1200304: row '' on table 'BIDDING_EVENTS'
> at region=BIDDING_EVENTS,,1452643348711.a4970d6e22f8c0accc39e9ec746a05fa.,
> hostname=ip-10-5-4-22.ec2.internal,16020,1452867025003, seqNum=11131841
> (state=08000,code=101)
> org.apache.phoenix.exception.PhoenixIOException:
> org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36,
> exceptions:
> Mon Jan 18 23:38:04 UTC 2016, null, java.net.SocketTimeoutException:
> callTimeout=60000, callDuration=1200304: row '' on table 'BIDDING_EVENTS'
> at region=BIDDING_EVENTS,,1452643348711.a4970d6e22f8c0accc39e9ec746a05fa.,
> hostname=ip-10-5-4-222.ec2.internal,16020,1452867025003, seqNum=11131841


After this, I get into a state where I can see the table on phoenix typing
*!tables* but I can't see the table on HBase. The state of the index is
BUILDING.

BTW, Is there a way to check the state of an index (BUILDING, USABLE,
etc..) via command line?

Any thoughts?

Thank you,
Cheers
Pedro

Re: Create new local index failed!

Posted by Pedro Gandola <pe...@gmail.com>.
The table not being on HBase is due the fact that I already had a local
index before.

I'm running it now using Async and the IndexTool.

Cheers

On Tue, Jan 19, 2016 at 12:51 AM, Pedro Gandola <pe...@gmail.com>
wrote:

> Hi,
>
> I'm trying to create a new local index on *Phoenix4.4* over an existing
> table containing ~2 billion rows. During the process I get a some warnings
> and then after  ~1 hour I get an error from Phoenix.
>
> My table has TTL defined and I'm assuming the warnings might be caused by
> expired data.
>
> *Warnings:*
>
> 16/01/18 23:36:43 WARN client.ScannerCallable: Ignore, probably already
>> closed
>> org.apache.hadoop.hbase.UnknownScannerException:
>> org.apache.hadoop.hbase.UnknownScannerException: Name: 1856, already closed?
>> at
>> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2223)
>> at
>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
>> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
>> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
>> at
>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>> at java.lang.Thread.run(Thread.java:745)
>
>
> Error:
>
> Error: org.apache.phoenix.exception.PhoenixIOException: Failed after
>> attempts=36, exceptions:
>> Mon Jan 18 23:38:04 UTC 2016, null, java.net.SocketTimeoutException:
>> callTimeout=60000, callDuration=1200304: row '' on table 'BIDDING_EVENTS'
>> at region=BIDDING_EVENTS,,1452643348711.a4970d6e22f8c0accc39e9ec746a05fa.,
>> hostname=ip-10-5-4-22.ec2.internal,16020,1452867025003, seqNum=11131841
>> (state=08000,code=101)
>> org.apache.phoenix.exception.PhoenixIOException:
>> org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36,
>> exceptions:
>> Mon Jan 18 23:38:04 UTC 2016, null, java.net.SocketTimeoutException:
>> callTimeout=60000, callDuration=1200304: row '' on table 'BIDDING_EVENTS'
>> at region=BIDDING_EVENTS,,1452643348711.a4970d6e22f8c0accc39e9ec746a05fa.,
>> hostname=ip-10-5-4-222.ec2.internal,16020,1452867025003, seqNum=11131841
>
>
> After this, I get into a state where I can see the table on phoenix typing
> *!tables* but I can't see the table on HBase. The state of the index is
> BUILDING.
>
> BTW, Is there a way to check the state of an index (BUILDING, USABLE,
> etc..) via command line?
>
> Any thoughts?
>
> Thank you,
> Cheers
> Pedro
>