You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Rajeshbabu Chintaguntla (JIRA)" <ji...@apache.org> on 2018/02/09 11:36:02 UTC
[jira] [Commented] (PHOENIX-4591) Possible
IndexOutOfBoundsException with delete query on bigger table
[ https://issues.apache.org/jira/browse/PHOENIX-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16358291#comment-16358291 ]
Rajeshbabu Chintaguntla commented on PHOENIX-4591:
--------------------------------------------------
This is coming when once after writing rows equal to batch size we 500000 we are clearing the indexMutations list. so next after committing we try to get the element from the empty list so IndexOutOfBoundsException is getting thrown. Instead of clearing the indexMutations list we need clear the maps holding in the list to avoid this.
{noformat}
// Commit a batch if auto commit is true and we're at our batch size
if (isAutoCommit && rowCount % batchSize == 0) {
MutationState state = new MutationState(tableRef, mutations, 0, maxSize, maxSizeBytes, connection);
connection.getMutationState().join(state);
for (int i = 0; i < otherTableRefs.size(); i++) {
MutationState indexState = new MutationState(otherTableRefs.get(i), indexMutations.get(i), 0, maxSize, maxSizeBytes, connection);
connection.getMutationState().join(indexState);
}
connection.getMutationState().send();
mutations.clear();
if (indexMutations != null) {
indexMutations.clear();
}
}
{noformat}
> Possible IndexOutOfBoundsException with delete query on bigger table
> --------------------------------------------------------------------
>
> Key: PHOENIX-4591
> URL: https://issues.apache.org/jira/browse/PHOENIX-4591
> Project: Phoenix
> Issue Type: Bug
> Reporter: Romil Choksi
> Assignee: Rajeshbabu Chintaguntla
> Priority: Major
> Fix For: 5.0.0, 4.14.0
>
>
> Here is the schema and inserted around 5million records.
> {noformat}
> 0: jdbc:phoenix:localhost> CREATE TABLE IF NOT EXISTS testTable ( ID BIGINT PRIMARY KEY , FirstName VARCHAR(30) , SecondName VARCHAR(30) , City VARCHAR(30) );
> No rows affected (2.283 seconds)
> 0: jdbc:phoenix:localhost> CREATE INDEX secondary_index ON testTable (FirstName);
> No rows affected (7.275 seconds)
> {noformat}
> Then delete from the table is throwing java.lang.IndexOutOfBoundsException
> {noformat}
> 0: jdbc:phoenix:localhost> delete from testtable;
> Error: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 (state=08000,code=101)
> org.apache.phoenix.exception.PhoenixIOException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:122)
> at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:970)
> at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:912)
> at org.apache.phoenix.iterate.RoundRobinResultIterator.getIterators(RoundRobinResultIterator.java:176)
> at org.apache.phoenix.iterate.RoundRobinResultIterator.next(RoundRobinResultIterator.java:91)
> at org.apache.phoenix.compile.DeleteCompiler$5.execute(DeleteCompiler.java:796)
> at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:394)
> at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:377)
> at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
> at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:376)
> at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:364)
> at org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:1738)
> at sqlline.Commands.execute(Commands.java:822)
> at sqlline.Commands.sql(Commands.java:732)
> at sqlline.SqlLine.dispatch(SqlLine.java:813)
> at sqlline.SqlLine.begin(SqlLine.java:686)
> at sqlline.SqlLine.start(SqlLine.java:398)
> at sqlline.SqlLine.main(SqlLine.java:291)
> Caused by: java.util.concurrent.ExecutionException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:206)
> at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:965)
> ... 16 more
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> at java.util.ArrayList.rangeCheck(ArrayList.java:653)
> at java.util.ArrayList.get(ArrayList.java:429)
> at org.apache.phoenix.compile.DeleteCompiler.deleteRows(DeleteCompiler.java:225)
> at org.apache.phoenix.compile.DeleteCompiler.access$000(DeleteCompiler.java:98)
> at org.apache.phoenix.compile.DeleteCompiler$DeletingParallelIteratorFactory.mutate(DeleteCompiler.java:276)
> at org.apache.phoenix.compile.MutatingParallelIteratorFactory.newIterator(MutatingParallelIteratorFactory.java:59)
> at org.apache.phoenix.iterate.ParallelIterators$1.call(ParallelIterators.java:121)
> at org.apache.phoenix.iterate.ParallelIterators$1.call(ParallelIterators.java:113)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at org.apache.phoenix.job.JobManager$InstrumentedJobFutureTask.run(JobManager.java:183)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)