You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by Jinho Kim <jh...@apache.org> on 2014/03/17 08:49:54 UTC

Review Request 19280: TAJO-689: NoSuchElementException occurs during assigning the leaf tasks

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19280/
-----------------------------------------------------------

Review request for Tajo.


Bugs: TAJO-689
    https://issues.apache.org/jira/browse/TAJO-689


Repository: tajo


Description
-------

{noformat}
2014-03-17 15:37:30,982 INFO  planner.PhysicalPlannerImpl (PhysicalPlannerImpl.java:createInMemoryHashAggregation(898)) - The planner chooses [Hash Aggregation]
2014-03-17 15:37:31,061 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 192.168.0.205 to /default-rack
2014-03-17 15:37:31,061 INFO  master.DefaultTaskScheduler (DefaultTaskScheduler.java:allocateRackTask(701)) - Assigned Local/Rack/Total: (0/2/2), Locality: 0.00%, Rack host: 192.168.0.205
Exception in thread "Thread-16" java.util.NoSuchElementException
  at java.util.ArrayList$Itr.next(ArrayList.java:794)
  at org.apache.tajo.master.DefaultTaskScheduler$ScheduledRequests.assignToLeafTasks(DefaultTaskScheduler.java:716)
  at org.apache.tajo.master.DefaultTaskScheduler.schedule(DefaultTaskScheduler.java:162)
  at org.apache.tajo.master.DefaultTaskScheduler$1.run(DefaultTaskScheduler.java:101)
2014-03-17 15:37:31,068 INFO  worker.TaskRunner (TaskRunner.java:run(374)) - Accumulated Received Task: 1
2014-03-17 15:37:31,068 INFO  worker.TaskRunner (TaskRunner.java:run(383)) - Initializing: ta_1395038211889_0001_000001_000001_00
2014-03-17 15:37:31,096 INFO  worker.TaskAttemptContext (TaskAttemptContext.java:setState(110)) - Query status of ta_1395038211889_0001_000001_000001_00 is changed to TA_PENDING
{noformat}


Diffs
-----

  tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/DefaultTaskScheduler.java 2aefc1500e19407c8e4ef485842b3f37d5d29d9c 

Diff: https://reviews.apache.org/r/19280/diff/


Testing
-------


Thanks,

Jinho Kim


Re: Review Request 19280: TAJO-689: NoSuchElementException occurs during assigning the leaf tasks

Posted by Jinho Kim <jh...@apache.org>.

> On March 17, 2014, 8:17 a.m., Hyunsik Choi wrote:
> > +1
> > I've tested it on a local cluster running on local file system. It works well. Thank you for quick fix!

Thank you for the fast review.
I've committed it to both branch-0.8.0 and master


- Jinho


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19280/#review37351
-----------------------------------------------------------


On March 17, 2014, 7:49 a.m., Jinho Kim wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19280/
> -----------------------------------------------------------
> 
> (Updated March 17, 2014, 7:49 a.m.)
> 
> 
> Review request for Tajo.
> 
> 
> Bugs: TAJO-689
>     https://issues.apache.org/jira/browse/TAJO-689
> 
> 
> Repository: tajo
> 
> 
> Description
> -------
> 
> {noformat}
> 2014-03-17 15:37:30,982 INFO  planner.PhysicalPlannerImpl (PhysicalPlannerImpl.java:createInMemoryHashAggregation(898)) - The planner chooses [Hash Aggregation]
> 2014-03-17 15:37:31,061 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 192.168.0.205 to /default-rack
> 2014-03-17 15:37:31,061 INFO  master.DefaultTaskScheduler (DefaultTaskScheduler.java:allocateRackTask(701)) - Assigned Local/Rack/Total: (0/2/2), Locality: 0.00%, Rack host: 192.168.0.205
> Exception in thread "Thread-16" java.util.NoSuchElementException
>   at java.util.ArrayList$Itr.next(ArrayList.java:794)
>   at org.apache.tajo.master.DefaultTaskScheduler$ScheduledRequests.assignToLeafTasks(DefaultTaskScheduler.java:716)
>   at org.apache.tajo.master.DefaultTaskScheduler.schedule(DefaultTaskScheduler.java:162)
>   at org.apache.tajo.master.DefaultTaskScheduler$1.run(DefaultTaskScheduler.java:101)
> 2014-03-17 15:37:31,068 INFO  worker.TaskRunner (TaskRunner.java:run(374)) - Accumulated Received Task: 1
> 2014-03-17 15:37:31,068 INFO  worker.TaskRunner (TaskRunner.java:run(383)) - Initializing: ta_1395038211889_0001_000001_000001_00
> 2014-03-17 15:37:31,096 INFO  worker.TaskAttemptContext (TaskAttemptContext.java:setState(110)) - Query status of ta_1395038211889_0001_000001_000001_00 is changed to TA_PENDING
> {noformat}
> 
> 
> Diffs
> -----
> 
>   tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/DefaultTaskScheduler.java 2aefc1500e19407c8e4ef485842b3f37d5d29d9c 
> 
> Diff: https://reviews.apache.org/r/19280/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Jinho Kim
> 
>


Re: Review Request 19280: TAJO-689: NoSuchElementException occurs during assigning the leaf tasks

Posted by Hyunsik Choi <hy...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19280/#review37351
-----------------------------------------------------------


+1
I've tested it on a local cluster running on local file system. It works well. Thank you for quick fix!

- Hyunsik Choi


On March 17, 2014, 4:49 p.m., Jinho Kim wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19280/
> -----------------------------------------------------------
> 
> (Updated March 17, 2014, 4:49 p.m.)
> 
> 
> Review request for Tajo.
> 
> 
> Bugs: TAJO-689
>     https://issues.apache.org/jira/browse/TAJO-689
> 
> 
> Repository: tajo
> 
> 
> Description
> -------
> 
> {noformat}
> 2014-03-17 15:37:30,982 INFO  planner.PhysicalPlannerImpl (PhysicalPlannerImpl.java:createInMemoryHashAggregation(898)) - The planner chooses [Hash Aggregation]
> 2014-03-17 15:37:31,061 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 192.168.0.205 to /default-rack
> 2014-03-17 15:37:31,061 INFO  master.DefaultTaskScheduler (DefaultTaskScheduler.java:allocateRackTask(701)) - Assigned Local/Rack/Total: (0/2/2), Locality: 0.00%, Rack host: 192.168.0.205
> Exception in thread "Thread-16" java.util.NoSuchElementException
>   at java.util.ArrayList$Itr.next(ArrayList.java:794)
>   at org.apache.tajo.master.DefaultTaskScheduler$ScheduledRequests.assignToLeafTasks(DefaultTaskScheduler.java:716)
>   at org.apache.tajo.master.DefaultTaskScheduler.schedule(DefaultTaskScheduler.java:162)
>   at org.apache.tajo.master.DefaultTaskScheduler$1.run(DefaultTaskScheduler.java:101)
> 2014-03-17 15:37:31,068 INFO  worker.TaskRunner (TaskRunner.java:run(374)) - Accumulated Received Task: 1
> 2014-03-17 15:37:31,068 INFO  worker.TaskRunner (TaskRunner.java:run(383)) - Initializing: ta_1395038211889_0001_000001_000001_00
> 2014-03-17 15:37:31,096 INFO  worker.TaskAttemptContext (TaskAttemptContext.java:setState(110)) - Query status of ta_1395038211889_0001_000001_000001_00 is changed to TA_PENDING
> {noformat}
> 
> 
> Diffs
> -----
> 
>   tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/DefaultTaskScheduler.java 2aefc1500e19407c8e4ef485842b3f37d5d29d9c 
> 
> Diff: https://reviews.apache.org/r/19280/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Jinho Kim
> 
>