You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tajo.apache.org by "Sergio Esteves (JIRA)" <ji...@apache.org> on 2013/09/06 05:33:51 UTC
[jira] [Resolved] (TAJO-160) StorageManager throws
InvalidInputException while running simple join query
[ https://issues.apache.org/jira/browse/TAJO-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sergio Esteves resolved TAJO-160.
---------------------------------
Resolution: Fixed
Fix Version/s: 0.3-incubating
0.2-incubating
> StorageManager throws InvalidInputException while running simple join query
> ---------------------------------------------------------------------------
>
> Key: TAJO-160
> URL: https://issues.apache.org/jira/browse/TAJO-160
> Project: Tajo
> Issue Type: Bug
> Components: storage
> Environment: Ubuntu 12.04.2 LTS, Java 1.6.0_26 (Sun Microsystems Inc.), hadoop 2.0.4-alpha
> Reporter: Sergio Esteves
> Fix For: 0.2-incubating, 0.3-incubating
>
>
> While executing the query "select * from customer as c inner join nation as n on c.c_nationkey = n.n_nationkey;", with nation and customer being the tables generated from TPCH, I got the following:
> {code}
> tajo> select * from customer as c inner join nation as n on c.c_nationkey = n.n_nationkey;
> 2013-09-05 04:45:05,632 INFO client.TajoClient (TajoClient.java:connectionToQueryMaster(190)) - Connected to Query Master (qid=q_1378350112573_0007, addr=146.XXX.XX.XX:8091)
> 2013-09-05 04:45:05,700 INFO rpc.NettyClientBase (NettyClientBase.java:close(87)) - Proxy is disconnected from 146.XXX.XX.XX:8091
> 2013-09-05 04:45:05,700 INFO client.TajoClient (TajoClient.java:closeQuery(113)) - Closed a QueryMaster connection (qid=q_1378350112573_0007, addr=computer3/146.XXX.XX.XX:8091)
> null
> tajo>
> {code}
> "select * from customer;" and "select * from nation;" returned correctly the tables.
> Here follows the yarn stderr user log:
> {code}
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.master.YarnTaskRunnerLauncherImpl is started.
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.AMRMClientImpl is started.
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.worker.AbstractResourceAllocator is started.
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.master.TajoAsyncDispatcher is started.
> 13/09/05 04:15:46 INFO master.TajoAsyncDispatcher: AsyncDispatcher started:q_1378350112573_0004
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.master.querymaster.QueryMasterTask is started.
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type INIT
> 13/09/05 04:15:46 INFO querymaster.Query: q_1378350112573_0004 Query Transitioned from QUERY_NEW to QUERY_INIT
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type START
> 13/09/05 04:15:46 INFO rm.YarnRMContainerAllocator: Available Resource: <memory:6144, vCores:0>
> 13/09/05 04:15:46 WARN querymaster.SubQuery: SubQuery (eb_1378350112573_0004_000001) failed
> org.apache.tajo.storage.StorageManager$InvalidInputException
> at org.apache.tajo.storage.StorageManager.listStatus(StorageManager.java:440)
> at org.apache.tajo.storage.StorageManager.getSplits(StorageManager.java:622)
> at org.apache.tajo.master.querymaster.Repartitioner.createJoinTasks(Repartitioner.java:85)
> at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.createTasks(SubQuery.java:566)
> at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.transition(SubQuery.java:449)
> at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.transition(SubQuery.java:433)
> at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:382)
> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:445)
> at org.apache.tajo.master.querymaster.SubQuery.handle(SubQuery.java:410)
> at org.apache.tajo.master.querymaster.Query$StartTransition.transition(Query.java:279)
> at org.apache.tajo.master.querymaster.Query$StartTransition.transition(Query.java:268)
> at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:359)
> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:445)
> at org.apache.tajo.master.querymaster.Query.handle(Query.java:399)
> at org.apache.tajo.master.querymaster.Query.handle(Query.java:53)
> at org.apache.tajo.master.TajoAsyncDispatcher.dispatch(TajoAsyncDispatcher.java:139)
> at org.apache.tajo.master.TajoAsyncDispatcher$1.run(TajoAsyncDispatcher.java:79)
> at java.lang.Thread.run(Thread.java:679)
> 13/09/05 04:15:46 INFO querymaster.Query: q_1378350112573_0004 Query Transitioned from QUERY_INIT to QUERY_RUNNING
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type SUBQUERY_COMPLETED
> 13/09/05 04:15:46 FATAL master.TajoAsyncDispatcher: Error in dispatcher thread:SUBQUERY_COMPLETED
> java.lang.ClassCastException: org.apache.tajo.master.event.QueryDiagnosticsUpdateEvent cannot be cast to org.apache.tajo.master.event.SubQueryCompletedEvent
> at org.apache.tajo.master.querymaster.Query$SubQueryCompletedTransition.transition(Query.java:291)
> at org.apache.tajo.master.querymaster.Query$SubQueryCompletedTransition.transition(Query.java:284)
> at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:382)
> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:445)
> at org.apache.tajo.master.querymaster.Query.handle(Query.java:399)
> at org.apache.tajo.master.querymaster.Query.handle(Query.java:53)
> at org.apache.tajo.master.TajoAsyncDispatcher.dispatch(TajoAsyncDispatcher.java:139)
> at org.apache.tajo.master.TajoAsyncDispatcher$1.run(TajoAsyncDispatcher.java:79)
> at java.lang.Thread.run(Thread.java:679)
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type SUBQUERY_COMPLETED
> 13/09/05 04:15:46 INFO querymaster.Query: q_1378350112573_0004 Query Transitioned from QUERY_RUNNING to QUERY_FAILED
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira