You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tajo.apache.org by Henry Saputra <he...@gmail.com> on 2013/05/08 10:31:39 UTC
Fail to connect to YARN Resource Manager in Ubuntu
Hi All,
I tried to move my dev env to Ubuntu but when I tried simple query for
external table like:
tajo> /d table3
table name: table3
table path: file:/home/hsaputra/tajo-install/sample_data/table1
store type: CSV
number of rows: 0
volume (bytes): 60 B
schema:
id INT
name STRING
score FLOAT
type STRING
tajo> select * from table3
Internal Error
I got error can not connect to YARN resource manager:
2013-05-08 01:25:12,852 INFO master.GlobalEngine
(GlobalEngine.java:executeQuery(152)) - TQL: select * from table3
2013-05-08 01:25:13,139 INFO planner.LogicalPlanner
(LogicalPlanner.java:createPlanInternal(89)) - Planning select statement
2013-05-08 01:25:13,146 INFO master.GlobalEngine
(GlobalEngine.java:createLogicalPlan(243)) - LogicalPlan:
Logical Plan Root
"Scan" : {"table":"table3",
"out schema": {table3.id (INT),table3.name (STRING),table3.score
(FLOAT),table3.type (STRING)}
"in schema": {table3.id (INT),table3.name (STRING),table3.score
(FLOAT),table3.type (STRING)}
2013-05-08 01:25:19,176 INFO ipc.Client
(Client.java:handleConnectionFailure(740)) - Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-05-08 01:25:20,178 INFO ipc.Client
(Client.java:handleConnectionFailure(740)) - Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-05-08 01:25:21,179 INFO ipc.Client
(Client.java:handleConnectionFailure(740)) - Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 2 time(s); retry policy is
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-05-08 01:25:22,182 INFO ipc.Client
(Client.java:handleConnectionFailure(740)) - Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 3 time(s); retry policy is
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-05-08 01:25:23,184 INFO ipc.Client
(Client.java:handleConnectionFailure(740)) - Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 4 time(s); retry policy is
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
I have verified the component is listening to port 8032 in my localhost.
Any insight why Tajo complain about connect failure?
- Henry
Re: Fail to connect to YARN Resource Manager in Ubuntu
Posted by Henry Saputra <he...@gmail.com>.
Thanks for the reply Hyunsik.
Ah yes, in my Ubuntu I uses the separate conf dir for Hadoop. Let me try
your suggestion.
Would it be a good improvement to make Tajo to load conf files from
location defined in HADOOP_CONF_DIR if it is defined?
Thanks,
- Henry
On Wed, May 8, 2013 at 1:51 AM, Hyunsik Choi <hy...@apache.org> wrote:
> Hi Henry,
>
> I designed bin/tajo script to read $HADOOP_HOME/etc/hadoop/*.xml from bash
> environment variables. But, if the configs are in the different place, the
> tajo script cannot get the appropriate configs.
>
> If you meet this problem, although your hadoop configs are in the right
> place, please put the following configs with proper ip addresses and port
> numbers to your tajo-site.xml.
>
> <property>
> <name>yarn.resourcemanager.address</name>
> <value>127.0.0.x:8032</value>
> </property>
>
> <property>
> <name>yarn.resourcemanager.scheduler.address</name>
> <value>127.0.0.x:8030</value>
> </property>
>
> <property>
> <name>yarn.resourcemanager.resource-tracker.address</name>
> <value>127.0.0.x:8031</value>
> </property>
>
> Best regards,
> Hyunsik
>
>
> On Wed, May 8, 2013 at 5:31 PM, Henry Saputra <henry.saputra@gmail.com
> >wrote:
>
> > Hi All,
> >
> > I tried to move my dev env to Ubuntu but when I tried simple query for
> > external table like:
> >
> > tajo> /d table3
> >
> > table name: table3
> > table path: file:/home/hsaputra/tajo-install/sample_data/table1
> > store type: CSV
> > number of rows: 0
> > volume (bytes): 60 B
> > schema:
> > id INT
> > name STRING
> > score FLOAT
> > type STRING
> >
> > tajo> select * from table3
> > Internal Error
> >
> > I got error can not connect to YARN resource manager:
> >
> > 2013-05-08 01:25:12,852 INFO master.GlobalEngine
> > (GlobalEngine.java:executeQuery(152)) - TQL: select * from table3
> > 2013-05-08 01:25:13,139 INFO planner.LogicalPlanner
> > (LogicalPlanner.java:createPlanInternal(89)) - Planning select statement
> > 2013-05-08 01:25:13,146 INFO master.GlobalEngine
> > (GlobalEngine.java:createLogicalPlan(243)) - LogicalPlan:
> > Logical Plan Root
> >
> > "Scan" : {"table":"table3",
> > "out schema": {table3.id (INT),table3.name (STRING),table3.score
> > (FLOAT),table3.type (STRING)}
> > "in schema": {table3.id (INT),table3.name (STRING),table3.score
> > (FLOAT),table3.type (STRING)}
> > 2013-05-08 01:25:19,176 INFO ipc.Client
> > (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is
> > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> > 2013-05-08 01:25:20,178 INFO ipc.Client
> > (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is
> > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> > 2013-05-08 01:25:21,179 INFO ipc.Client
> > (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032. Already tried 2 time(s); retry policy is
> > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> > 2013-05-08 01:25:22,182 INFO ipc.Client
> > (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032. Already tried 3 time(s); retry policy is
> > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> > 2013-05-08 01:25:23,184 INFO ipc.Client
> > (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032. Already tried 4 time(s); retry policy is
> > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> >
> >
> > I have verified the component is listening to port 8032 in my localhost.
> >
> > Any insight why Tajo complain about connect failure?
> >
> >
> > - Henry
> >
>
Re: Fail to connect to YARN Resource Manager in Ubuntu
Posted by Hyunsik Choi <hy...@apache.org>.
Hi Henry,
I designed bin/tajo script to read $HADOOP_HOME/etc/hadoop/*.xml from bash
environment variables. But, if the configs are in the different place, the
tajo script cannot get the appropriate configs.
If you meet this problem, although your hadoop configs are in the right
place, please put the following configs with proper ip addresses and port
numbers to your tajo-site.xml.
<property>
<name>yarn.resourcemanager.address</name>
<value>127.0.0.x:8032</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>127.0.0.x:8030</value>
</property>
<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>127.0.0.x:8031</value>
</property>
Best regards,
Hyunsik
On Wed, May 8, 2013 at 5:31 PM, Henry Saputra <he...@gmail.com>wrote:
> Hi All,
>
> I tried to move my dev env to Ubuntu but when I tried simple query for
> external table like:
>
> tajo> /d table3
>
> table name: table3
> table path: file:/home/hsaputra/tajo-install/sample_data/table1
> store type: CSV
> number of rows: 0
> volume (bytes): 60 B
> schema:
> id INT
> name STRING
> score FLOAT
> type STRING
>
> tajo> select * from table3
> Internal Error
>
> I got error can not connect to YARN resource manager:
>
> 2013-05-08 01:25:12,852 INFO master.GlobalEngine
> (GlobalEngine.java:executeQuery(152)) - TQL: select * from table3
> 2013-05-08 01:25:13,139 INFO planner.LogicalPlanner
> (LogicalPlanner.java:createPlanInternal(89)) - Planning select statement
> 2013-05-08 01:25:13,146 INFO master.GlobalEngine
> (GlobalEngine.java:createLogicalPlan(243)) - LogicalPlan:
> Logical Plan Root
>
> "Scan" : {"table":"table3",
> "out schema": {table3.id (INT),table3.name (STRING),table3.score
> (FLOAT),table3.type (STRING)}
> "in schema": {table3.id (INT),table3.name (STRING),table3.score
> (FLOAT),table3.type (STRING)}
> 2013-05-08 01:25:19,176 INFO ipc.Client
> (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-05-08 01:25:20,178 INFO ipc.Client
> (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-05-08 01:25:21,179 INFO ipc.Client
> (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 2 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-05-08 01:25:22,182 INFO ipc.Client
> (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 3 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-05-08 01:25:23,184 INFO ipc.Client
> (Client.java:handleConnectionFailure(740)) - Retrying connect to server:
> 0.0.0.0/0.0.0.0:8032. Already tried 4 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
>
>
> I have verified the component is listening to port 8032 in my localhost.
>
> Any insight why Tajo complain about connect failure?
>
>
> - Henry
>