You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Sean Zhang (Created) (JIRA)" <ji...@apache.org> on 2012/03/16 07:09:43 UTC
[jira] [Created] (WHIRR-560) starting instances fails for cloudera
cdh3u2
starting instances fails for cloudera cdh3u2
--------------------------------------------
Key: WHIRR-560
URL: https://issues.apache.org/jira/browse/WHIRR-560
Project: Whirr
Issue Type: Bug
Components: service/cdh
Affects Versions: 0.7.1
Reporter: Sean Zhang
Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
Here is the conf file:
whirr.cluster-name=hadoop
whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
whirr.env.repo=cdh3u2
whirr.hadoop.install-function=install_cdh_hadoop
whirr.hadoop.configure-function=configure_cdh_hadoop
whirr.provider=aws-ec2
whirr.identity=<deleted>
whirr.credential=<deleted>
whirr.hardware-id=t1.micro
whirr.image-id=us-east-1/ami-baba68d3
whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] [Created] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by Andrei Savu <sa...@gmail.com>.
Please try with a larger instance, t1.micro is not enough for Hadoop.
On Mar 16, 2012 8:10 AM, "Sean Zhang (Created) (JIRA)" <ji...@apache.org>
wrote:
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
>
>
> Seems to me that the installation of the openJDK failed. The failure is
> not consistent. It fails for me for more than 50% of times. It only fails
> when "whirr.env.repo=cdh3u2" is specified. coincidence?
>
> Here is the conf file:
>
> whirr.cluster-name=hadoop
> whirr.instance-templates=1
> hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
>
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
>
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators:
> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
[jira] [Commented] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by "Sean Zhang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231845#comment-13231845 ]
Sean Zhang commented on WHIRR-560:
----------------------------------
I have also tried to use another image. Everything works out after I changed to ubuntu 10.04 (us-east-1/ami-349b495d).
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231205#comment-13231205 ]
Andrei Savu commented on WHIRR-560:
-----------------------------------
Does it work if you use a larger instance? I think this is the root cause here.
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13232489#comment-13232489 ]
Andrei Savu commented on WHIRR-560:
-----------------------------------
Nope. What OS would you like to be tested as part of the release process?
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by "Sean Zhang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13232170#comment-13232170 ]
Sean Zhang commented on WHIRR-560:
----------------------------------
Andrei, Thanks for your help. us-east-1/ami-baba68d3 is ubuntu 11.10 x64. Since we are on this topic, is there any other OS tested regularly?
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231921#comment-13231921 ]
Andrei Savu commented on WHIRR-560:
-----------------------------------
We are running all the integration tests on Ubuntu 10.04. I will go through your logs. What OS is us-east-1/ami-baba68d3?
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by "Sean Zhang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231840#comment-13231840 ]
Sean Zhang commented on WHIRR-560:
----------------------------------
I tried a large instance. It didn't work. I looked at the /tmp/logs dir on the instance. The error was the same as micro instance (badlogs.tar.gz).
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-560) starting instances fails for cloudera
cdh3u2
Posted by "Sean Zhang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Zhang updated WHIRR-560:
-----------------------------
Attachment: badlogs.tar.gz
Here is the entire /tmp dir on the instance when the configuration fails. I hope someone can find clue in it.
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-560) starting instances fails for
cloudera cdh3u2
Posted by "Sean Zhang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13232621#comment-13232621 ]
Sean Zhang commented on WHIRR-560:
----------------------------------
No, noting in particular. 10.04 is good enough for me.
> starting instances fails for cloudera cdh3u2
> --------------------------------------------
>
> Key: WHIRR-560
> URL: https://issues.apache.org/jira/browse/WHIRR-560
> Project: Whirr
> Issue Type: Bug
> Components: service/cdh
> Affects Versions: 0.7.1
> Reporter: Sean Zhang
> Attachments: badlogs.tar.gz
>
>
> Seems to me that the installation of the openJDK failed. The failure is not consistent. It fails for me for more than 50% of times. It only fails when "whirr.env.repo=cdh3u2" is specified. coincidence?
> Here is the conf file:
> whirr.cluster-name=hadoop
> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker+hadoop-datanode+hadoop-tasktracker
> whirr.env.repo=cdh3u2
> whirr.hadoop.install-function=install_cdh_hadoop
> whirr.hadoop.configure-function=configure_cdh_hadoop
> whirr.provider=aws-ec2
> whirr.identity=<deleted>
> whirr.credential=<deleted>
> whirr.hardware-id=t1.micro
> whirr.image-id=us-east-1/ami-baba68d3
> whirr.location-id=us-east-1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira