You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2010/09/23 21:26:32 UTC
[jira] Created: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Hadoop on EC2 does not use the /mnt partition
---------------------------------------------
Key: WHIRR-101
URL: https://issues.apache.org/jira/browse/WHIRR-101
Project: Whirr
Issue Type: Bug
Components: service/hadoop
Reporter: Tom White
Fix For: 0.2.0
It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917410#action_12917410 ]
Adrian Cole commented on WHIRR-101:
-----------------------------------
I'm ok with this for a bug fix.
Here's more for the more complete issue:
it looks like alestic and rightscale images mount the first ephemeral disk onto /mnt. According to the amazon linux guide:
"The ephemeral drive ephemeral0 is mounted in /media/ephmeral0 only on S3 backed AMIs."
When we address this holistically, we may need to have a script that arranges the fstab and formats volumes accordingly, possibly using lvm or something to span disks together. Then, we can have a clear mount setup that whirr is authoritative for.
my 2p.
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch, WHIRR-101.patch, WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-101:
----------------------------
Status: Patch Available (was: Open)
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch, WHIRR-101.patch, WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-101:
----------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
I've just committed this.
I opened WHIRR-111 for the larger issue.
bq. my 2p.
Glad to see you're using the local currency!
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch, WHIRR-101.patch, WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-101:
----------------------------
Attachment: WHIRR-101.patch
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch, WHIRR-101.patch, WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917374#action_12917374 ]
Tom White commented on WHIRR-101:
---------------------------------
Adrian - yes, this is definitely a better approach - thanks for pointing it out. I'm tempted to commit the current patch as an interim fix and open a new JIRA to take advantage of the Volume objects (this might tie in with adding EBS support too). Thoughts?
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch, WHIRR-101.patch, WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-101:
----------------------------
Attachment: WHIRR-101.patch
Minor update to patch to pass cloud provider string to workers for installation script. Tested (with WHIRR-107 too) and manually checked that data was being stored on /mnt on EC2.
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch, WHIRR-101.patch, WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-101:
----------------------------
Attachment: WHIRR-101.patch
This should fix it, but I haven't been able to test it because I'm having problems connecting to EC2 instances once they start.
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917317#action_12917317 ]
Adrian Cole commented on WHIRR-101:
-----------------------------------
there's another approach we could use.
once the template is built, look at template.hardware.volumes. In ec2, this has the exact mount points for the ephemeral and ebs volumes attached
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch, WHIRR-101.patch, WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (WHIRR-101) Hadoop on EC2 does not use the /mnt
partition
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White reassigned WHIRR-101:
-------------------------------
Assignee: Tom White
> Hadoop on EC2 does not use the /mnt partition
> ---------------------------------------------
>
> Key: WHIRR-101
> URL: https://issues.apache.org/jira/browse/WHIRR-101
> Project: Whirr
> Issue Type: Bug
> Components: service/hadoop
> Reporter: Tom White
> Assignee: Tom White
> Fix For: 0.2.0
>
> Attachments: WHIRR-101.patch
>
>
> It uses /data which is too small.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.