You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Arun Venugopal (JIRA)" <ji...@apache.org> on 2008/10/30 06:35:44 UTC
[jira] Created: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Minor fix in dfs to make hadoop work in AIX
-------------------------------------------
Key: HADOOP-4546
URL: https://issues.apache.org/jira/browse/HADOOP-4546
Project: Hadoop Core
Issue Type: Improvement
Components: dfs
Affects Versions: 0.18.1
Environment: AIX
Reporter: Arun Venugopal
Fix For: 0.18.1
HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Arun Venugopal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun Venugopal updated HADOOP-4546:
-----------------------------------
Attachment: dfs_aix_fix.patch
svn diff output of DF.java
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676651#action_12676651 ]
Bill Habermaas commented on HADOOP-4546:
----------------------------------------
The patch and supplied unit test work on AIX 6.1. I have run the Hadoop unit tests against my patched version also. Prior to the patch about 60 tests fail, after the patch only 2 fail for unrelated reasons (and I have created jira entries for those). I noticed that the junit test failed because disk space changed between calls. What do you recommend be done to rework the test so this patch will pass all requirements?
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Affects Version/s: (was: 0.20.0)
0.18.0
0.19.0
Remaining Estimate: (was: 24h)
Original Estimate: (was: 24h)
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.21.0
Status: Resolved (was: Patch Available)
All the unit tests passed, save org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.TestStartAtOffset, which is not related.
I committed this. Thanks, Bill
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12677527#action_12677527 ]
Chris Douglas commented on HADOOP-4546:
---------------------------------------
At this point we typically wait for Hudson to run its tests, but the queue is [disabled|http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Patch] for some reason, so I verified on my my machine:
{noformat}
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] -1 release audit. The applied patch generated 797 release audit warnings (more than the trunk's current 796 warnings).
{noformat}
I've no idea why this generated a release audit warning. The diff mentions something in the docs, which shouldn't be affected by the patch. The new unit test has a license header... I think it's spurious.
I'm running the unit tests now. All the core and HDFS tests have passed, so I expect this can go in today.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678079#action_12678079 ]
Chris Douglas commented on HADOOP-4546:
---------------------------------------
bq. I don't see any reason why this can't be included in 0.18.4 as the original code that is patched has not been changed over the last few releases.
That's not one of the criteria Hadoop uses to determine whether a patch should be backported. That the code is stable is an argument _against_ backporting this for two reasons. First, there are no known issues with it and any changes may destabilize it, requiring more maintenance releases. Second, applying the patch isn't unduly burdensome, neither does it require any special build instruction, so interested parties can apply this themselves. Hadoop's release criteria are conservative, in part because most organizations want to backport some subset of later releases into stable branches.
With few exceptions, the only patches that get pushed into older branches are those that fix behavior that was unintentionally and incompatibly broken in that branch or earlier. If it can be demonstrated that a previous version of Hadoop was compatible with AIX, then the patch can be pushed into previous releases, but lacking that it requires a special dispensation.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Arun Venugopal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun Venugopal updated HADOOP-4546:
-----------------------------------
Status: Patch Available (was: Open)
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Attachment: 4546-2.patch
Does this work on AIX?
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Status: Open (was: Patch Available)
bq. A minor comment about the patch: it would be nice if you can create a enum named DF.OSType that follows the pattern in src.core.org.apache.fs.FileUtil.HardLink.OSType. Then it will be elegant to add newer platform support for DF parsing in the future.
+1 (and the unit test).
So Hudson can apply the patch, would you mind generating it from the root? It should apply cleanly with {{patch \-p0 < _file_}}
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678068#action_12678068 ]
Bill Habermaas commented on HADOOP-4546:
----------------------------------------
I see this still didn't get through Hudson again.
For what it might be worth, I applied 4546-2.patch to 0.18.3 when I did all my unit testing on AIX (I don't have a Java6 running on my AIX).
I don't see any reason why this can't be included in 0.18.4 as the original code that is patched has not been changed over the last few releases.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas reassigned HADOOP-4546:
-------------------------------------
Assignee: Bill Habermaas
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1, 0.18.2, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Attachment: 4546-1.patch
Merged original patch and unit test.
{noformat}
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
{noformat}
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1, 0.18.2, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: 4546-1.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
bq. I'm reopening this issue to resubmit patch to hudson.. For some reason hudson didnt accept this patch..( possibly a jira issue)
The issue has been resolved and the patch committed to the repository. I'm assuming this was accidental and part of a batch operation, but please accept my apologies if I misunderstand your purpose. I'm re-marking this as "resolved".
bq. I see this is noted as fixed on 0.21 - any way it can be applied to 0.18.4? It needs to be available for Java5 as well as Java6. AIX users are likely to need the Java5 version. Or will the patch get applied to the Java5 version?
Unfortunately, it's not likely to be applied to any branch prior to 0.21 since this isn't a regression. If this worked on AIX for some previous, released version of Hadoop, then one could argue that the fix should be backported, but I don't think that's the case. Neither am I certain we're going to roll an 0.18.4 release, anyway. Does AIX not have a Java6 port?
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-4546) Minor fix in dfs to make
hadoop work in AIX
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678796#action_12678796 ]
aw edited comment on HADOOP-4546 at 3/4/09 9:25 AM:
------------------------------------------------------------------
[ignore me, i'm thinking of a different problem]
was (Author: aw):
Actually, this would be a regression. Hadoop should have worked fine prior to 0.16 when permissions were added. Until then, Hadoop didn't do callouts to whoami, groups, etc.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Status: Open (was: Patch Available)
The unit test is likely to fail; one can't assume that disk space won't change between calls. A unit test validating the parsing would make more sense.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.19.0, 0.18.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Status: Patch Available (was: Open)
bq. Patch 4546-2.patch has been applied and tested on AIX 6.1 and it works. I assume that is what you are asking.
Yes, that's what I was asking. If Hudson is OK with this, I think it can be committed
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.19.0, 0.18.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12677381#action_12677381 ]
Bill Habermaas commented on HADOOP-4546:
----------------------------------------
Chris: Ok, is there something I need to do for this to move along.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644774#action_12644774 ]
dhruba borthakur commented on HADOOP-4546:
------------------------------------------
Hi Arun, your patch looks good. Would it be possible for you to write a unit test as Steve suggested? The details are explained in http://wiki.apache.org/hadoop/HowToContribute
A minor comment about the patch: it would be nice if you can create a enum named DF.OSType that follows the pattern in src.core.org.apache.fs.FileUtil.HardLink.OSType. Then it will be elegant to add newer platform support for DF parsing in the future.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated HADOOP-4546:
---------------------------------------
Status: Patch Available (was: Reopened)
resubmitting patch
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.19.0, 0.18.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644891#action_12644891 ]
Hadoop QA commented on HADOOP-4546:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12393233/dfs_aix_fix.patch
against trunk revision 709609.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 patch. The patch command could not apply the patch.
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3522/console
This message is automatically generated.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643809#action_12643809 ]
Steve Loughran commented on HADOOP-4546:
----------------------------------------
although this will be hard to test on non AIX systems, if the parsing is decoupled from the execution, you could have junit tests that verify you can parse AIX output just by handing static strings of df output to the parser. this would keep coverage up and catch regressions early.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676459#action_12676459 ]
Hadoop QA commented on HADOOP-4546:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12400881/4546-1.patch
against trunk revision 747332.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3913/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3913/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3913/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3913/console
This message is automatically generated.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4546:
----------------------------------
Affects Version/s: (was: 0.18.2)
(was: 0.18.1)
(was: 0.19.0)
0.20.0
Hadoop Flags: [Reviewed]
Status: Patch Available (was: Open)
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.20.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678106#action_12678106 ]
Bill Habermaas commented on HADOOP-4546:
----------------------------------------
Thanks for clarifying the issues. This fix goes back to early november when 0.18 was the current release. It's a shame that this couldn't make it into the system back then. Anyway, thanks for your help. much appreciated.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12677720#action_12677720 ]
Bill Habermaas commented on HADOOP-4546:
----------------------------------------
Thanks for your help Chris. I see this is noted as fixed on 0.21 - any way it can be applied to 0.18.4? It needs to be available for Java5 as well as Java6. AIX users are likely to need the Java5 version. Or will the patch get applied to the Java5 version?
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12677136#action_12677136 ]
Bill Habermaas commented on HADOOP-4546:
----------------------------------------
Chris: Patch 4546-2.patch has been applied and tested on AIX 6.1 and it works. I assume that is what you are asking. I have also run the test-core unit tests as well with the expected good results.
Can we give this another shot?
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678065#action_12678065 ]
Hadoop QA commented on HADOOP-4546:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12400901/4546-2.patch
against trunk revision 749318.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/32/console
This message is automatically generated.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Habermaas updated HADOOP-4546:
-----------------------------------
Affects Version/s: 0.18.2
0.19.0
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1, 0.18.2, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Habermaas updated HADOOP-4546:
-----------------------------------
Attachment: hadoop-4546.patch
TestDFVariations.java
The original patch author says he does not have an AIX system to finish this fix. I have made the suggested revision to the source, written a unit test, and tested the patch/unit test on AIX 6.1(in addition to running the normal ANT junit tests on that system). If I need to take further action to ensure this fix becomes permanently included in the system then please provide further guidance.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1, 0.18.2, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644559#action_12644559 ]
dhruba borthakur commented on HADOOP-4546:
------------------------------------------
It would be really nice if you could a submit a patch for this one. I am suspecting that the code changes will be concentrated in src/core/org/apache/hadoop/fs/DF.java. A syntax similar to src.core.org.apache.fs.FileUtil.HardLink can be followed.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12671010#action_12671010 ]
dhruba borthakur commented on HADOOP-4546:
------------------------------------------
@Chris: will appreciate it a lot if you can review this patch one more time. Thanks a bunch!
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1, 0.18.2, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678796#action_12678796 ]
Allen Wittenauer commented on HADOOP-4546:
------------------------------------------
Actually, this would be a regression. Hadoop should have worked fine prior to 0.16 when permissions were added. Until then, Hadoop didn't do callouts to whoami, groups, etc.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Bill Habermaas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678070#action_12678070 ]
Bill Habermaas commented on HADOOP-4546:
----------------------------------------
I just checked the repository and the patch has been committed to trunk. So that is why it didn't apply when resubmitted.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681785#action_12681785 ]
Hudson commented on HADOOP-4546:
--------------------------------
Integrated in Hadoop-trunk #778 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/778/])
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-4546:
--------------------------------
Fix Version/s: (was: 0.18.1)
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (HADOOP-4546) Minor fix in dfs to make hadoop work
in AIX
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan reopened HADOOP-4546:
----------------------------------------
I'm reopening this issue to resubmit patch to hudson.. For some reason hudson didnt accept this patch..( possibly a jira issue)
tnx!
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.0, 0.19.0
> Environment: AIX
> Reporter: Arun Venugopal
> Assignee: Bill Habermaas
> Fix For: 0.21.0
>
> Attachments: 4546-1.patch, 4546-2.patch, dfs_aix_fix.patch, hadoop-4546.patch, TestDFVariations.java
>
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4546) Minor fix in dfs to make hadoop
work in AIX
Posted by "Arun Venugopal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644650#action_12644650 ]
Arun Venugopal commented on HADOOP-4546:
----------------------------------------
I am not sure how a patch should be created. I assume it would be a diff output. I have attached the diff output of the changes I have made to make it work on AIX. Hope this helps.
> Minor fix in dfs to make hadoop work in AIX
> -------------------------------------------
>
> Key: HADOOP-4546
> URL: https://issues.apache.org/jira/browse/HADOOP-4546
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.18.1
> Environment: AIX
> Reporter: Arun Venugopal
> Attachments: dfs_aix_fix.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HDFS uses df command to get the disk space. The output format of df command is different in AIX compared to Linux and Solaris. Checking the OS type and then reading the df output as per the format will fix this issue and thus allows hadoop to be fully functional in AIX environment.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.