You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "eric baldeschwieler (JIRA)" <ji...@apache.org> on 2009/05/18 06:27:45 UTC
[jira] Created: (HADOOP-5862) Namespace quota exceeded message
unclear
Namespace quota exceeded message unclear
----------------------------------------
Key: HADOOP-5862
URL: https://issues.apache.org/jira/browse/HADOOP-5862
Project: Hadoop Core
Issue Type: Bug
Reporter: eric baldeschwieler
We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
Finally, the error below would be clearer if it read:
Quota exceeded for directory '/user/ciyaliao'.
By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
------ AN EXAMPLE -----
> Hi,
>
> I encountered an error:
>
> put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> /user/x is exceeded: namespace quota=200000 file count=200001,
> diskspace quota=-1 diskspace=-44221467605496
>
> It apparently complains that dfs quota is exceeded. But I only use around
> 200GB disk space. From the error message, what kind of quota did I actually
> exceed? How do I check my usage of this type of quota?
>
> Thanks,
> x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Patch Available (was: Open)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862-1.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720134#action_12720134 ]
Hadoop QA commented on HADOOP-5862:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12410042/HADOOP-5862.patch
against trunk revision 785065.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 14 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
-1 release audit. The applied patch generated 495 release audit warnings (more than the trunk's current 494 warnings).
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/504/testReport/
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/504/artifact/trunk/patchprocess/releaseAuditDiffWarnings.txt
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/504/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/504/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/504/console
This message is automatically generated.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Fix Version/s: (was: 0.20.1)
Affects Version/s: (was: 0.18.0)
Status: Patch Available (was: Open)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713686#action_12713686 ]
Boris Shkolnik commented on HADOOP-5862:
----------------------------------------
Suggested wording for the namespace quota:
The NameSpace quota (maximum allowed number of files) of directory /test is exceeded: quota=2 file count=3
For disk quota:
The DiskSpace quota of /test is exceeded: quota=45000 diskspace count=70656
I will also modify TestQuota and TestHDFSCLI tests .
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Attachment: HADOOP-5862.patch
synced with trunk to fix the patch
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Fix For: 0.20.1
>
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716448#action_12716448 ]
Hadoop QA commented on HADOOP-5862:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12409707/HADOOP-5862.patch
against trunk revision 781816.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 13 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/463/console
This message is automatically generated.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Fix For: 0.20.1
>
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714961#action_12714961 ]
Raghu Angadi commented on HADOOP-5862:
--------------------------------------
The patch looks good. A few comments apart from Nicholas comment above.
# Need to makes sure help for command line quota commands and documentation user guide reflect the new behaviour.
# In the Exception message, it might be better to replace "diskspace count=" with something like "diskspace consumed=". "count" might confuse users.
# Currently {{FSDirectory.updateCountForInodeWithQuota()}} warns when a directory exceeds quota. The warning text implies it is a software error (or corruption in the image) since it is not expected. The wording in the warning could be changed to be less severe.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Attachment: HADOOP-5862.patch
changed dfsadmin help
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Open (was: Patch Available)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862-1.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Patch Available (was: Open)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722147#action_12722147 ]
Hadoop QA commented on HADOOP-5862:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12411135/HADOOP-5862-1.patch
against trunk revision 786278.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 14 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/537/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/537/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/537/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/537/console
This message is automatically generated.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Common
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862-1.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713225#action_12713225 ]
Boris Shkolnik commented on HADOOP-5862:
----------------------------------------
Fixing together with HADOOP-5872.
1. allowing to set quota even if the current usage goes over the quota.
2. creating two separate exception for NameSpace and DiskSpace quota (both extending QuotaExceededException).
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719741#action_12719741 ]
Boris Shkolnik commented on HADOOP-5862:
----------------------------------------
Running test-patch on Friday, June 12, 09
[exec]
[exec]
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 14 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
[exec]
[exec]
[exec]
[exec] ======================================================================
[exec] ======================================================================
[exec] Finished build.
[exec] ======================================================================
[exec] ======================================================================
[exec]
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Attachment: HADOOP-5862.patch
implemented all of the above.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "eric baldeschwieler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713443#action_12713443 ]
eric baldeschwieler commented on HADOOP-5862:
---------------------------------------------
cool! thanks!
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Attachment: HADOOP-5862.patch
Implemented most of the comments.
(left warning, but changed the wording).
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Open (was: Patch Available)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Attachment: HADOOP-5862-1.patch
resynced with trunk
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862-1.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Patch Available (was: Open)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Open (was: Patch Available)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-5862) Namespace quota exceeded
message unclear
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713692#action_12713692 ]
Jakob Homan edited comment on HADOOP-5862 at 5/27/09 12:01 PM:
---------------------------------------------------------------
For the diskspace quota, is it worth putting the numbers into MB, GB, etc for human consumption? On a large cluster with a large quota the formatted number would probably be more easily groked.
was (Author: jghoman):
For the diskspace quota, is it worth putting the numbers into MB, GB, etc for human consumption? On a large cluster with a large quota the unformatted number would probably be more easily groked.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715702#action_12715702 ]
Raghu Angadi commented on HADOOP-5862:
--------------------------------------
I think you forgot to fix 'hdfs dfsadmin -help' for these commands.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721472#action_12721472 ]
Boris Shkolnik commented on HADOOP-5862:
----------------------------------------
[exec] /home/sureshms/tools/buildtools/ant/apache-ant-1.7.1/bin/ant -Dversion=PATCH-HADOOP-5862-1.patch -Djava5.home=/usr/releng/tools/java/jdk1.5.0_06 -Dforrest.home=/home/ndaley/tools/forrest/latest -DHadoopPatchProcess= releaseaudit > ../scratch_dir//patchReleaseAuditWarnings.txt 2>&1
[exec]
[exec]
[exec] There appear to be 499 release audit warnings before the patch and 499 release audit warnings after applying the patch.
[exec]
[exec]
[exec]
[exec]
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 14 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
[exec]
[exec]
[exec]
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862-1.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713794#action_12713794 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-5862:
------------------------------------------------
Hi Boris, NameSpace quota not only counts files but also directories. It counts all "names".
{code}
+ return "The NameSpace quota (maximum allowed number of files)" + ...
{code}
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715719#action_12715719 ]
Raghu Angadi commented on HADOOP-5862:
--------------------------------------
+1.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Open (was: Patch Available)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Patch Available (was: Open)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713692#action_12713692 ]
Jakob Homan commented on HADOOP-5862:
-------------------------------------
For the diskspace quota, is it worth putting the numbers into MB, GB, etc for human consumption? On a large cluster with a large quota the unformatted number would probably be more easily groked.
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-5862:
------------------------------------
Component/s: dfs
Affects Version/s: 0.18.0
Fix Version/s: 0.20.1
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Fix For: 0.20.1
>
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Open (was: Patch Available)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Fix For: 0.20.1
>
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated HADOOP-5862:
-----------------------------------
Status: Patch Available (was: Open)
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
> Attachments: HADOOP-5862.patch, HADOOP-5862.patch, HADOOP-5862.patch
>
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-5862) Namespace quota exceeded message
unclear
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik reassigned HADOOP-5862:
--------------------------------------
Assignee: Boris Shkolnik
> Namespace quota exceeded message unclear
> ----------------------------------------
>
> Key: HADOOP-5862
> URL: https://issues.apache.org/jira/browse/HADOOP-5862
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: eric baldeschwieler
> Assignee: Boris Shkolnik
>
> We seem to return one generic message when either a namespace or diskspace quota is exceeded. We should be clearer. The error should state which quota is exceeded and only report statistics on the exceeded quota.
> Further namespace quota is probably not clear to most users. We should probably have explanatory text such as: "you have exceeded the maximum allowed number of files". Maybe we should even rename the quota to number of files quota?
> Finally, the error below would be clearer if it read:
> Quota exceeded for directory '/user/ciyaliao'.
> By not using the word "directory" it is not clear in this case if the issue is with a user or a directory.
> ------ AN EXAMPLE -----
> > Hi,
> >
> > I encountered an error:
> >
> > put: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of
> > /user/x is exceeded: namespace quota=200000 file count=200001,
> > diskspace quota=-1 diskspace=-44221467605496
> >
> > It apparently complains that dfs quota is exceeded. But I only use around
> > 200GB disk space. From the error message, what kind of quota did I actually
> > exceed? How do I check my usage of this type of quota?
> >
> > Thanks,
> > x
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.