You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Konstantin Shvachko (JIRA)" <ji...@apache.org> on 2010/08/28 03:22:55 UTC
[jira] Created: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Add -fileStatus operation to NNThroughputBenchmark
--------------------------------------------------
Key: HDFS-1361
URL: https://issues.apache.org/jira/browse/HDFS-1361
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 0.22.0
Reporter: Konstantin Shvachko
Assignee: Konstantin Shvachko
Fix For: 0.22.0
getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated HDFS-1361:
-------------------------------------
Status: Patch Available (was: Open)
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907891#action_12907891 ]
Hudson commented on HDFS-1361:
------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #383 (See [https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/383/])
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HDFS-1361:
--------------------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
I just committed this.
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HDFS-1361:
--------------------------------------
Status: Patch Available (was: Open)
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12906983#action_12906983 ]
Konstantin Shvachko commented on HDFS-1361:
-------------------------------------------
Tests pass.
test-patch results:
{code}
. [exec] -1 overall.
[exec] +1 @author. The patch does not contain any @author tags.
[exec] +1 tests included. The patch appears to include 6 new or modified tests.
[exec] -1 javadoc. The javadoc tool appears to have generated 1 warning messages.
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec] +1 system tests framework. The patch passed system tests framework compile.
[exec] ======================================================================
[exec] ======================================================================
[exec] Finished build.
[exec] ======================================================================
[exec] ======================================================================
{code}
The javadoc warning is fixed by HDFS-1369.
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated HDFS-1361:
-------------------------------------
Status: Open (was: Patch Available)
re-submitting to hudson
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jakob Homan updated HDFS-1361:
------------------------------
Hadoop Flags: [Reviewed]
+1, although this class is due for a refactor.
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1361) Add -fileStatus operation to
NNThroughputBenchmark
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HDFS-1361:
--------------------------------------
Attachment: NNThroughput-fileStatus.patch
The patch introduces -fileStatus operation. It is run similar to open or delete ops.
I also converted TestNNThroughputBenchmark to a Junit-4 test and added a description of "advanced" options to JavaDoc.
This benchmark was used to compare performance of debug() messages in HADOOP-6884.
> Add -fileStatus operation to NNThroughputBenchmark
> --------------------------------------------------
>
> Key: HDFS-1361
> URL: https://issues.apache.org/jira/browse/HDFS-1361
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Fix For: 0.22.0
>
> Attachments: NNThroughput-fileStatus.patch
>
>
> getFileStatus() is a frequently used operation in HDFS. It important to benchmark the name-node throughput on it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.