You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2008/01/30 02:05:38 UTC

[jira] Created: (HADOOP-2736) Random read benchmark for DFS

Random read benchmark for DFS
-----------------------------

                 Key: HADOOP-2736
                 URL: https://issues.apache.org/jira/browse/HADOOP-2736
             Project: Hadoop Core
          Issue Type: New Feature
            Reporter: Raghu Angadi
             Fix For: 0.17.0



We should have at least one  random read benchmark that can be run with rest of Hadoop benchmarks regularly.

Please provide benchmark  ideas or requirements.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-2736) Random read benchmark for DFS

Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Chansler updated HADOOP-2736:
------------------------------------

    Fix Version/s:     (was: 0.17.0)

> Random read benchmark for DFS
> -----------------------------
>
>                 Key: HADOOP-2736
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2736
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>
> We should have at least one  random read benchmark that can be run with rest of Hadoop benchmarks regularly.
> Please provide benchmark  ideas or requirements.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (HADOOP-2736) Random read benchmark for DFS

Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi reassigned HADOOP-2736:
------------------------------------

    Assignee: Raghu Angadi

> Random read benchmark for DFS
> -----------------------------
>
>                 Key: HADOOP-2736
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2736
>             Project: Hadoop Core
>          Issue Type: New Feature
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>             Fix For: 0.17.0
>
>
> We should have at least one  random read benchmark that can be run with rest of Hadoop benchmarks regularly.
> Please provide benchmark  ideas or requirements.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-2736) Random read benchmark for DFS

Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Chansler updated HADOOP-2736:
------------------------------------

    Component/s: dfs
    Description: 
We should have at least one  random read benchmark that can be run with rest of Hadoop benchmarks regularly.

Please provide benchmark  ideas or requirements.

  was:

We should have at least one  random read benchmark that can be run with rest of Hadoop benchmarks regularly.

Please provide benchmark  ideas or requirements.


> Random read benchmark for DFS
> -----------------------------
>
>                 Key: HADOOP-2736
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2736
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>             Fix For: 0.17.0
>
>
> We should have at least one  random read benchmark that can be run with rest of Hadoop benchmarks regularly.
> Please provide benchmark  ideas or requirements.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HADOOP-2736) Random read benchmark for DFS

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12564152#action_12564152 ] 

Doug Cutting commented on HADOOP-2736:
--------------------------------------

TestSetFile tests random access.  The unit test creates a SetFile containing 10,000 RandomDatum instances, then seeks to sqrt(10,000)=100 random entries in that file and checks that the expected entry is found.

We could also run it on a MiniDFS cluster, specifying a small block size (~32kb?) to test random access on HDFS.

We might also specify block compression for a run, to better test seeks within a block-compressed SequenceFile.


> Random read benchmark for DFS
> -----------------------------
>
>                 Key: HADOOP-2736
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2736
>             Project: Hadoop Core
>          Issue Type: New Feature
>            Reporter: Raghu Angadi
>             Fix For: 0.17.0
>
>
> We should have at least one  random read benchmark that can be run with rest of Hadoop benchmarks regularly.
> Please provide benchmark  ideas or requirements.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.