You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Cam Macdonell <ca...@cs.ualberta.ca> on 2009/08/24 18:59:57 UTC

Can't find TestDFSIO

Hi,

I'm trying to run the TestDFSIO benchmark that is mentioned in the 
hadoop o'reilly book.  However, I can't find it in any of the jars 
(common, mapred or hdfs).

For example, I presume it would be under hdfs, but the only mentioned 
test is 'dfsthroughput'.

$ ./bin/hadoop jar 
/home/cam/research/SVN/hadoop/lib/hadoop-hdfs-test-0.21.0-dev.jar
An example program must be given as the first argument.
Valid program names are:
   dfsthroughput: measure hdfs throughput

Has the name of TestDFSIO changed or am I looking in the wrong place?

Any tips or pointers are appreciated,
Cam

Re: Can't find TestDFSIO

Posted by Tom White <to...@cloudera.com>.

Hi Cam,

Looks like it's in hadoop-hdfs-hdfswithmr-test-0.21.0-dev.jar, which
should be built with "ant jar-test".

Cheers,
Tom

On Mon, Aug 24, 2009 at 8:22 PM, Cam Macdonell<ca...@cs.ualberta.ca> wrote:
>
> Thanks Danny,
>
> It currently does not show up hadoop-common-test, hadoop-hdfs-test or
> hadoop-mapred-test with 0.21-dev.  So either it has been a victim of the
> project split or I didn't specify the right target for Ant.
>
> Cam
>
> Gross, Danny wrote:
>>
>> Hi Cam,
>>
>> For what it's worth, in 19.1, I see TestDFSIO in the
>> hadoop-0.19.1-test.jar.
>> Best regards,
>>
>> Danny
>>
>> -----Original Message-----
>> From: Cam Macdonell [mailto:cam@cs.ualberta.ca] Sent: Monday, August 24,
>> 2009 12:00 PM
>> To: common-user@hadoop.apache.org
>> Subject: Can't find TestDFSIO
>>
>>
>> Hi,
>>
>> I'm trying to run the TestDFSIO benchmark that is mentioned in the hadoop
>> o'reilly book.  However, I can't find it in any of the jars (common, mapred
>> or hdfs).
>>
>> For example, I presume it would be under hdfs, but the only mentioned test
>> is 'dfsthroughput'.
>>
>> $ ./bin/hadoop jar
>> /home/cam/research/SVN/hadoop/lib/hadoop-hdfs-test-0.21.0-dev.jar
>> An example program must be given as the first argument.
>> Valid program names are:
>>   dfsthroughput: measure hdfs throughput
>>
>> Has the name of TestDFSIO changed or am I looking in the wrong place?
>>
>> Any tips or pointers are appreciated,
>> Cam
>

Re: Can't find TestDFSIO

Posted by Cam Macdonell <ca...@cs.ualberta.ca>.

Thanks Danny,

It currently does not show up hadoop-common-test, hadoop-hdfs-test or 
hadoop-mapred-test with 0.21-dev.  So either it has been a victim of the 
project split or I didn't specify the right target for Ant.

Cam

Gross, Danny wrote:
> Hi Cam,
> 
> For what it's worth, in 19.1, I see TestDFSIO in the
> hadoop-0.19.1-test.jar. 
> 
> Best regards,
> 
> Danny
> 
> -----Original Message-----
> From: Cam Macdonell [mailto:cam@cs.ualberta.ca] 
> Sent: Monday, August 24, 2009 12:00 PM
> To: common-user@hadoop.apache.org
> Subject: Can't find TestDFSIO
> 
> 
> Hi,
> 
> I'm trying to run the TestDFSIO benchmark that is mentioned in the 
> hadoop o'reilly book.  However, I can't find it in any of the jars 
> (common, mapred or hdfs).
> 
> For example, I presume it would be under hdfs, but the only mentioned 
> test is 'dfsthroughput'.
> 
> $ ./bin/hadoop jar 
> /home/cam/research/SVN/hadoop/lib/hadoop-hdfs-test-0.21.0-dev.jar
> An example program must be given as the first argument.
> Valid program names are:
>    dfsthroughput: measure hdfs throughput
> 
> Has the name of TestDFSIO changed or am I looking in the wrong place?
> 
> Any tips or pointers are appreciated,
> Cam

RE: Can't find TestDFSIO

Posted by "Gross, Danny" <Da...@spansion.com>.

Hi Cam,

For what it's worth, in 19.1, I see TestDFSIO in the
hadoop-0.19.1-test.jar. 

Best regards,

Danny

-----Original Message-----
From: Cam Macdonell [mailto:cam@cs.ualberta.ca] 
Sent: Monday, August 24, 2009 12:00 PM
To: common-user@hadoop.apache.org
Subject: Can't find TestDFSIO


Hi,

I'm trying to run the TestDFSIO benchmark that is mentioned in the 
hadoop o'reilly book.  However, I can't find it in any of the jars 
(common, mapred or hdfs).

For example, I presume it would be under hdfs, but the only mentioned 
test is 'dfsthroughput'.

$ ./bin/hadoop jar 
/home/cam/research/SVN/hadoop/lib/hadoop-hdfs-test-0.21.0-dev.jar
An example program must be given as the first argument.
Valid program names are:
   dfsthroughput: measure hdfs throughput

Has the name of TestDFSIO changed or am I looking in the wrong place?

Any tips or pointers are appreciated,
Cam