You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "John Doe (JIRA)" <ji...@apache.org> on 2018/04/27 19:47:00 UTC
[jira] [Created] (HDFS-13513) BenchmarkThroughput.readFile hangs
with misconfigured BUFFER_SIZE
John Doe created HDFS-13513:
-------------------------------
Summary: BenchmarkThroughput.readFile hangs with misconfigured BUFFER_SIZE
Key: HDFS-13513
URL: https://issues.apache.org/jira/browse/HDFS-13513
Project: Hadoop HDFS
Issue Type: Bug
Components: test
Reporter: John Doe
Fix For: 2.5.0
When the BUFFER_SIZE is configured to be 0, the while loop in BenchmarkThroughput.readFile function hangs endlessly.
This is because when the data.size (i.e., BUFFER_SIZE) is 0, the val will always be 0 by invoking val=in.read(data).
Here is the code snippet.
{code:java}
BUFFER_SIZE = conf.getInt("dfsthroughput.buffer.size", 4 * 1024);//when dfsthroughput.buffer.size is configued to be 0
private void readFile(FileSystem fs, Path f, String name, Configuration conf ) throws IOException {
System.out.print("Reading " + name);
resetMeasurements();
InputStream in = fs.open(f);
byte[] data = new byte[BUFFER_SIZE];
long val = 0;
while (val >= 0) {
val = in.read(data);
}
in.close();
printMeasurements();
}
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org