You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "John Doe (JIRA)" <ji...@apache.org> on 2018/04/27 19:52:00 UTC

[jira] [Created] (HDFS-13514) BenchmarkThroughput.readLocalFile hangs with misconfigured BUFFER_SIZE

John Doe created HDFS-13514:
-------------------------------

             Summary: BenchmarkThroughput.readLocalFile hangs with misconfigured BUFFER_SIZE
                 Key: HDFS-13514
                 URL: https://issues.apache.org/jira/browse/HDFS-13514
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: test
    Affects Versions: 2.5.0
            Reporter: John Doe


When the BUFFER_SIZE is configured to be 0, the while loop in BenchmarkThroughput.readLocalFile function hangs endlessly.
This is because when the data.size (i.e., BUFFER_SIZE) is 0, the val will always be 0 by invoking val=in.read(data).
Here is the code snippet.
{code:java}
  BUFFER_SIZE = conf.getInt("dfsthroughput.buffer.size", 4 * 1024);//when dfsthroughput.buffer.size is configued to be 0

  private void readLocalFile(Path path, String name, Configuration conf) throws IOException {
    System.out.print("Reading " + name);
    resetMeasurements();
    InputStream in = new FileInputStream(new File(path.toString()));
    byte[] data = new byte[BUFFER_SIZE];
    long size = 0;
    while (size >= 0) {
      size = in.read(data);
    }
    in.close();
    printMeasurements();
  }
{code}
The similar case is HDFS-13513



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org