[jira] [Created] (HDFS-14481) BenchmarkThroughput.writeLocalFile hangs with misconfigured BUFFER_SIZE

["John Doe (JIRA)" <ji...@apache.org>]

John Doe created HDFS-14481:
-------------------------------

             Summary: BenchmarkThroughput.writeLocalFile hangs with misconfigured BUFFER_SIZE
                 Key: HDFS-14481
                 URL: https://issues.apache.org/jira/browse/HDFS-14481
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: test
    Affects Versions: 2.5.0
            Reporter: John Doe


When the configuration file is corrupted, reading BUFFER_SIZE from corrupted conf can return 0.
 The "for" loop in BenchmarkThroughput.writeLocalFile function hangs endlessly.
 Here is the code snippet.
{code:java}
  BUFFER_SIZE = conf.getInt("dfsthroughput.buffer.size", 4 * 1024);

  private Path writeLocalFile(String name, Configuration conf,
                                     long total) throws IOException {
    Path path = dir.getLocalPathForWrite(name, total, conf);
    System.out.print("Writing " + name);
    resetMeasurements();
    OutputStream out = new FileOutputStream(new File(path.toString()));
    byte[] data = new byte[BUFFER_SIZE];
    for(long size=0; size < total; size += BUFFER_SIZE) {//Bug!!!
      System.out.println("inside for loop...size = " + size);
      out.write(data);
    }
    out.close();
    printMeasurements();
    return path;
  }
{code}
This configuration error also affects HDFS-13513, HDFS-13514



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org