You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Lisheng Sun (Jira)" <ji...@apache.org> on 2019/09/04 11:59:00 UTC

[jira] [Created] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

Lisheng Sun created HDFS-14820:
----------------------------------

             Summary:  The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big
                 Key: HDFS-14820
                 URL: https://issues.apache.org/jira/browse/HDFS-14820
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Lisheng Sun


this issue is similar to HDFS-14535.
{code:java}
public static BlockReader newBlockReader(String file,
    ExtendedBlock block,
    Token<BlockTokenIdentifier> blockToken,
    long startOffset, long len,
    boolean verifyChecksum,
    String clientName,
    Peer peer, DatanodeID datanodeID,
    PeerCache peerCache,
    CachingStrategy cachingStrategy,
    int networkDistance) throws IOException {
  // in and out will be closed when sock is closed (by the caller)
  final DataOutputStream out = new DataOutputStream(new BufferedOutputStream(
      peer.getOutputStream()));
  new Sender(out).readBlock(block, blockToken, clientName, startOffset, len,
      verifyChecksum, cachingStrategy);

public BufferedOutputStream(OutputStream out) {
    this(out, 8192);
}
{code}
Sender#readBlock parameter( block,blockToken, clientName, startOffset, len, verifyChecksum, cachingStrategy) could not use such a big buffer.
So i think it should reduce BufferedOutputStream buffer.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org