You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "J.Andreina (JIRA)" <ji...@apache.org> on 2015/10/09 05:26:26 UTC

[jira] [Created] (YARN-4244) BlockPlacementPolicy related logs should contain the details about the filename and blockid

J.Andreina created YARN-4244:
--------------------------------

             Summary: BlockPlacementPolicy related logs should contain the details about the filename and blockid
                 Key: YARN-4244
                 URL: https://issues.apache.org/jira/browse/YARN-4244
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: J.Andreina
            Assignee: J.Andreina


Currently the user will not get the details about which file/block , the BlockPlacementPolicy is not able to find a replica node , if there is a huge client write operation is going on.

For example consider below failure message , which does'nt have details about file/block , which will be difficult to track later.
{noformat}
      final String message =
          "Failed to place enough replicas, still in need of "
              + (totalReplicasExpected - results.size()) + " to reach " + totalReplicasExpected
              + " (unavailableStorages=" + unavailableStorages + ", storagePolicy="
              + storagePolicy + ", newBlock=" + newBlock + ")";

        String msg = "All required storage types are unavailable: "
            + " unavailableStorages=" + unavailableStorages
            + ", storagePolicy=" + storagePolicy.getName();
{noformat}

It  is better to provide the file/block information in the logs for better debugability .



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)