You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2008/02/27 20:01:51 UTC

[jira] Updated: (HADOOP-2907) dead datanodes because of OutOfMemoryError

     [ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi updated HADOOP-2907:
---------------------------------

    Attachment: jmap-histo.txt

Koji and I looked at one of the datanodes. Attached jmap-histo.txt is the output of 'jmap -histo'. The top entry takes pretty much all the memory :

{noformat}
num   #instances    #bytes  class name
--------------------------------------
  1:     25039   918792056  [B
  2:     38666     4910272  [C
  3:     23620     2674272  <constMethodKlass>
  4:     23620     1893912  <methodKlass>
  5:     38347     1549664  <symbolKlass>
{noformat}

Does "[B" refer to byte arrays? Any ideas about how get anymore info out of this process are welcome.

> dead datanodes because of OutOfMemoryError
> ------------------------------------------
>
>                 Key: HADOOP-2907
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2907
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.16.0
>            Reporter: Christian Kunz
>         Attachments: jmap-histo.txt
>
>
> We see more dead datanodes than in previous releases. The common exception is found in the out file:
> Exception in thread "org.apache.hadoop.dfs.DataBlockScanner@18166e5" java.lang.OutOfMemoryError: Java heap space
> Exception in thread "DataNode: [dfs.data.dir-value]" java.lang.OutOfMemoryError: Java heap space

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.