You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Renukaprasad C (Jira)" <ji...@apache.org> on 2021/02/09 05:22:00 UTC
[jira] [Commented] (HDFS-14735) File could only be replicated to 0
nodes instead of minReplication (=1)
[ https://issues.apache.org/jira/browse/HDFS-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281533#comment-17281533 ]
Renukaprasad C commented on HDFS-14735:
---------------------------------------
[~talexey] Thanks for reporting the issue, [~zhangchen] Thanks for replay & detailed clarification.
We also face the similar issue which exists for some time and recovered automatically. But from the available INFO logs, we couldnt find which DN has issue. We can enhance the logging for better traceability.
Can we print the log in INFO level? Sometimes issue not reproducible or enabling DEBUG log lead to huge log. We can add an event based thread which print the INFO log on node addition/deletion. What is your opinion?
> File could only be replicated to 0 nodes instead of minReplication (=1)
> -----------------------------------------------------------------------
>
> Key: HDFS-14735
> URL: https://issues.apache.org/jira/browse/HDFS-14735
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Reporter: Tatyana Alexeyev
> Priority: Major
>
> Hello I have intermitent error when running my EMR Hadoop Cluster:
> "Error: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/sphdadm/_sqoop/00501bd7b05e4182b5006b9d51 bafb7f_f405b2f3/_temporary/1/_temporary/attempt_1565136887564_20057_m_000000_0/part-m-00000.snappy could only be replicated to 0 nodes instead of minReplication (=1). There are 5 datanode(s) running and no node(s) are excluded in this operation."
> I am running Hadoop version
> sphdadm@ip-10-6-15-108 hadoop]$ hadoop version
> Hadoop 2.8.5-amzn-4
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org