You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Jo Desmet (JIRA)" <ji...@apache.org> on 2016/05/13 22:43:12 UTC
[jira] [Updated] (ATLAS-786) hdfs dfs -put exits with zero on
exception
[ https://issues.apache.org/jira/browse/ATLAS-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jo Desmet updated ATLAS-786:
----------------------------
Description:
On a filesystem that is about to fill up, execute "hdfs dfs -put" for a file that is big enough to go over the limit. As a result, the command fails with an exception, however the command terminates normally (exit code 0).
Expectation is that any detectable failure generates an exit code different than zero.
Documentation on https://hadoop.apache.org/docs/r1.2.1/file_system_shell.html#put states:
Exit Code:
Returns 0 on success and -1 on error.
following is the exception generated:
16/05/11 13:37:07 INFO hdfs.DFSClient: Exception in createBlockOutputStream
java.io.EOFException: Premature EOF: no length prefix available
at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2282)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1352)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1271)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)
16/05/11 13:37:07 INFO hdfs.DFSClient: Abandoning BP-1964113808-130.8.138.99-1446787670498:blk_1073835906_95114
16/05/11 13:37:08 INFO hdfs.DFSClient: Excluding datanode DatanodeInfoWithStorage[130.8.138.99:50010,DS-eed7039a-8031-499e-85a5-7216b9d766a8,DISK]
> hdfs dfs -put exits with zero on exception
> ------------------------------------------
>
> Key: ATLAS-786
> URL: https://issues.apache.org/jira/browse/ATLAS-786
> Project: Atlas
> Issue Type: Bug
> Reporter: Jo Desmet
>
> On a filesystem that is about to fill up, execute "hdfs dfs -put" for a file that is big enough to go over the limit. As a result, the command fails with an exception, however the command terminates normally (exit code 0).
> Expectation is that any detectable failure generates an exit code different than zero.
> Documentation on https://hadoop.apache.org/docs/r1.2.1/file_system_shell.html#put states:
> Exit Code:
> Returns 0 on success and -1 on error.
> following is the exception generated:
> 16/05/11 13:37:07 INFO hdfs.DFSClient: Exception in createBlockOutputStream
> java.io.EOFException: Premature EOF: no length prefix available
> at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2282)
> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1352)
> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1271)
> at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)
> 16/05/11 13:37:07 INFO hdfs.DFSClient: Abandoning BP-1964113808-130.8.138.99-1446787670498:blk_1073835906_95114
> 16/05/11 13:37:08 INFO hdfs.DFSClient: Excluding datanode DatanodeInfoWithStorage[130.8.138.99:50010,DS-eed7039a-8031-499e-85a5-7216b9d766a8,DISK]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)