You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Murillo Flores <mu...@chaordic.com.br> on 2014/04/26 17:03:13 UTC
Input file with length zero crash
Hello everyone,
I'm trying to run a MR job in hadoop 2.2.0 with the input files coming from
s3. One of these input files is an empty file (zero byte length) and
because of that my job fail at the map phase, because it tries to read a
range of this input file that does not exists. The exception I see in logs
is something like this:
s3native.NativeS3FileSystem: Opening 's3n://bucket/folder/_FINISHED' for
reading
s3native.NativeS3FileSystem: Opening key 'folder/_FINISHED' for reading at
position '0'
pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
Unexpected response code 416, expected 206
pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' - Received
error response with XML message
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>InvalidRange</Code>
<Message>The requested range is not satisfiable</Message>
<ActualObjectSize>0</ActualObjectSize><RequestId>C651E27E4B4A4732</RequestId><HostId>g9GPS7IczKzsIWSRnS7lw+H2rIDl6KT7qwDutPTMD0mkdv1XZnXI2LVsCML0I03x</HostId><RangeRequested>bytes=0-</RangeRequested>
</Error>
Does anyone knows how to fix this?
Thanks a lot.
--
*Murillo*
Chaordic
*www.chaordic.com.br <http://www.chaordic.com.br/>*
55 48 3232.3200
Re: Input file with length zero crash
Posted by Murillo Flores <mu...@chaordic.com.br>.
Have anyone experienced something like this before?
2014-04-26 12:03 GMT-03:00 Murillo Flores <mu...@chaordic.com.br>:
> Hello everyone,
>
> I'm trying to run a MR job in hadoop 2.2.0 with the input files coming
> from s3. One of these input files is an empty file (zero byte length) and
> because of that my job fail at the map phase, because it tries to read a
> range of this input file that does not exists. The exception I see in logs
> is something like this:
>
> s3native.NativeS3FileSystem: Opening 's3n://bucket/folder/_FINISHED' for
> reading
> s3native.NativeS3FileSystem: Opening key 'folder/_FINISHED' for reading at
> position '0'
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Unexpected response code 416, expected 206
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Received error response with XML message
> <?xml version="1.0" encoding="UTF-8"?>
> <Error><Code>InvalidRange</Code>
> <Message>The requested range is not satisfiable</Message>
>
> <ActualObjectSize>0</ActualObjectSize><RequestId>C651E27E4B4A4732</RequestId><HostId>g9GPS7IczKzsIWSRnS7lw+H2rIDl6KT7qwDutPTMD0mkdv1XZnXI2LVsCML0I03x</HostId><RangeRequested>bytes=0-</RangeRequested>
> </Error>
>
>
> Does anyone knows how to fix this?
>
> Thanks a lot.
>
> --
> *Murillo*
>
> Chaordic
> *www.chaordic.com.br <http://www.chaordic.com.br/>*
> 55 48 3232.3200
>
--
*Murillo*
Chaordic
*www.chaordic.com.br <http://www.chaordic.com.br/>*
55 48 3232.3200
Re: Input file with length zero crash
Posted by Murillo Flores <mu...@chaordic.com.br>.
Have anyone experienced something like this before?
2014-04-26 12:03 GMT-03:00 Murillo Flores <mu...@chaordic.com.br>:
> Hello everyone,
>
> I'm trying to run a MR job in hadoop 2.2.0 with the input files coming
> from s3. One of these input files is an empty file (zero byte length) and
> because of that my job fail at the map phase, because it tries to read a
> range of this input file that does not exists. The exception I see in logs
> is something like this:
>
> s3native.NativeS3FileSystem: Opening 's3n://bucket/folder/_FINISHED' for
> reading
> s3native.NativeS3FileSystem: Opening key 'folder/_FINISHED' for reading at
> position '0'
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Unexpected response code 416, expected 206
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Received error response with XML message
> <?xml version="1.0" encoding="UTF-8"?>
> <Error><Code>InvalidRange</Code>
> <Message>The requested range is not satisfiable</Message>
>
> <ActualObjectSize>0</ActualObjectSize><RequestId>C651E27E4B4A4732</RequestId><HostId>g9GPS7IczKzsIWSRnS7lw+H2rIDl6KT7qwDutPTMD0mkdv1XZnXI2LVsCML0I03x</HostId><RangeRequested>bytes=0-</RangeRequested>
> </Error>
>
>
> Does anyone knows how to fix this?
>
> Thanks a lot.
>
> --
> *Murillo*
>
> Chaordic
> *www.chaordic.com.br <http://www.chaordic.com.br/>*
> 55 48 3232.3200
>
--
*Murillo*
Chaordic
*www.chaordic.com.br <http://www.chaordic.com.br/>*
55 48 3232.3200
Re: Input file with length zero crash
Posted by Murillo Flores <mu...@chaordic.com.br>.
Have anyone experienced something like this before?
2014-04-26 12:03 GMT-03:00 Murillo Flores <mu...@chaordic.com.br>:
> Hello everyone,
>
> I'm trying to run a MR job in hadoop 2.2.0 with the input files coming
> from s3. One of these input files is an empty file (zero byte length) and
> because of that my job fail at the map phase, because it tries to read a
> range of this input file that does not exists. The exception I see in logs
> is something like this:
>
> s3native.NativeS3FileSystem: Opening 's3n://bucket/folder/_FINISHED' for
> reading
> s3native.NativeS3FileSystem: Opening key 'folder/_FINISHED' for reading at
> position '0'
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Unexpected response code 416, expected 206
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Received error response with XML message
> <?xml version="1.0" encoding="UTF-8"?>
> <Error><Code>InvalidRange</Code>
> <Message>The requested range is not satisfiable</Message>
>
> <ActualObjectSize>0</ActualObjectSize><RequestId>C651E27E4B4A4732</RequestId><HostId>g9GPS7IczKzsIWSRnS7lw+H2rIDl6KT7qwDutPTMD0mkdv1XZnXI2LVsCML0I03x</HostId><RangeRequested>bytes=0-</RangeRequested>
> </Error>
>
>
> Does anyone knows how to fix this?
>
> Thanks a lot.
>
> --
> *Murillo*
>
> Chaordic
> *www.chaordic.com.br <http://www.chaordic.com.br/>*
> 55 48 3232.3200
>
--
*Murillo*
Chaordic
*www.chaordic.com.br <http://www.chaordic.com.br/>*
55 48 3232.3200
Re: Input file with length zero crash
Posted by Murillo Flores <mu...@chaordic.com.br>.
Have anyone experienced something like this before?
2014-04-26 12:03 GMT-03:00 Murillo Flores <mu...@chaordic.com.br>:
> Hello everyone,
>
> I'm trying to run a MR job in hadoop 2.2.0 with the input files coming
> from s3. One of these input files is an empty file (zero byte length) and
> because of that my job fail at the map phase, because it tries to read a
> range of this input file that does not exists. The exception I see in logs
> is something like this:
>
> s3native.NativeS3FileSystem: Opening 's3n://bucket/folder/_FINISHED' for
> reading
> s3native.NativeS3FileSystem: Opening key 'folder/_FINISHED' for reading at
> position '0'
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Unexpected response code 416, expected 206
> pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
> Received error response with XML message
> <?xml version="1.0" encoding="UTF-8"?>
> <Error><Code>InvalidRange</Code>
> <Message>The requested range is not satisfiable</Message>
>
> <ActualObjectSize>0</ActualObjectSize><RequestId>C651E27E4B4A4732</RequestId><HostId>g9GPS7IczKzsIWSRnS7lw+H2rIDl6KT7qwDutPTMD0mkdv1XZnXI2LVsCML0I03x</HostId><RangeRequested>bytes=0-</RangeRequested>
> </Error>
>
>
> Does anyone knows how to fix this?
>
> Thanks a lot.
>
> --
> *Murillo*
>
> Chaordic
> *www.chaordic.com.br <http://www.chaordic.com.br/>*
> 55 48 3232.3200
>
--
*Murillo*
Chaordic
*www.chaordic.com.br <http://www.chaordic.com.br/>*
55 48 3232.3200