You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "mukesh katariya (JIRA)" <ji...@apache.org> on 2018/04/04 16:40:00 UTC
[jira] [Created] (AVRO-2167) Block Size - retrieved as negative
with Snappy codec.
mukesh katariya created AVRO-2167:
-------------------------------------
Summary: Block Size - retrieved as negative with Snappy codec.
Key: AVRO-2167
URL: https://issues.apache.org/jira/browse/AVRO-2167
Project: Avro
Issue Type: Bug
Components: java
Affects Versions: 1.8.2
Reporter: mukesh katariya
Fix For: 1.8.2
Attachments: original-file-2.PNG
I am using the snappy codec, the bytes from 0x4fc1 to 0x4fd0,represent 16 byte sync block
16 byte sync >> 1c 21 91 44 35 f6 7a 76 e1 a6 ce 8f cc bf 11 29
After that there are two bytes showing 32 and 37 – which are avro long values using zigzag variable encoding. those decode to 25 and -28. Now the block size reads as negative.
The Avro tool fail to read the block with following error.
AvroRuntimeException — java.io.exception: Block size invalid or too large for this implemenation: -28.
Also i the sync 16 bytes are missing from the end of the file. Any idea what's wrong and how we can fix the same.
!original-file-2.PNG|width=1041,height=166!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)