[jira] [Created] (AVRO-3480) Avro files with multiple "blocks" fail to deserialize from a file when using the DEFLATE codec

["Spencer Williams (Jira)" <ji...@apache.org>]

Spencer Williams created AVRO-3480:
--------------------------------------

             Summary: Avro files with multiple "blocks" fail to deserialize from a file when using the DEFLATE codec
                 Key: AVRO-3480
                 URL: https://issues.apache.org/jira/browse/AVRO-3480
             Project: Apache Avro
          Issue Type: Bug
          Components: php
    Affects Versions: 1.11.0
            Reporter: Spencer Williams
         Attachments: repro_java_create_problematic_avro_file.zip, test.avro

When attempting in PHP to deserialize a file containing a large number of records (see example file attached – 20,000 records) that uses the DEFLATE codec, the `$decoder` instance advances through the file incorrectly, eventually yielding an empty string that is passed into `gzinflate(...)` on this line: [https://github.com/apache/avro/blob/a6f13b269a359d3839e55a75e0662d834d76992c/lang/php/lib/DataFile/AvroDataIOReader.php#L176]

 

...resulting in a PHP error being raised. Notably, at the time when this happens, not all records have been deserialized, so it seems that this is related to there being multiple "blocks" in the file.

I've attached a file that meets this condition, and also a quick Kotlin project using the official Java library that I used to generate the file.

The PHP code in question to reproduce this behavior is pretty standard, lifted directly from the provided {{examples/write_read.php}} file:

 

{{{}<?php{}}}{{{}if (count($argv) < 2) {{}}}
{{    echo "USAGE: php main.php FILENAME";}}
{{    exit(1);}}
{{}}}
{{$filename = $argv[1];}}

{{require_once __DIR__ . '/../vendor/avro-php-1.11.0/lib/autoload.php';}}

{{use Apache\Avro\DataFile\AvroDataIO;}}

{{$data_reader = AvroDataIO::openFile($filename);}}
{{echo "Reading from $filename:\n";}}
{{foreach ($data_reader->data() as $datum) {}}
{{    echo var_export($datum, true) . "\n";}}
{{}}}
{{$data_reader->close();}}

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)