[jira] [Created] (BEAM-13391) The Apache Avro library failed to parse the header with the following error: EOF reached

["Sayat Satybaldiyev (Jira)" <ji...@apache.org>]

Sayat Satybaldiyev created BEAM-13391:
-----------------------------------------

             Summary: The Apache Avro library failed to parse the header with the following error: EOF reached
                 Key: BEAM-13391
                 URL: https://issues.apache.org/jira/browse/BEAM-13391
             Project: Beam
          Issue Type: Bug
          Components: io-py-gcp
    Affects Versions: 2.34.0
            Reporter: Sayat Satybaldiyev


When WriteToBigQuery is done with AVRO file loads, and the load is triggering a schema [modification job|https://github.com/apache/beam/blob/ad56edbf1fa2e6c19fea23555ecfad015f67174d/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py#L323-L340], then following error is triggered:


{code:java}
E         RuntimeError: BigQuery job beam_bq_job_LOAD_AUTOMATIC_JOB_NAME_SCHEMA_MOD_STEP_171_736013176f6ea340cfd22b9f5b575c81_643a0ee608c04300bfbe67c8db85b2b0 failed. Error Result: <ErrorProto
E          message: 'Error while reading data, error message: The Apache Avro library failed to parse the header with the following error: EOF reached'
E          reason: 'invalid'> [while running 'WriteToBigQuery/BigQueryBatchFileLoads/WaitForSchemaModJobs']
{code}










--
This message was sent by Atlassian Jira
(v8.20.1#820001)