You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Anonymous (Jira)" <ji...@apache.org> on 2022/11/19 11:32:00 UTC
[jira] [Updated] (BEAM-13391) The Apache Avro library failed to parse the header with the following error: EOF reached
[ https://issues.apache.org/jira/browse/BEAM-13391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anonymous updated BEAM-13391:
-----------------------------
Status: Triage Needed (was: Resolved)
> The Apache Avro library failed to parse the header with the following error: EOF reached
> ----------------------------------------------------------------------------------------
>
> Key: BEAM-13391
> URL: https://issues.apache.org/jira/browse/BEAM-13391
> Project: Beam
> Issue Type: Bug
> Components: io-py-gcp
> Affects Versions: 2.34.0
> Reporter: Sayat Satybaldiyev
> Assignee: Sayat Satybaldiyev
> Priority: P2
> Fix For: 2.37.0
>
> Original Estimate: 48h
> Time Spent: 5h 10m
> Remaining Estimate: 42h 50m
>
> When WriteToBigQuery is done with AVRO file loads, and the load is triggering a schema [modification job|https://github.com/apache/beam/blob/ad56edbf1fa2e6c19fea23555ecfad015f67174d/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py#L323-L340], then following error is triggered:
> {code:java}
> E RuntimeError: BigQuery job beam_bq_job_LOAD_AUTOMATIC_JOB_NAME_SCHEMA_MOD_STEP_171_736013176f6ea340cfd22b9f5b575c81_643a0ee608c04300bfbe67c8db85b2b0 failed. Error Result: <ErrorProto
> E message: 'Error while reading data, error message: The Apache Avro library failed to parse the header with the following error: EOF reached'
> E reason: 'invalid'> [while running 'WriteToBigQuery/BigQueryBatchFileLoads/WaitForSchemaModJobs']
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)