You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Anonymous (Jira)" <ji...@apache.org> on 2023/04/13 10:59:00 UTC

[jira] [Updated] (BEAM-7917) Python datastore v1new fails on retry

     [ https://issues.apache.org/jira/browse/BEAM-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anonymous updated BEAM-7917:
----------------------------
    Status: Triage Needed  (was: Resolved)

> Python datastore v1new fails on retry
> -------------------------------------
>
>                 Key: BEAM-7917
>                 URL: https://issues.apache.org/jira/browse/BEAM-7917
>             Project: Beam
>          Issue Type: Bug
>          Components: io-py-gcp, runner-dataflow
>    Affects Versions: 2.14.0
>         Environment: Python 3.7 on Dataflow
>            Reporter: Dmytro Sadovnychyi
>            Assignee: Dmytro Sadovnychyi
>            Priority: P2
>              Labels: pull-request-available
>             Fix For: 2.18.0
>
>          Time Spent: 3h 50m
>  Remaining Estimate: 0h
>
> Traceback (most recent call last):
>   File "apache_beam/runners/common.py", line 782, in apache_beam.runners.common.DoFnRunner.process
>   File "apache_beam/runners/common.py", line 454, in apache_beam.runners.common.SimpleInvoker.invoke_process
>   File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/datastoreio.py", line 334, in process
>     self._flush_batch()
>   File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/datastoreio.py", line 349, in _flush_batch
>     throttle_delay=util.WRITE_BATCH_TARGET_LATENCY_MS // 1000)
>   File "/usr/local/lib/python3.7/site-packages/apache_beam/utils/retry.py", line 197, in wrapper
>     return fun(*args, **kwargs)
>   File "/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/helper.py", line 99, in write_mutations
>     batch.commit()
>   File "/usr/local/lib/python3.7/site-packages/google/cloud/datastore/batch.py", line 271, in commit
>     raise ValueError("Batch must be in progress to commit()")
> ValueError: Batch must be in progress to commit()



--
This message was sent by Atlassian Jira
(v8.20.10#820010)