You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Moritz Mack (Jira)" <ji...@apache.org> on 2021/12/15 08:58:00 UTC

[jira] [Updated] (BEAM-13209) DynamoDBIO silently drops unprocessed items

     [ https://issues.apache.org/jira/browse/BEAM-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Moritz Mack updated BEAM-13209:
-------------------------------
    Labels: aws aws-sdk-v1 aws-sdk-v2 data-loss dynamodb  (was: aws data-loss dynamodb)

> DynamoDBIO silently drops unprocessed items
> -------------------------------------------
>
>                 Key: BEAM-13209
>                 URL: https://issues.apache.org/jira/browse/BEAM-13209
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-aws
>            Reporter: Moritz Mack
>            Assignee: Moritz Mack
>            Priority: P1
>              Labels: aws, aws-sdk-v1, aws-sdk-v2, data-loss, dynamodb
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> `[batchWriteItem|https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_BatchWriteItem.html]` might fail partially and return unprocessed items. Such partial failures are not handled and result in a data loss.
> If hitting DynamoDB at scale it's rather likely to run into this.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)