You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Etienne Chauchot (Jira)" <ji...@apache.org> on 2021/11/09 14:08:00 UTC
[jira] [Commented] (BEAM-13209) DynamoDBIO silently drops
unprocessed items
[ https://issues.apache.org/jira/browse/BEAM-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441186#comment-17441186 ]
Etienne Chauchot commented on BEAM-13209:
-----------------------------------------
Thanks for identifying this [~mosche] !
> DynamoDBIO silently drops unprocessed items
> -------------------------------------------
>
> Key: BEAM-13209
> URL: https://issues.apache.org/jira/browse/BEAM-13209
> Project: Beam
> Issue Type: Bug
> Components: io-java-aws
> Reporter: Moritz Mack
> Priority: P0
> Labels: aws, data-loss, dynamodb
>
> `[batchWriteItem|https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_BatchWriteItem.html]` might fail partially and return unprocessed items. Such partial failures are not handled and result in a data loss.
> If hitting DynamoDB at scale it's rather likely to run into this.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)