You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Anton Kedin (JIRA)" <ji...@apache.org> on 2018/04/30 21:23:00 UTC
[jira] [Created] (BEAM-4199) [SQL] Add a DLQ support for Pubsub
tables
Anton Kedin created BEAM-4199:
---------------------------------
Summary: [SQL] Add a DLQ support for Pubsub tables
Key: BEAM-4199
URL: https://issues.apache.org/jira/browse/BEAM-4199
Project: Beam
Issue Type: Improvement
Components: dsl-sql
Reporter: Anton Kedin
Currently we crash the pipeline if there's any error processing the message from the pubsub, including if it has incorrect JSON format, like missing fields etc.
Correct solution would be for the user to specify a way to handle the errors, and ideally point to a dead-letter-queue where Beam should send the messages it could not process.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)