[jira] [Created] (CASSSIDECAR-312) CDC: Improve durability in failure scenarios by bursting out to object storage

["Josh McKenzie (Jira)" <ji...@apache.org>]

Josh McKenzie created CASSSIDECAR-312:
-----------------------------------------

             Summary: CDC: Improve durability in failure scenarios by bursting out to object storage
                 Key: CASSSIDECAR-312
                 URL: https://issues.apache.org/jira/browse/CASSSIDECAR-312
             Project: Sidecar for Apache Cassandra
          Issue Type: Improvement
          Components: CDC
            Reporter: Josh McKenzie
            Assignee: Bernardo Botella Corbi


In the event of Kafka being down - or even if a user pauses CDC - we are limited by the local disk space. When we move to run CDC in Sidecar, if Kafka is unavailable we can ship the logs to some kind of object store (s3, etc) temporarily to ease disk usage. When Kafka comes back up we resume can reading from object storage, and clear up once published in Kafka.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org