You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Yifan Cai (Jira)" <ji...@apache.org> on 2024/04/16 18:32:00 UTC

[jira] [Updated] (CASSANDRA-19563) [Analytics] Support bulk write via S3

     [ https://issues.apache.org/jira/browse/CASSANDRA-19563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yifan Cai updated CASSANDRA-19563:
----------------------------------
    Change Category: Semantic
         Complexity: Normal
        Component/s: Analytics Library
             Status: Open  (was: Triage Needed)

> [Analytics] Support bulk write via S3
> -------------------------------------
>
>                 Key: CASSANDRA-19563
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-19563
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Analytics Library
>            Reporter: Yifan Cai
>            Assignee: Yifan Cai
>            Priority: Normal
>
> I would like to propose a new write option in Cassandra Analytics to bulk write SSTables via S3, in addition to the previously-implemented "direct upload to all sidecars" (now known as the "Direct" transport). 
> The new write option, now being implemented, is the "S3_COMPAT" transport, which allows the job to upload the generated SSTables to an S3-compatible storage system, and then inform the Cassandra Sidecar that those files are available for download & commit.
> Additionally, a plug-in system was added to allow communications between custom transport hooks and the job, so the custom hook can provide updated credentials and out-of-band status updates on S3-related issues.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org