[jira] [Commented] (CASSANDRA-19563) [Analytics] Support bulk write via S3

["Francisco Guerrero (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-19563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17838825#comment-17838825 ] 

Francisco Guerrero commented on CASSANDRA-19563:
------------------------------------------------

+1 Thanks for the patch

> [Analytics] Support bulk write via S3
> -------------------------------------
>
>                 Key: CASSANDRA-19563
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-19563
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Analytics Library
>            Reporter: Yifan Cai
>            Assignee: Yifan Cai
>            Priority: Normal
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> I would like to propose a new write option in Cassandra Analytics to bulk write SSTables via S3, in addition to the previously-implemented "direct upload to all sidecars" (now known as the "Direct" transport). 
> The new write option, now being implemented, is the "S3_COMPAT" transport, which allows the job to upload the generated SSTables to an S3-compatible storage system, and then inform the Cassandra Sidecar that those files are available for download & commit.
> Additionally, a plug-in system was added to allow communications between custom transport hooks and the job, so the custom hook can provide updated credentials and out-of-band status updates on S3-related issues.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org