You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Yijun Mao (Jira)" <ji...@apache.org> on 2023/03/24 01:20:00 UTC
[jira] [Commented] (CASSANDRA-17740) BulkLoader tool initializes schema unnecessarily via streaming
[ https://issues.apache.org/jira/browse/CASSANDRA-17740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704396#comment-17704396 ]
Yijun Mao commented on CASSANDRA-17740:
---------------------------------------
Hi [~maedhroz], is there a plan to backport the fix to 4.0 branch? We are hitting this issue w/ 4.0.7. Thanks.
> BulkLoader tool initializes schema unnecessarily via streaming
> --------------------------------------------------------------
>
> Key: CASSANDRA-17740
> URL: https://issues.apache.org/jira/browse/CASSANDRA-17740
> Project: Cassandra
> Issue Type: Bug
> Components: Tool/bulk load
> Reporter: Caleb Rackliffe
> Assignee: Caleb Rackliffe
> Priority: Normal
> Fix For: 4.1-beta1, 5.0
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> Changes to streaming setup code for CASSANDRA-17663 mean that {{BulkLoader}} initializes the schema/system keyspace, which is not what we want in a tool. Initialization is due to a call to {{SystemKeyspace.getPreferredIP}} from the {{BulkLoader}} when it starts to transmit the SSTables from the bulk loader to the Cassandra instance.
> {noformat}
> getPreferredIP:1063, SystemKeyspace (org.apache.cassandra.db)
> sendMessage:213, StreamingMultiplexedChannel (org.apache.cassandra.streaming.async)
> sendControlMessage:191, StreamingMultiplexedChannel (org.apache.cassandra.streaming.async)
> sendControlMessage:1033, StreamSession (org.apache.cassandra.streaming)
> startStreamingFiles:1257, StreamSession (org.apache.cassandra.streaming)
> prepareSynAck:802, StreamSession (org.apache.cassandra.streaming)
> messageReceived:622, StreamSession (org.apache.cassandra.streaming)
> run:76, StreamDeserializingTask (org.apache.cassandra.streaming)
> run:30, FastThreadLocalRunnable (io.netty.util.concurrent)
> run:748, Thread (java.lang)
> {noformat}
> The existing {{BulkLoaderTest}} fails to detect this as it doesn't actually connect to anything so does not initialize streaming.
> Affects 4.1 and trunk, and may affect 4.0, although the 4.0 patch for CASSANDRA-17663 is different than 4.1+, and may require different mitigation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org