You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Nick Bailey (JIRA)" <ji...@apache.org> on 2012/10/03 22:48:14 UTC
[jira] [Created] (CASSANDRA-4755) Bulk loader won't work with CQL3
Nick Bailey created CASSANDRA-4755:
--------------------------------------
Summary: Bulk loader won't work with CQL3
Key: CASSANDRA-4755
URL: https://issues.apache.org/jira/browse/CASSANDRA-4755
Project: Cassandra
Issue Type: Bug
Components: Tools
Affects Versions: 1.2.0 beta 1
Reporter: Nick Bailey
Fix For: 1.2.0
Currently the bulk loader uses thrift to get the schema and validate it before bulk loading a cf. Since we stopped returning cql3 cfs through describe_keyspaces, the bulk loader will be unable to load those cfs.
If we figure out/add a way to validate the schema over jmx, we could use that for getting token ranges as well and drop thrift completely from the bulk loader.
Another option might be querying system tables manually to validate things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4755) Bulk loader won't work with CQL3
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-4755:
--------------------------------------
Reviewer: jbellis (was: yukim)
> Bulk loader won't work with CQL3
> --------------------------------
>
> Key: CASSANDRA-4755
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4755
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
> Affects Versions: 1.2.0 beta 1
> Reporter: Nick Bailey
> Assignee: Aleksey Yeschenko
> Fix For: 1.2.0
>
> Attachments: CASSANDRA-4755.txt
>
>
> Currently the bulk loader uses thrift to get the schema and validate it before bulk loading a cf. Since we stopped returning cql3 cfs through describe_keyspaces, the bulk loader will be unable to load those cfs.
> If we figure out/add a way to validate the schema over jmx, we could use that for getting token ranges as well and drop thrift completely from the bulk loader.
> Another option might be querying system tables manually to validate things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4755) Bulk loader won't work with CQL3
Posted by "Aleksey Yeschenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aleksey Yeschenko updated CASSANDRA-4755:
-----------------------------------------
Attachment: CASSANDRA-4755.txt
> Bulk loader won't work with CQL3
> --------------------------------
>
> Key: CASSANDRA-4755
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4755
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
> Affects Versions: 1.2.0 beta 1
> Reporter: Nick Bailey
> Assignee: Aleksey Yeschenko
> Fix For: 1.2.0
>
> Attachments: CASSANDRA-4755.txt
>
>
> Currently the bulk loader uses thrift to get the schema and validate it before bulk loading a cf. Since we stopped returning cql3 cfs through describe_keyspaces, the bulk loader will be unable to load those cfs.
> If we figure out/add a way to validate the schema over jmx, we could use that for getting token ranges as well and drop thrift completely from the bulk loader.
> Another option might be querying system tables manually to validate things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4755) Bulk loader won't work with
CQL3
Posted by "Aleksey Yeschenko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13480847#comment-13480847 ]
Aleksey Yeschenko commented on CASSANDRA-4755:
----------------------------------------------
Haven't dealt with BulkRecordWriter.External/BulkLoader.ExternalClient duplication. The attached patch fixes the BulkLoader+CQL3 issue and does nothing beyond that.
Please create a new issue for removing the duplication (or tell me to create it) if you still think it's worth the effort. But that would have a different priority compared to this issue, so I've dealt with the bug first.
> Bulk loader won't work with CQL3
> --------------------------------
>
> Key: CASSANDRA-4755
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4755
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
> Affects Versions: 1.2.0 beta 1
> Reporter: Nick Bailey
> Assignee: Aleksey Yeschenko
> Fix For: 1.2.0
>
> Attachments: CASSANDRA-4755.txt
>
>
> Currently the bulk loader uses thrift to get the schema and validate it before bulk loading a cf. Since we stopped returning cql3 cfs through describe_keyspaces, the bulk loader will be unable to load those cfs.
> If we figure out/add a way to validate the schema over jmx, we could use that for getting token ranges as well and drop thrift completely from the bulk loader.
> Another option might be querying system tables manually to validate things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4755) Bulk loader won't work with CQL3
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-4755:
--------------------------------------
Reviewer: yukim
Assignee: Aleksey Yeschenko
I think I'd prefer just converting that code to use a CQL query or two, all it cares about is "is this ks/cf pair valid," which isn't a big deal to fix.
Side note: looks like some code duplication in BulkLoader.ExternalClient and BulkRecordWriter.External client, be nice to clean that up.
> Bulk loader won't work with CQL3
> --------------------------------
>
> Key: CASSANDRA-4755
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4755
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
> Affects Versions: 1.2.0 beta 1
> Reporter: Nick Bailey
> Assignee: Aleksey Yeschenko
> Fix For: 1.2.0
>
>
> Currently the bulk loader uses thrift to get the schema and validate it before bulk loading a cf. Since we stopped returning cql3 cfs through describe_keyspaces, the bulk loader will be unable to load those cfs.
> If we figure out/add a way to validate the schema over jmx, we could use that for getting token ranges as well and drop thrift completely from the bulk loader.
> Another option might be querying system tables manually to validate things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira