You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Dana H. P'Simer, Jr. (JIRA)" <ji...@apache.org> on 2011/09/23 18:50:26 UTC
[jira] [Created] (CASSANDRA-3252) IntegerType columns cause
exceptions when use in Pig.
IntegerType columns cause exceptions when use in Pig.
-----------------------------------------------------
Key: CASSANDRA-3252
URL: https://issues.apache.org/jira/browse/CASSANDRA-3252
Project: Cassandra
Issue Type: Bug
Components: Contrib, Hadoop
Affects Versions: 0.8.6
Reporter: Dana H. P'Simer, Jr.
CassandraStorage uses the validator classes to determine how to marshal column values, if the type is IntegerType a BigInteger is returned and Pig throws an exception on writing the value to intermediate storage. The exception is thrown because BigInteger is not one of the data types that Pig can handle.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3252) IntegerType columns cause
exceptions when use in Pig.
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113682#comment-13113682 ]
Jonathan Ellis commented on CASSANDRA-3252:
-------------------------------------------
int32type is new in 1.0
> IntegerType columns cause exceptions when use in Pig.
> -----------------------------------------------------
>
> Key: CASSANDRA-3252
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3252
> Project: Cassandra
> Issue Type: Bug
> Components: Contrib, Hadoop
> Affects Versions: 0.8.6
> Reporter: Dana H. P'Simer, Jr.
> Labels: cassandra, hadoop, pig
> Attachments: CASSANDRA-3252.patch
>
>
> CassandraStorage uses the validator classes to determine how to marshal column values, if the type is IntegerType a BigInteger is returned and Pig throws an exception on writing the value to intermediate storage. The exception is thrown because BigInteger is not one of the data types that Pig can handle.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3252) IntegerType columns cause
exceptions when use in Pig.
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113619#comment-13113619 ]
Jonathan Ellis commented on CASSANDRA-3252:
-------------------------------------------
Wouldn't a better fix be "use longtype or int32type if that's what you want instead?"
> IntegerType columns cause exceptions when use in Pig.
> -----------------------------------------------------
>
> Key: CASSANDRA-3252
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3252
> Project: Cassandra
> Issue Type: Bug
> Components: Contrib, Hadoop
> Affects Versions: 0.8.6
> Reporter: Dana H. P'Simer, Jr.
> Labels: cassandra, hadoop, pig
> Attachments: CASSANDRA-3252.patch
>
>
> CassandraStorage uses the validator classes to determine how to marshal column values, if the type is IntegerType a BigInteger is returned and Pig throws an exception on writing the value to intermediate storage. The exception is thrown because BigInteger is not one of the data types that Pig can handle.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3252) IntegerType columns cause
exceptions when use in Pig.
Posted by "Dana H. P'Simer, Jr. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dana H. P'Simer, Jr. updated CASSANDRA-3252:
--------------------------------------------
Attachment: CASSANDRA-3252.patch
A somewhat kludgey fix for IntegerType data in cassandra.
> IntegerType columns cause exceptions when use in Pig.
> -----------------------------------------------------
>
> Key: CASSANDRA-3252
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3252
> Project: Cassandra
> Issue Type: Bug
> Components: Contrib, Hadoop
> Affects Versions: 0.8.6
> Reporter: Dana H. P'Simer, Jr.
> Labels: cassandra, hadoop, pig
> Attachments: CASSANDRA-3252.patch
>
>
> CassandraStorage uses the validator classes to determine how to marshal column values, if the type is IntegerType a BigInteger is returned and Pig throws an exception on writing the value to intermediate storage. The exception is thrown because BigInteger is not one of the data types that Pig can handle.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3252) IntegerType columns cause
exceptions when use in Pig.
Posted by "Dana H. P'Simer, Jr. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113656#comment-13113656 ]
Dana H. P'Simer, Jr. commented on CASSANDRA-3252:
-------------------------------------------------
@Jonathan, I did not see any int32type and I just checked again and there is no such type in the org.apache.cassandra.db.marshal package. Where is this type? On the other hand, LongType is not appropriate since it expectes 8 bytes and there are only 4 in the data.
@Brandon, even the latest version of that patch does not handle the case where the BigInteger is larger than 32 bits. I assume that BigInteger was used to allow for arbitrarily large integers. Your code would break if the data were larger than 32 bits. However, I do like moving the logic into a separate function.
> IntegerType columns cause exceptions when use in Pig.
> -----------------------------------------------------
>
> Key: CASSANDRA-3252
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3252
> Project: Cassandra
> Issue Type: Bug
> Components: Contrib, Hadoop
> Affects Versions: 0.8.6
> Reporter: Dana H. P'Simer, Jr.
> Labels: cassandra, hadoop, pig
> Attachments: CASSANDRA-3252.patch
>
>
> CassandraStorage uses the validator classes to determine how to marshal column values, if the type is IntegerType a BigInteger is returned and Pig throws an exception on writing the value to intermediate storage. The exception is thrown because BigInteger is not one of the data types that Pig can handle.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira