You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Steeve Morin (Created) (JIRA)" <ji...@apache.org> on 2011/09/30 00:37:45 UTC
[jira] [Created] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
--------------------------------------------------------------------------
Key: CASSANDRA-3280
URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
Project: Cassandra
Issue Type: Improvement
Components: Contrib
Affects Versions: 0.8.6
Reporter: Steeve Morin
Various patches in the Pig Storage Handler:
- correctly guess the right Pig type for the Row Key*
- add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
- add support to specify correct type comparator in SlicePredicate
*SlicePredicate comparator:*
For instance:
{{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3280:
--------------------------------------
Component/s: (was: Contrib)
Hadoop
Affects Version/s: (was: 0.8.6)
0.8.1
Fix Version/s: 0.8.7
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 0.8.1
> Reporter: Steeve Morin
> Labels: patch
> Fix For: 0.8.7
>
> Attachments: new_types_and_key_type.txt
>
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Posted by "Steeve Morin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steeve Morin updated CASSANDRA-3280:
------------------------------------
Attachment: new_types_and_key_type_v2.txt
Removes Date and UUID transformation, as it could pose problems when storing data back in Cassandra.
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 0.8.1
> Reporter: Steeve Morin
> Labels: patch
> Fix For: 0.8.7
>
> Attachments: new_types_and_key_type.txt, new_types_and_key_type_v2.txt
>
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3280) Pig Storage Handler: Add
>=0.8.1 types, Guess right type for Key in Schema
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127915#comment-13127915 ]
Hudson commented on CASSANDRA-3280:
-----------------------------------
Integrated in Cassandra-0.8 #374 (See [https://builds.apache.org/job/Cassandra-0.8/374/])
Add 0.8+ types and key validation type to pig schema.
Patch by Steeve Morin, reviewed by brandonwilliams for CASSANDRA-3280
brandonwilliams : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183518
Files :
* /cassandra/branches/cassandra-0.8/CHANGES.txt
* /cassandra/branches/cassandra-0.8/contrib/pig/src/java/org/apache/cassandra/hadoop/pig/CassandraStorage.java
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 0.8.1
> Reporter: Steeve Morin
> Labels: patch
> Fix For: 0.8.8
>
> Attachments: new_types_and_key_type.txt, new_types_and_key_type_v2.txt
>
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, -UUIDType (as String) and DateType (as time epoch)- (removed in v2 because it would break when storing data back in Cassandra)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3280:
--------------------------------------
Fix Version/s: 1.0.1
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 0.8.1
> Reporter: Steeve Morin
> Labels: patch
> Fix For: 0.8.8, 1.0.1
>
> Attachments: new_types_and_key_type.txt, new_types_and_key_type_v2.txt
>
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, -UUIDType (as String) and DateType (as time epoch)- (removed in v2 because it would break when storing data back in Cassandra)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Posted by "Steeve Morin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steeve Morin updated CASSANDRA-3280:
------------------------------------
Description:
Various patches in the Pig Storage Handler:
- correctly guess the right Pig type for the Row Key
- add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
- add support to specify correct type comparator in SlicePredicate
*SlicePredicate comparator:*
For instance:
{quote}
{{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
{quote}
It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
was:
Various patches in the Pig Storage Handler:
- correctly guess the right Pig type for the Row Key
- add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
- add support to specify correct type comparator in SlicePredicate
*SlicePredicate comparator:*
For instance:
{{quote}}
{{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
{{quote}}
It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Contrib
> Affects Versions: 0.8.6
> Reporter: Steeve Morin
> Labels: patch
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Posted by "Steeve Morin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steeve Morin updated CASSANDRA-3280:
------------------------------------
Attachment: new_types_and_key_type.txt
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Contrib
> Affects Versions: 0.8.6
> Reporter: Steeve Morin
> Labels: patch
> Attachments: new_types_and_key_type.txt
>
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Posted by "Steeve Morin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steeve Morin updated CASSANDRA-3280:
------------------------------------
Description:
Various patches in the Pig Storage Handler:
- correctly guess the right Pig type for the Row Key
- add support for FloatType, DoubleType, -UUIDType (as String) and DateType (as time epoch)- (removed in v2 because it would break when storing data back in Cassandra)
- add support to specify correct type comparator in SlicePredicate
*SlicePredicate comparator:*
For instance:
{quote}
{{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
{quote}
It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
was:
Various patches in the Pig Storage Handler:
- correctly guess the right Pig type for the Row Key
- add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
- add support to specify correct type comparator in SlicePredicate
*SlicePredicate comparator:*
For instance:
{quote}
{{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
{quote}
It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 0.8.1
> Reporter: Steeve Morin
> Labels: patch
> Fix For: 0.8.7
>
> Attachments: new_types_and_key_type.txt, new_types_and_key_type_v2.txt
>
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, -UUIDType (as String) and DateType (as time epoch)- (removed in v2 because it would break when storing data back in Cassandra)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3280) Pig Storage Handler: Add >=0.8.1
types, Guess right type for Key in Schema
Posted by "Steeve Morin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steeve Morin updated CASSANDRA-3280:
------------------------------------
Description:
Various patches in the Pig Storage Handler:
- correctly guess the right Pig type for the Row Key
- add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
- add support to specify correct type comparator in SlicePredicate
*SlicePredicate comparator:*
For instance:
{{quote}}
{{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
{{quote}}
It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
was:
Various patches in the Pig Storage Handler:
- correctly guess the right Pig type for the Row Key*
- add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
- add support to specify correct type comparator in SlicePredicate
*SlicePredicate comparator:*
For instance:
{{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Contrib
> Affects Versions: 0.8.6
> Reporter: Steeve Morin
> Labels: patch
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, UUIDType (as String) and DateType (as time epoch)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {{quote}}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {{quote}}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3280) Pig Storage Handler: Add
>=0.8.1 types, Guess right type for Key in Schema
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127904#comment-13127904 ]
Brandon Williams commented on CASSANDRA-3280:
---------------------------------------------
Committed, thanks!
> Pig Storage Handler: Add >=0.8.1 types, Guess right type for Key in Schema
> --------------------------------------------------------------------------
>
> Key: CASSANDRA-3280
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3280
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 0.8.1
> Reporter: Steeve Morin
> Labels: patch
> Fix For: 0.8.8
>
> Attachments: new_types_and_key_type.txt, new_types_and_key_type_v2.txt
>
>
> Various patches in the Pig Storage Handler:
> - correctly guess the right Pig type for the Row Key
> - add support for FloatType, DoubleType, -UUIDType (as String) and DateType (as time epoch)- (removed in v2 because it would break when storing data back in Cassandra)
> - add support to specify correct type comparator in SlicePredicate
> *SlicePredicate comparator:*
> For instance:
> {quote}
> {{raw = LOAD 'cassandra://ks/cf?slice_start=2.5&slice_end=5.3&comparator=DoubleType' USING CassandraStorage() AS ();}}
> {quote}
> It's an optional parameter. If it's not present, it will default to BytesType. Which mean you must use hex strings.
> Hence {{slice_start=00&slice_end=FF}} isn't the same as {{slice_start=00&slice_end=FF&comparator=AsciiType}} !
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira