You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Brandon Williams (Created) (JIRA)" <ji...@apache.org> on 2012/01/19 18:07:40 UTC
[jira] [Created] (CASSANDRA-3754) Add TTL and counter support to
BulkOutputFormat
Add TTL and counter support to BulkOutputFormat
-----------------------------------------------
Key: CASSANDRA-3754
URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
Project: Cassandra
Issue Type: Improvement
Components: Hadoop
Reporter: Brandon Williams
Assignee: Brandon Williams
Priority: Minor
Fix For: 1.2
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Samarth Gahire (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire updated CASSANDRA-3754:
--------------------------------------
Attachment: 0001-TTL-Support-Added-updated.txt
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added-updated.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Brandon Williams (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brandon Williams updated CASSANDRA-3754:
----------------------------------------
Summary: Add TTL support to BulkOutputFormat (was: Add TTL and counter support to BulkOutputFormat)
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3754) Add TTL and counter support to
BulkOutputFormat
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198806#comment-13198806 ]
Brandon Williams commented on CASSANDRA-3754:
---------------------------------------------
Right, we can't guarantee what precision the timestamps supplied are in, and if for whatever reason someone wants to set timestamps far in the future or past, that's still valid.
> Add TTL and counter support to BulkOutputFormat
> -----------------------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL and counter support to
BulkOutputFormat
Posted by "Brandon Williams (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brandon Williams updated CASSANDRA-3754:
----------------------------------------
Assignee: Samarth Gahire (was: Brandon Williams)
> Add TTL and counter support to BulkOutputFormat
> -----------------------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3754) Add TTL and counter support to
BulkOutputFormat
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198004#comment-13198004 ]
Brandon Williams commented on CASSANDRA-3754:
---------------------------------------------
Instead of calculating the expiration time based on the client's timestamp, it should be the current time in ms.
> Add TTL and counter support to BulkOutputFormat
> -----------------------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Brandon Williams
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Samarth Gahire (Reopened) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire reopened CASSANDRA-3754:
---------------------------------------
During cleanup, you have removed
{code}long temp = column.ttl;
expirationTimestampMS = (currentTime) + (temp * 1000);
{code}
from the patch I have submitted.
Assigning column.ttl (which is integer) to long in absolutely necessary.
While calculating the "expirationTimestampMS" multiplying this integer ttl with 1000 may results into the value which is out of range of "int".
You can try with ttl = 11824305 seconds. Multiplying this with 1000 results into negative value and expirationTimestampMS of past is calculated.
Reopening Issue.
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1.0
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1.0
>
> Attachments: 0001-TTL-Support-Added-updated.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Samarth Gahire (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire updated CASSANDRA-3754:
--------------------------------------
Attachment: 0001-TTL-Support-Added-updated.txt
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added-updated.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Samarth Gahire (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire updated CASSANDRA-3754:
--------------------------------------
Attachment: (was: 0001-TTL-Support-Added)
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Samarth Gahire (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire updated CASSANDRA-3754:
--------------------------------------
Attachment: (was: 0001-TTL-Support-Added-updated.txt)
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added-updated.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Erik Forsberg (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212440#comment-13212440 ]
Erik Forsberg commented on CASSANDRA-3754:
------------------------------------------
I can confirm the problem, and also that Samarth's latest patch fixes the problem.
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1.0
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1.0
>
> Attachments: 0001-TTL-Support-Added-updated.txt, ttl_long_issue_fix.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL support to
BulkOutputFormat
Posted by "Samarth Gahire (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire updated CASSANDRA-3754:
--------------------------------------
Attachment: ttl_long_issue_fix.txt
> Add TTL support to BulkOutputFormat
> -----------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1.0
> Reporter: Brandon Williams
> Assignee: Samarth Gahire
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1.0
>
> Attachments: 0001-TTL-Support-Added-updated.txt, ttl_long_issue_fix.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3754) Add TTL and counter support to
BulkOutputFormat
Posted by "Samarth Gahire (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire updated CASSANDRA-3754:
--------------------------------------
Attachment: 0001-TTL-Support-Added
Patch for TTL support to BulkOutputFormat.
> Add TTL and counter support to BulkOutputFormat
> -----------------------------------------------
>
> Key: CASSANDRA-3754
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3754
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Affects Versions: 1.1
> Reporter: Brandon Williams
> Assignee: Brandon Williams
> Priority: Minor
> Labels: bulkloader, hadoop, ttl
> Fix For: 1.1
>
> Attachments: 0001-TTL-Support-Added
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira