You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@metron.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/09/14 20:11:20 UTC
[jira] [Commented] (METRON-419) Update Tuple to HBase Mapper/Bolt
to Set TTL
[ https://issues.apache.org/jira/browse/METRON-419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15491341#comment-15491341 ]
ASF GitHub Bot commented on METRON-419:
---------------------------------------
GitHub user nickwallen opened a pull request:
https://github.com/apache/incubator-metron/pull/252
METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
For METRON-417, the goal is to use HBase's TTL mechanism to expire or age-out Profile data. This PR is another step toward that goal.
This PR alters the mechanism that maps tuples to HBase so that a TTL can be specified in a generic way. Each tuple is capable of being written to HBase with its own unique TTL value.
The dependency on the storm-hbase project, which is part of Apache Storm, has been removed. The storm-hbase code could not be enhanced to support a TTL without changing the underlying implementation. The HBaseMapper interface was altered so that implementation can specify the TTL value for each tuple.
Unit tests have been added to test writes with and without a TTL to HBase.
Depends on the following existing PRs...
- [ ] #246
- [ ] #251
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nickwallen/incubator-metron METRON-419
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/252.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #252
----
commit c2ffd4a94ed59da718ebc17d5d093bb2085e508e
Author: Nick Allen <ni...@nickallen.org>
Date: 2016-09-10T02:10:03Z
METRON-411 Support Greater Range of Profile Periods
commit a8e2da3b762bf3df99ab0ff27973ccc10c4a575d
Author: Nick Allen <ni...@nickallen.org>
Date: 2016-09-14T18:04:23Z
METRON-418 Set TTL on HBase Puts
commit 18d343dee87fc9497499acf38f9c774709cc4aaa
Author: Nick Allen <ni...@nickallen.org>
Date: 2016-09-14T19:02:36Z
METRON-419 Removed dependency on storm-hbase as this code will need to change to support TTL.
commit 79859d8662de026a2ca1681ccefa3a64fe276d39
Author: Nick Allen <ni...@nickallen.org>
Date: 2016-09-14T20:00:22Z
METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
----
> Update Tuple to HBase Mapper/Bolt to Set TTL
> --------------------------------------------
>
> Key: METRON-419
> URL: https://issues.apache.org/jira/browse/METRON-419
> Project: Metron
> Issue Type: Sub-task
> Reporter: Nick Allen
> Assignee: Nick Allen
>
> Alter the generic mechanism that maps Tuples to HBase so that a TTL can optionally be specified. Each tuple should be capable of being written to HBase with its own unique TTL vaue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)