You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@rya.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/01/28 01:09:39 UTC
[jira] [Commented] (RYA-32) Improve how metadata and values are
written to Accumulo PCJ tables.
[ https://issues.apache.org/jira/browse/RYA-32?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120468#comment-15120468 ]
ASF GitHub Bot commented on RYA-32:
-----------------------------------
GitHub user meiercaleb opened a pull request:
https://github.com/apache/incubator-rya/pull/15
RYA-32 Improve how metadata and values are written to Accumulo PCJ tables
Created a class AccumuloPcjSerializer within the rya.indexing project for serializing and deserializing binding sets for storing and reading solutions in precomputed join tables. Also developed the class PcjTables to encapsulate the logic for creating a PCJ table. Refactored some of the core precomputed join classes to utilize these updates and included a number of comments to make the code clearer. Updated a large number of tests within the packages mvm.rya.indexing.external and mvm.rya.indexing.external.tupleSet to reflect these updates.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/meiercaleb/incubator-rya RYA-32-Improve-how-metadata-and-values-are-written-to-Accumulo-PCJ-tables
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-rya/pull/15.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15
----
commit f7a3dbcc1d2e84d95009713a059b41cc23a98369
Author: meiercaleb <me...@gmail.com>
Date: 2016-01-06T19:49:20Z
Merge pull request #1 from apache/develop
RYA-28 fixing build after incomplete check in
commit 11ac3882a2331c92433530be3d16baee8dd12fd9
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-06T21:51:42Z
Remove bad imports
commit 1d94f2ef6ab1cbd01358abf9da0e470700f0c46e
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-07T21:49:16Z
PcjSerializer Stub
commit 5692b5f0163acf107e5e01c7e34fb23c461e4f0b
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-07T21:55:19Z
Stub Update
commit 858d6e5aa0f2a349347a497adcfd759dca88a457
Author: kchilton2 <ke...@gmail.com>
Date: 2016-01-07T21:57:43Z
Merge pull request #1 from meiercaleb/develop
PcjSerializer Stub
commit 857aead7a476cdcf4bfe031862505fd7700dbae2
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-07T23:02:30Z
First Implementation of Serializer
commit 53dfee72e450543ffed4c6a715260d1c7f9a4e29
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-08T17:58:45Z
AccumuloPcjSerializer and Test
Serializer for wrtiing and reading BindingSets to and from a PCJ table.
commit c6f2741cc393ba5b8f5fd8bf7a3e41ad681b98e6
Author: Kevin Chilton <ke...@localhost.localdomain>
Date: 2016-01-08T19:35:34Z
Fixing javadocs.
commit 44d3cad8e47e98d5aa3ae424073fef8d1a7de533
Author: kchilton2 <ke...@gmail.com>
Date: 2016-01-08T19:45:16Z
Merge pull request #2 from meiercaleb/develop
Develop
commit cb6151b99bf8a7fdc9a5d9e229371e71cf4280ae
Author: meiercaleb <me...@gmail.com>
Date: 2016-01-08T20:10:46Z
Merge pull request #2 from kchilton2/develop
Develop
commit 80f52089e0b52bdbe9b68967919e435e2901ab3b
Author: Kevin Chilton <ke...@localhost.localdomain>
Date: 2016-01-09T00:11:07Z
Encapsulated common PCJ Table functions within the PcjTables class.
commit b9ebc6a003781d5ca5bc1fbdabd9e629c705958f
Author: meiercaleb <me...@gmail.com>
Date: 2016-01-09T20:18:28Z
Merge pull request #3 from kchilton2/develop
Encapsulated common PCJ Table functions within the PcjTables class.
commit dedd25b8e03f05e0ded753c5b602640cd8fc0ba0
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-09T20:41:39Z
Overhaul of AccumuloIndexSet
commit 8bd26f25ecc73d21802ab6185d6da044c1398127
Author: Kevin Chilton <ke...@localhost.localdomain>
Date: 2016-01-12T01:27:04Z
Finished documentation for PcjTables and cleaned up the integration tests.
commit 9cf178b25be4d9d0c6166f1c918fa101ef92e447
Author: kchilton2 <ke...@gmail.com>
Date: 2016-01-12T01:53:59Z
Merge pull request #3 from meiercaleb/develop
Develop
commit df8364d4ceecfab676b0d6f02bd0a334cf4d69cc
Author: Kevin Chilton <ke...@localhost.localdomain>
Date: 2016-01-12T05:46:54Z
Making PcjTables methods non-static so that they may be mocked when writing unit tests.
commit 65561d0d2bd7dab70683ea82ef43d4c173912a39
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-12T21:34:03Z
PCJ Refactor
Updates to AccumuloIndexSetNew, AccumuloPcjQuery, and
AccumuloIndexSetNewTest
commit 129e1681ab9a5537c51d10e11a971c0c03617a42
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-12T21:36:46Z
Revert "PCJ Refactor"
This reverts commit 65561d0d2bd7dab70683ea82ef43d4c173912a39.
commit 7c10794da4a62e89d041c4e3fdfedb332d52ee63
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-12T21:37:51Z
Revert "Revert "PCJ Refactor""
This reverts commit 129e1681ab9a5537c51d10e11a971c0c03617a42.
commit e2d209c5c25d708a62f443bd64bc065eff36d233
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-12T22:06:33Z
Pcj Merge
commit 207d37c6786e5c14e87c25f9c3dc70ba542cc35f
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-12T22:08:34Z
PcjIntegrationTest merge
commit 9d2bea4d97dd870ce534189c370abf7218abb6dc
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-12T22:59:03Z
Resolving merge conflict
Merge branch 'develop' of https://github.com/kchilton2/incubator-rya into develop
commit 8589aa5a695b7bdfd801d51aac6cb5854f2c0196
Author: Kevin Chilton <ke...@localhost.localdomain>
Date: 2016-01-15T01:33:35Z
Implemented incremental PCJ cardinality updates.
commit 2228fdc49c18864f2ec500a727b03478716dccf2
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-15T04:17:58Z
Cleaning up and Fixing Tests. Eliminating dependency on ExternalProcessor
commit fdf7a64cb1111f6855a2ff6bf1acfa2887adcf52
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-15T04:54:06Z
Eliminate dependency on ExternalProcessor
commit 863dd9ebc166a7c72a360b52151c2f7e99c5229f
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-15T05:15:06Z
dfa
commit 489bc3f7d5ae411c7714f7b0cec6f73c4a3796d2
Author: meiercaleb <me...@gmail.com>
Date: 2016-01-15T05:16:45Z
Merge pull request #6 from kchilton2/develop
Implemented incremental PCJ cardinality updates.
commit 34a7c264153648d743a347779b70f7f45d01540c
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-15T18:02:40Z
Updates to Test and Comments.
commit f1f674589fe9615593f21577ab8f2e7008716dda
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-15T19:20:58Z
Test updates
commit 8c713405c81747850b2650b63fac5620c0ba5c97
Author: Caleb Meier <me...@gmail.com>
Date: 2016-01-19T17:21:15Z
Comments for AccumuloPcjQuery
----
> Improve how metadata and values are written to Accumulo PCJ tables.
> -------------------------------------------------------------------
>
> Key: RYA-32
> URL: https://issues.apache.org/jira/browse/RYA-32
> Project: Rya
> Issue Type: Improvement
> Reporter: Kevin Chilton
>
> Refactor how Precomputed Joins (PCJs) are stored in Accumulo.
> 1. Change how PCJ results are written to an Accumulo PCJ table so that they include all information required to deserialize them.
> 2. Change how the PCJ metadata is stored within the Accumulo table to allow Cardinalities to be updated.
> 3. Create an API for interacting with PCJ tables.
> 4. Update the accmulo.pig project to write values using the new formats.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)