[jira] [Commented] (RYA-528) DataWave DAO connector

["Brad (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/RYA-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097241#comment-17097241 ] 

Brad commented on RYA-528:
--------------------------

I'm continuing to develop this feature. I've discovered a lot of problems in the way the current AccumuloRyaDAO works, so I've refactored significant chunks of the code, but it is getting easier to work with now. I'll test out the changes on a real cluster to see if there is any significant improvement in performance with the refactor.

> DataWave DAO connector
> ----------------------
>
>                 Key: RYA-528
>                 URL: https://issues.apache.org/jira/browse/RYA-528
>             Project: Rya
>          Issue Type: New Feature
>          Components: dao
>    Affects Versions: 4.1.0
>            Reporter: Brad
>            Priority: Major
>
> I'd like to propose a DAO connector to a complimentary Accumulo project: [https://github.com/NationalSecurityAgency/datawave]
> Both these products utilise Accumulo as a database. DataWave generates an edge table and a shard table, and I think both of these could be sources of RDF for Rya (for different types of use cases). Essentially I see Rya as a useful query method for data stored in DataWave, and allowing for joining with other data sets stored within Rya. They also share support for GeoWave.
> DataWave edges code: [https://github.com/NationalSecurityAgency/datawave/blob/master/warehouse/core/src/main/java/datawave/edge/util/EdgeKey.java]
> DataWave documentation: [https://code.nsa.gov/datawave/docs/2.6/getting-started/data-model#primary-data-table]
> If no-one else has started work on such a connector, I hope to find time to develop it over the coming months.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)