You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@rya.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/12/28 19:39:00 UTC
[jira] [Commented] (RYA-377) Implement single node kafka streams
incremental SPARQL processor
[ https://issues.apache.org/jira/browse/RYA-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305687#comment-16305687 ]
ASF GitHub Bot commented on RYA-377:
------------------------------------
GitHub user kchilton2 opened a pull request:
https://github.com/apache/incubator-rya/pull/257
RYA-377 Rya Streams
This is a first draft of the Rya Streams feature. It's a single node Kafka Streams implementation of an incremental SPARQL processor. It supports most of the query use cases of the Fluo app we've written, but it does not have any periodic support yet. We still need to hook historic import and PCJ/Construct output into the source Rya instance using Kafka Connect.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kchilton2/incubator-rya RYA-377
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-rya/pull/257.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #257
----
commit 5de3aa4c529d02916e7256541a7a70c702a18505
Author: kchilton2 <ke...@...>
Date: 2017-10-03T21:08:32Z
RYA-377 Created the parent project used for all Rya Streams projects.
commit 35656c8b092fc355d62ada983e123cd8c2c787f1
Author: kchilton2 <ke...@...>
Date: 2017-10-02T21:11:04Z
RYA-377 Repackaged VisibilityBindingSet related classes to the rya.api.model project.
commit 2c2834664aaebff1efce80b106aef01165ea6a45
Author: kchilton2 <ke...@...>
Date: 2017-10-02T23:35:54Z
RYA-377 Implemented the VisibilityStatement model class.
commit 465d1d9a44adb293f420f42ba2526c3efa000147
Author: kchilton2 <ke...@...>
Date: 2017-10-04T14:37:29Z
RYA-377 Removing file that was moved.
commit bc847ddca53bdc1296f3d0f2c1156f1293531bbf
Author: kchilton2 <ke...@...>
Date: 2017-10-04T14:52:48Z
RYA-377 Created a project for holding Kafka specific Rya Streams code.
commit de65cb54e1a2ecbcbcea616aaf910a3bfd629527
Author: kchilton2 <ke...@...>
Date: 2017-10-05T19:47:41Z
RYA-377 Fixing pom error.
commit 11950e726072543c9fcee53dfd96b393dba2df37
Author: kchilton2 <ke...@...>
Date: 2017-10-05T20:01:15Z
RYA-377 Adding missing Apache 2.0 license headers.
commit 735f1be27054be9fc28c1fc38712e7ce56fd442e
Author: kchilton2 <ke...@...>
Date: 2017-10-05T18:11:02Z
RYA-377 Implement a Kafka Serializer and Deserializer for VisibilityBindingSet.
commit 6838b190d65ede61411ea3c1478cde63343eceac
Author: kchilton2 <ke...@...>
Date: 2017-10-05T18:56:27Z
RYA-377 Implement a Kafka Serializer and Deserializer for VisibilityStatement.
commit ffd7610c4665ae067a748db21f872b4251d77a3a
Author: kchilton2 <ke...@...>
Date: 2017-10-06T00:26:22Z
RYA-377 Defined a VisibilityStatement loading interface.
commit 30e4de7205916ef408192b45d7e54bce8d0d1a1b
Author: Andrew Smith <sm...@...>
Date: 2017-10-12T20:47:59Z
RYA-377 Updated version numbers
commit a7e11e45105e6fa249be42646fbc356a993ba505
Author: kchilton2 <ke...@...>
Date: 2017-10-16T21:24:04Z
RYA-377 Write a Kafka integration test that shows you can read/write VisibilityStatements to a Kafka topic.
commit 43b174955ab03d01e182f32604e03b7364cb8fc1
Author: kchilton2 <ke...@...>
Date: 2017-10-16T21:30:48Z
RYA-377 Write a Kafka integration test that shows you can read/write VisibilityBindingSets to a Kafka topic.
commit 3f71973fb50a45c4949786c210610af481acca78
Author: Andrew Smith <sm...@...>
Date: 2017-10-10T16:56:22Z
RYA-377 Client for loading triples
CLI tool for loading a triples file with
provided options for connecting to kafka.
commit 16744935866cd34f7215a96ff47b2d93f830615c
Author: kchilton2 <ke...@...>
Date: 2017-10-17T23:18:18Z
RYA-377 Define the QueryChangeLog interface for Rya Streams.
commit 218a40786fbd67b2dd0e9df35993b68ff1d8728c
Author: Andrew Smith <sm...@...>
Date: 2017-10-16T16:17:06Z
RYA-377 Loading Statements into a topic.
Conflicts:
extras/rya.streams/client/src/main/java/org/apache/rya/streams/client/command/LoadTriplesCommand.java
commit 25eba77381b31751486d2f43415c08b4a24b3225
Author: Andrew Smith <sm...@...>
Date: 2017-10-25T18:36:03Z
RYA-377 Charset problems with FindBugs and FileReader
commit 2663b8fdabfd038d0f24d558b95eb3297d349276
Author: kchilton2 <ke...@...>
Date: 2017-10-25T18:33:25Z
RYA-377 Create the DeleteQuery interface.
commit 54e0207988b5459d061901261d7d700835775801
Author: Andrew Smith <sm...@...>
Date: 2017-10-23T16:28:28Z
RYA-377 Create interactor for adding queries to Rya Streams
Added AddQueryChange interactor as well as command
for using the interactor.
commit b0be0233be1286f139cb522d637bd19e74ba9d1c
Author: kchilton2 <ke...@...>
Date: 2017-10-25T20:10:46Z
RYA-377 Implement the StreamsQuery entity and the ListQueries interactor interface.
commit 30600a837e40fbdceaa5a7191170d7eeaba38e75
Author: Andrew Smith <sm...@...>
Date: 2017-10-25T20:07:32Z
RYA-377 QueryRepository for maintaining state in Rya Streams.
Query Repository deals with interacting with the most recent
state of Rya Streams
commit ecefc3df43a4a20db68484821b59449bcd4199b5
Author: Andrew Smith <sm...@...>
Date: 2017-10-25T20:49:54Z
RYA-377 change topic -> statement in LoadStatement command
commit c08e0fefb136e9a703cb0928d3b1b0c241f70576
Author: Andrew Smith <sm...@...>
Date: 2017-10-25T20:46:36Z
RYA-377 implementation for interactor and command for Add Query.
commit b9d1417e13c4ae406ec3531824e86b4803920572
Author: kchilton2 <ke...@...>
Date: 2017-10-25T22:52:32Z
RYA-377 Implemented the InMemoryQueryRepository class.
commit 017a8e5d194f8909d32a3de33043823cc7ad78e0
Author: kchilton2 <ke...@...>
Date: 2017-10-26T17:57:08Z
RYA-377 Added missing license headers to test data.
commit 1149e0bc492a831356c6d269f7b154f1adb38ec1
Author: kchilton2 <ke...@...>
Date: 2017-10-26T19:35:42Z
RYA-377 Create the GetQueryResultStream interactor.
commit 32bc4f9442a75bba200b9cb504c99e5ba40d3edc
Author: Andrew Smith <sm...@...>
Date: 2017-10-25T23:01:53Z
RYA-377 Kafka implementation of the QueryChangeLog
Refactored serialization to be more abstract.
Changed QueryChange to be serializable.
commit 9c2cf8b46f3652986dbbd869bc4be2432f4dd73c
Author: Andrew Smith <sm...@...>
Date: 2017-10-27T19:19:11Z
RYA-377 Added connections to the Add command.
Queries can now be added to Rya Streams.
Added tests to ensure the queries were added.
commit 1ab8d14be7c250c52c92c13f5a15d58a652b232a
Author: Andrew Smith <sm...@...>
Date: 2017-10-27T19:29:47Z
RYA-377 Abstracted out command parameters
commit 2e3b676ca32ccd97ed88384f15275ac3ef97b180
Author: Andrew Smith <sm...@...>
Date: 2017-10-27T19:44:10Z
RYA-377 Added Delete Command
Added a command to delete queries from Rya Streams.
Added Tests for delete functionality.
----
> Implement single node kafka streams incremental SPARQL processor
> ----------------------------------------------------------------
>
> Key: RYA-377
> URL: https://issues.apache.org/jira/browse/RYA-377
> Project: Rya
> Issue Type: New Feature
> Reporter: Andrew Smith
> Assignee: Kevin Chilton
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)