You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@usergrid.apache.org by snoopdave <gi...@git.apache.org> on 2016/11/10 17:46:51 UTC

[GitHub] usergrid pull request #562: Embedded Queueing System based on Akka

GitHub user snoopdave opened a pull request:

    https://github.com/apache/usergrid/pull/562

    Embedded Queueing System based on Akka

    Queue implementation as described here:
    https://issues.apache.org/jira/browse/USERGRID-1318


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/usergrid usergrid-1318-queue

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/usergrid/pull/562.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #562
    
----
commit 461076c389ba8413cbbb1b596dba9439af35a8b9
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-02T21:23:15Z

    Fixing links to point to mirrors.

commit a8cd381d5dd1c3b66639fe2f8f883927d2e897fc
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-07T19:46:05Z

    Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid
    
    * 'master' of https://git-wip-us.apache.org/repos/asf/usergrid: (50 commits)
      Fix reactivateTest and handle re-activation differently from auto-activation with confirmation requirements.
      Fix issue with admin user confirmation flag not working when trying to disable emails.
      Moving older SDKs to a difference location and updating main README to link to new SDK locations.
      Removing the old Java SDK.
      Moving the Android SDK to https://github.com/apache/usergrid-android
      Moving the .NET SDK to https://github.com/apache/usergrid-dotnet
      Moving the Java SDK to https://github.com/apache/usergrid-java
      Moving the Javascript SDK to https://github.com/apache/usergrid-javascript.
      Moving the Node.js SDK to https://github.com/apache/usergrid-nodejs.
      Moving Python SDK to https://github.com/apache/usergrid-python
      Fix UniqueValueManager tool to work with datastax driver in the unique value serialization strategy.
      Moving Swift SDK to https://github.com/apache/usergrid-swift.
      Update test for collection level authoritative region setting.
      Rename the cluster authoritative region parameters/methods to be more specific.
      Set non-clustered unique value verification loading back to the non-consistent read consistency level.
      Use StringUtils.isEmpty() to determine if region is not set.
      Move shard logging statement to TRACE level.
      Don't shut down full actor system when the JVM exists ( this affects actors running on other hosts ).
      fix duplicate user test to use random usernames in case DB cleanup not done correctly
      Allow GET /management/me with local UG tokens when External SSO is enabled.
      ...

commit 1574b3af4765777f8693c79b6c1bea836812e6bc
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-09T20:35:38Z

    Make TableDefinition into an interface, move to cassandra-all 2.1.14

commit 9016fd290e80b88ba3199c0020fca7722b82d780
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-09T21:31:44Z

    Move under org.apache.usergrid.persistence package in preparation for integration into Usergrid.

commit 3075dce1631cc7f225ddb34aa08fb16a4a8f486a
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-13T17:44:42Z

    Initial integration of Qakka into Usergrid Queue module, and implementation of Qakka-based LegacyQueueManager implementation.

commit f47a5f65add96bbd066c88e085bc1d6aac0cc3c2
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-14T16:23:55Z

    Changes to make Queue / Hakka tests run with fewer intermittent failures.

commit 7fdba4a2cfa6d18047b5b893382806a342a78eff
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-14T17:25:21Z

    Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid
    
    * 'master' of https://git-wip-us.apache.org/repos/asf/usergrid:
      Add unique value index update option to UniqueValueManager tool.
      Add support for application and organization client credentials to be passed in Authorization header.
      Fix NPE when user doesn't exist after lookup from the unique value index.
      Use URLs (like admin reset password URL) from properties if they are provided.

commit ffeadb20878d03002dd7a77fa9dacd6be614ec4b
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-14T17:36:14Z

    Merge branch 'master' into usergrid-1318-queue

commit ee0dda4cca0ff5cd56b9574f998222f439fa948c
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-14T20:08:30Z

    Still some intermittent failures in the queue module, but now able to get through ALL Usergrid tests w/Qakka

commit 483ca0f5485891f2acc5d3b1a921d68c87d1d647
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-16T11:48:09Z

    switch Qakka to using two keyspaces, the original replicated Applications one and a new un-replicated Applications Local one

commit 447b60d4364c9f705a1350f11288dbad6ed3673c
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-16T11:49:02Z

    Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid into usergrid-1318-queue
    
    * 'master' of https://git-wip-us.apache.org/repos/asf/usergrid:
      allow no password when creating admin users when SSO-enabled
      Load properties into Guice by using the getProperty method instead of generic putAll from Map superclass as it getProperty could be overridden
      add count to paged organizations get, and fix limit=1000
      Refactor superuser authentication/login such that permissions are handled more appropriately, allowing access to all parts of the system.
      Enhance superuser basic auth filter to login to shiro with a token just like the sysadmin tokens.
      Adding paging to get all orgs endpoint.  Enhance Akka cluster so it properly downs nodes that are restarted but still ok on the network. Don't load all orgs when validating sysadmin creds.

commit 99dbfc2d17e330583560d386b6ecb5cce93fa3e5
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-16T13:39:51Z

    Fixes to get all tests passing again.

commit 79c5499799007e24ea1784f6fd8b21f2225c668b
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-16T18:52:32Z

    Move router producer registration to CpEntityManagerFactory

commit 6f983a4c0fcf65dfabb048568c341b3698afbf25
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-16T18:53:12Z

    Don't include test classes in prod release

commit 832b505c75724ed61a2d5869727208cbabf5ce13
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-16T18:54:35Z

    Don't init queue in constructor

commit 18e4305b995be88947b72172dd22056702659a8e
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-16T22:33:10Z

    Changes to get Qakka using same injector as rest of Usergrid

commit e09e74932642c7783888639d67218cfb0a117ddd
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-17T15:01:01Z

    Exclude logback-classic as it was borking our logging setup.

commit 03eb31246839bca237c7f761cc4cdece74596bb3
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-17T17:01:02Z

    Adding distributedQueueManager.init() to CpEntityManagerFactry startup, needed to start queue refreshers, time-outers and shard allocators.

commit a0b0f717bb1a23e4879282726045eba12514850d
Author: Michael Russo <mr...@apigee.com>
Date:   2016-09-17T18:50:34Z

    Update bootstrap/init logic so avoid race conditions in writing a new queue to the database.

commit c08e8f0e72321a238209265161c5c6fb1181923c
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-19T16:15:41Z

    Make ReplicatedIndexAlias serializable

commit 434e53e7eed46fbdc3cdeafde9464c90101fa7e3
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-20T16:18:33Z

    Implement configurable long polling for Qakka queue gets

commit 6c204b9f046fa9ea234d7e608b940ead60fb6720
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-20T17:27:17Z

    Ensure local keyspace has unique name per datacenter / region.

commit 8b79fb875a3aea88458e08429286d2119d6a3c88
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-20T18:30:20Z

    Introduce maxTtl for queue message and message payload data, default is two weeks.

commit 9306f12eea8cd8f0ad0b2ec4751cd8a9b9ba5382
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-21T12:34:28Z

    Complete message counter and add support for getQueueDepth() in QakkaQueueManager

commit 727ff1d642fdaf3768ab2b1f0c07364854ec2e60
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-21T17:48:47Z

    When writing to queue, if in-memory queue is empty then refresh will be done.

commit c08e02a914d98bd048f997cddd47b343ba9908c1
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-22T11:47:07Z

    Use same timeout value as old queue implementation did

commit 00eb13965e2b31bc1c57e437ceac0a42f6610861
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-22T11:47:44Z

    Make DatabaseQueueMessage serializable because it is sent in Akka messages

commit 2cd8ecb30fc5f97927ec000573daba2ba16e914f
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-23T16:47:29Z

    Now supports elasticsearch.queue_impl=MULTIREGION setting instead of SNS, also more/better DEBUG logging

commit 5a19ba9a748c5d96f5356d77df1e7845aa92fc0f
Author: Dave Johnson <sn...@apache.org>
Date:   2016-09-30T21:18:24Z

    Change to use proper Guice injection instead of static injector kludge.

commit 781b894a65851e4e8a4ff2fac84b644e5b72c12d
Author: Dave Johnson <sn...@apache.org>
Date:   2016-10-03T14:45:22Z

    Fixes to get tests running consistently.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] usergrid pull request #562: Embedded Queueing System based on Akka

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/usergrid/pull/562


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---