You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@usergrid.apache.org by tnine <gi...@git.apache.org> on 2015/07/08 23:56:26 UTC

[GitHub] incubator-usergrid pull request: Usergrid 752

GitHub user tnine opened a pull request:

    https://github.com/apache/incubator-usergrid/pull/302

    Usergrid 752

    Updates the search engine to use concurrent shard searching

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/incubator-usergrid USERGRID-752

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-usergrid/pull/302.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #302
    
----
commit 9b21332d1db5160f280fd74a3a64d82eca05e5cd
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-16T17:58:39Z

    First pass of refactor to allow concurrent tree execution.

commit aa31768cb8f6826692e4bb06f3459e1c7af4827f
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-17T00:47:34Z

    Second pass with visitor factory generation

commit 1fe69065b299797e1c2b40b59fa2fc567ed1f5e6
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-17T23:07:34Z

    Added comparator chain so that we can merge correctly

commit bb2837caaa52d5e2b4977aa5b76533ed5240c3ca
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-17T23:36:16Z

    Pushed comparator down into each column implementation.

commit 68c7eae1eb4409b067c8f3c3e4923b6b5e5a8e86
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-18T17:06:17Z

    Comparators partially implemented.
    
    Merges iterators.  Paging still incomplete.
    
    Merges iterators.  Paging still incomplete.
    
    WIP overwrite
    
    WIP overwrite

commit aa79488419bbd1c6a3ff3bfb8d187fb30bd9e046
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-24T19:20:22Z

    Wraps connection all scanners with shard filters to ensure we only process entities relevant to our shards

commit c1157449c9c2a32662423c0e14a1f73ef64042b4
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-25T16:16:07Z

    Fixes resumption and off by 1 bugs

commit f087924dd0533de5ce320f815180cf8ae25a8415
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-25T23:43:16Z

    Finished refactor of shard slice iterator.  Need to refactor cursor generation to be encapsulated within the ScanColumn.

commit efab0b935cfc60b44b7d0c79233367a55611dc84
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-30T21:13:04Z

    Finished cursor generation refactor.  Added gets for slice shard filter iterator.

commit 9971068a04db30237350742d5cb7e0c42962ba8c
Author: Todd Nine <tn...@apigee.com>
Date:   2015-06-30T23:41:27Z

    Refactor of Geo to execute per shard for faster querying rather than post filter

commit 595aa71d6512ed5f43f9ff252d28824094cf7223
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-01T17:02:48Z

    Revert of geo per shard. Geo has a hashing bug on write, and therefore does not correctly allocate the same shard as the rest of the entity on write.  Aggregate + filter is the only mechanism to return correct results without triggering a complete re-index.

commit b462b6ac4a88d41578ffca71126bb1dc76ea0dbf
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-01T20:57:22Z

    Fixes cursor generation for geo points

commit 84d77605dd1cc4d5a0b638686a2166c2430a0ca3
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-02T23:22:34Z

    Fixes bug with order by in connections

commit 501da721b6f0e2ec45c94f5e21d7fad723121dc1
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-06T18:33:05Z

    Fixes but with comparator ordering and uuid comparison when secondary compare fails

commit 4444803727620198045fd06143255495227bac4a
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-06T22:43:05Z

    Fixes multi order by
    
    Cleans up unused code and adds license headers
    
    Fixes export tools.

commit b14a9ae144e1a2836a4f3c96479851469879ded7
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-07T18:05:22Z

    First pass at concurrent merge

commit b2e1fe686a11f87e0de4abbe043e7bb28f9f6083
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-08T17:36:53Z

    Updates tests to be cleaner.
    
    Fixes stack trace on exception

commit 9a92fcc83963e40ff14c1670d881b0790d9cf643
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-08T17:37:13Z

    Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/incubator-usergrid into USERGRID-752

commit bbd563787b07a9bbc2f4a1647573a8c8ffedbc6e
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-08T20:46:56Z

    Configures thread pool

commit d872e0305e85739e1f531793560c298ed6739919
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-08T21:19:13Z

    Refactor of gather iterator to clean up coordination

commit 219a425a656d33af1c9defbb08b6d73d574dadeb
Author: Todd Nine <tn...@apigee.com>
Date:   2015-07-08T21:55:12Z

    Adds slice duplicate.  Otherwise cursor concurrency errors occur.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-usergrid pull request: Usergrid 752

Posted by tnine <gi...@git.apache.org>.
Github user tnine commented on the pull request:

    https://github.com/apache/incubator-usergrid/pull/302#issuecomment-121406917
  
    Yeah, I agree, a peer review would be ideal.  We're still doing performance testing.  Once we're happy with that, we should review everything.  I want to make sure this is performant before we push it through.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-usergrid pull request: Usergrid 752

Posted by tnine <gi...@git.apache.org>.
Github user tnine commented on the pull request:

    https://github.com/apache/incubator-usergrid/pull/302#issuecomment-119743244
  
    Do not merge yet.  I need to perform more integration testing with existing clusters.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-usergrid pull request: Usergrid 752

Posted by snoopdave <gi...@git.apache.org>.
Github user snoopdave commented on the pull request:

    https://github.com/apache/incubator-usergrid/pull/302#issuecomment-119925798
  
    This is a huge change. It might be a good idea to do a screen-sharing session with a couple of UG devs and walk through the design and code.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-usergrid pull request: Usergrid 752

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/incubator-usergrid/pull/302


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---