You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by enothereska <gi...@git.apache.org> on 2017/03/05 15:33:56 UTC
[GitHub] kafka pull request #2643: KAFKA-4843: More efficient round-robin scheduler
GitHub user enothereska opened a pull request:
https://github.com/apache/kafka/pull/2643
KAFKA-4843: More efficient round-robin scheduler
- Improves streams efficiency by more than 200K requests/second (small 100 byte requests)
- Gets streams efficiency very close to pure consumer (see results in https://jenkins.confluent.io/job/system-test-kafka-branch-builder/746/console)
- Maintains same fairness across tasks
- Schedules all records in the queue in-between poll() calls, not just one per task.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/enothereska/kafka minor-schedule-round-robin
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/2643.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2643
----
commit c3f9a1756e7b7f0e2869853bde2e249fb3f1f6d9
Author: Eno Thereska <en...@confluent.io>
Date: 2017-03-05T08:09:51Z
More efficient round robin
commit 138a491f743d5ed7017c415c9f50f974f16c8567
Author: Eno Thereska <en...@confluent.io>
Date: 2017-03-05T10:05:38Z
Tighter loop
commit caba483760eb47304e50589f66d396a2afdf0f4e
Author: Eno Thereska <en...@confluent.io>
Date: 2017-03-05T14:16:33Z
Increased records further
commit aaa14d1c95bfea0f7681f1b5686e0bc6736b13ee
Author: Eno Thereska <en...@confluent.io>
Date: 2017-03-05T15:00:06Z
Temporary reduce number of tests for quick branch builder turnaround
commit 6c616addbc86f23e9f7311f6ac1cc2e5c92152ee
Author: Eno Thereska <en...@confluent.io>
Date: 2017-03-05T15:24:29Z
Re-enable full tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] kafka pull request #2643: KAFKA-4843: More efficient round-robin scheduler
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/kafka/pull/2643
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---