You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by dguy <gi...@git.apache.org> on 2017/04/12 13:50:02 UTC

[GitHub] kafka pull request #2846: [WIP]: Exactly once transactional coordinator

GitHub user dguy opened a pull request:

    https://github.com/apache/kafka/pull/2846

    [WIP]: Exactly once transactional coordinator

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/confluentinc/kafka exactly-once-transactional-coordinator

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/kafka/pull/2846.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2846
    
----
commit 40fa5f01866da411f1631c520ac6400a6ea9b6ba
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-02T01:42:49Z

    Transaction log message format (#134)
    
    * add transaction log message format
    * add transaction timeout to initPid request
    * collapse to one message type

commit 1b2df91b19dacf2cd8a5548c86b227104e8bbc67
Author: hachikuji <ja...@confluent.io>
Date:   2017-03-07T00:40:53Z

    Implement FindCoordinatorRequest for transaction coordinator (#140)

commit 7a681649ec14e4b00df734fe584bd9dbb955e379
Author: hachikuji <ja...@confluent.io>
Date:   2017-03-08T07:00:19Z

    Exactly once transactions request types (#141)

commit a9c32758592112750569f7fd41b538e7500dc959
Author: Apurva Mehta <ap...@confluent.io>
Date:   2017-03-15T20:47:25Z

    Fix build and test errors due to reabse onto idempotent-producer branch

commit 20701f17c20e8121d125bdc11008fb9407f54d11
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-17T05:40:49Z

    Transaction log partition Immigration and Emigration (#142)
    
    * sub-package transaction and group classes within coordinator
    * add loading and cleaning up logic
    * add transaction configs

commit 711657e3b3dead9c7612965def930d01daea6592
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-21T04:38:35Z

    Add transactions broker configs (#146)
    
    * add all broker-side configs
    * check for transaction timeout value
    * added one more exception type

commit bb5c14fd2473abc1b340fcd6d3c5d0dbd787f4a4
Author: Apurva Mehta <ap...@gmail.com>
Date:   2017-03-30T22:13:11Z

    CPKAFKA-465 : Implement READ_COMMITTED mode in the KafkaConsumer (#145)

commit 109ee0e4e7605f92885f6f1994c4efddb42bcc50
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-31T22:20:05Z

    Handle addPartitions and addOffsets on TC (#147)
    
    * handling add offsets to txn
    * add a pending state with prepareTransition / completeTransaction / abortTransition of state
    * refactor handling logic for multiple in-flight requests

commit 846ea79a109e3cb9912832c2a9ed77700b066ef7
Author: Apurva Mehta <ap...@confluent.io>
Date:   2017-04-03T21:17:25Z

    Fix test errors after rebase:
    
     1. Notable conflicts are with the small API changes to
    DelayedOperation and the newly introduced purgeDataBefore PR.
    
     2. Jason's update to support streaming decompression required a bit of
    an overhaul to the way we handle aborted transactions on the consumer.

commit 8596871dd8794058fd124f8bbe722c99f0443cac
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-24T18:46:14Z

    change write txn request protocol

commit a2995e1f449e297ff2fcd10ceb1f617e7a343f65
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-24T22:42:53Z

    fix unit tests

commit a4765159028f920f7160e3617dcabee74a7e1981
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-24T22:52:37Z

    add sender thread

commit 511d509069fb30f72d0ef394ab9ba23daf866d19
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-28T01:04:53Z

    rename TC Send Thread to general inter-broker send thread

commit 135c0009db4df8d39a50a6e232b98aff3dbdf057
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-29T21:58:45Z

    add tc channel manager

commit ca1ee8a701a6f353baa4fe0450ee1220f276baac
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-29T21:59:26Z

    missing files

commit f98b6addeaf7f7aae11031700f920d8ab214c992
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-31T22:15:37Z

    add the txn marker channel manager

commit fcc48e52a686418aef7573cf54167976aaea2018
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-05T16:09:27Z

    fix compilation errors

commit 46c5ea238589eba58fab840d6025d95b9381c5e9
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-10T10:58:43Z

    integrate EndTxnRequest

commit 7f53430e6febd5a8bc4ab479eb08b2df8d4d14fc
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-10T13:43:40Z

    add test fo InterBrokerSendThread. Refactor to use delegation rather than inheritance

commit 76532ed936a8ca61af4a055d1fb5f65020e4e9b5
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-10T16:24:24Z

    refactor TransactionMarkerChannelManager. Add some test

commit 62cdf3a47e3cf430fc18e093b7f91dfed71d9dd3
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-10T18:25:57Z

    more tests

commit ec72f8cda2cbbd6c1887c7c427392e2387ae8c5a
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-11T09:23:36Z

    remove some answered TODOs

commit b1981310e290501eeea05121ecd42f3a665a4675
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-11T15:46:37Z

    update to WriteTxnMarkersRequest/Response from Trunk

commit 2e8d892dff21bfb74aa4edff971006d608ab73a5
Author: Damian Guy <da...@gmail.com>
Date:   2017-04-11T16:19:01Z

    add missing @Test annotation

commit 4d17b7c96293ca8f9735049070512be9707aba27
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-02T01:42:49Z

    Transaction log message format (#134)
    
    * add transaction log message format
    * add transaction timeout to initPid request
    * collapse to one message type

commit af926510d2fd455a0ea4e82da83e10cde65db4e9
Author: Apurva Mehta <ap...@confluent.io>
Date:   2017-03-15T20:47:25Z

    Fix build and test errors due to reabse onto idempotent-producer branch

commit fc3544bf6b55c48d487ef2b7877280d3ac90debb
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-17T05:40:49Z

    Transaction log partition Immigration and Emigration (#142)
    
    * sub-package transaction and group classes within coordinator
    * add loading and cleaning up logic
    * add transaction configs

commit fc5fe9226dd4374018f6b5fe3c182158530af193
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-21T04:38:35Z

    Add transactions broker configs (#146)
    
    * add all broker-side configs
    * check for transaction timeout value
    * added one more exception type

commit ef390df0eacc8d1f32f96b2db792326a053a5db1
Author: Guozhang Wang <wa...@gmail.com>
Date:   2017-03-31T22:20:05Z

    Handle addPartitions and addOffsets on TC (#147)
    
    * handling add offsets to txn
    * add a pending state with prepareTransition / completeTransaction / abortTransition of state
    * refactor handling logic for multiple in-flight requests

commit 2a6526a861546eb4102b900d1da703fd2914bd43
Author: Apurva Mehta <ap...@confluent.io>
Date:   2017-04-07T19:49:19Z

    Fix build errors after rebase onto trunk and dropping out the request stubs and client changes.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] kafka pull request #2846: KAFKA-5059: Exactly once transactional coordinator

Posted by dguy <gi...@git.apache.org>.
Github user dguy closed the pull request at:

    https://github.com/apache/kafka/pull/2846


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---