You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kafka.apache.org by jj...@apache.org on 2020/03/30 21:50:02 UTC
[kafka] branch jjkoshy-corruptlogissue created (now 1711fb1)
This is an automated email from the ASF dual-hosted git repository.
jjkoshy pushed a change to branch jjkoshy-corruptlogissue
in repository https://gitbox.apache.org/repos/asf/kafka.git.
at 1711fb1 log message format version should be 0.10.0
This branch includes the following new commits:
new 7a812c1 [LI-HOTFIX] LIKAFKA-4425 and LIKAFKA-4424 - add quota metrics log TICKET = LI_DESCRIPTION =
new 4902305 [LI-HOTFIX] LIKAFKA-4424: Add a metric to track the total number of requests that have been throttled and rename the delay queue size metric TICKET = LI_DESCRIPTION =
new d302fa2 [LI-HOTFIX] LIKAFKA-8529: avoid duplicate app-info registrations TICKET = LI_DESCRIPTION =
new e77fd34 [LI-HOTFIX] add metadata.topic.expiry.ms config to KafkaProducer TICKET = LI_DESCRIPTION =
new bad1cc8 [LI-HOTFIX] Add kafka-jbod-reassignment.sh to generate reassignment json file for conversion from one-broker-per-disk to one-broker-per-node TICKET = LI_DESCRIPTION =
new abbfbd3 [LI-HOTFIX] LIKAFKA-12852: mirror maker with new consumer should make progress after committing to a deleted topic TICKET = LI_DESCRIPTION =
new 0b8aa43 [LI-HOTFIX] LIKAFKA-12852, attempt #2. Clear the offset map after receiving offset commit exception. TICKET = LI_DESCRIPTION =
new 8571fa0 [LI-HOTFIX] Adding metrics for log compaction threads alive TICKET = KAFKA-6588 LI_DESCRIPTION = Introduces a new metric that is useful to monitor log compaction threads in the broker. Too much overhead in open-source to introduce this metric. Hence, the hotfix.
new 5646748 [LI-HOTFIX] Clear the offset map even when the offset commit failed. We need to do this to avoid committing old offsets. TICKET = LI_DESCRIPTION =
new d481e08 [LI-HOTFIX] Consumer should fetch metadata from the same broker until it is disconnected from that broker TICKET = LI_DESCRIPTION = - HOTFIX LIKAFKA-13869; Prevent MetadataRequest starvation by trying to send MetadataRequest before the end of networkClient.poll()
new 1f73cdf [LI-HOTFIX] LIKAFKA-12720 : Buffer the fetched data for paused partitions TICKET = KAFKA-7548 LI_DESCRIPTION = "KafkaConsumer should not throw away already fetched data for paused partitions"
new 6c21f11 [LI-HOTFIX] LIKAFKA-14632 - add more heartbeat and poll timing sensors to new consumer TICKET = LIKAFKA-14632 LI_DESCRIPTION = adds "poll-interval", "last-poll-seconds-ago" and "last-heartbeat-received-seconds-ago" sensors to consumer
new ebb6508 [LI-HOTFIX] Do not let callers of BufferPool.dellocate deallocate more memory than total memory. TICKET = LI_DESCRIPTION =
new 7a67b81 [LI-HOTFIX] LIKAFKA-8072: Kafka should shutdown if it couldn't make progress in processing request TICKET = LI_DESCRIPTION = This patch adds a new config called request.processing.max.time.ms. By default its value is Long.MaxValue to be backward compatible. Network threads will log error message and call Runtime.getRuntime.halt(1) if one of the following is true: - New request can not be inserted into requestChannel after request.processing.max.time.ms - requestChannel.l [...]
new bb46d3a [LI-HOTFIX] Only read the high watermark checkpointfile (replication-offset-checkpoint) once TICKET = KAFKA-6468 LI_DESCRIPTION =
new ee3a597 [LI-HOTFIX] KAFKA-6469 Batch ISR change notifications TICKET = KAFKA-6469 LI_DESCRIPTION =
new 2a28d61 [LI-HOTFIX] LIKAFKA-11492: capture heap dump on healthcheck suicide TICKET = LIKAFKA-11492 LI_DESCRIPTION = captures a heap dump and dies if kafka broker fails to do any IO activity for a configurable amount of time
new 2ec273f [LI-HOTFIX] Allow poison pill methods to take an exit status code to use on halt RB=1340022 TICKET = LI_DESCRIPTION = Allows failing process (in this case, KafkaServer.scala) to generate heap dump and exit status code, before exiting. I think this codepath is also used by KMM (venice).
new c79483b [LI-HOTFIX] LIKAFKA-9486 followup; Initialize lastDequeueTimeMs to be Long.MaxValue TICKET = LI_DESCRIPTION =
new fcde80d [LI-HOTFIX] StopReplicaRequest should remove partitions from ReplicaManager TICKET = LI_DESCRIPTION = Due to one of our existing hotfix patch, after a broker starts, the broker may receive LeaderAndIsrRequest to become a follower for a partition, receive StopReplicaRequest for this partition, and then receive LeaderAndIsrRequest to become follower for this partition again. If we don't remove this partition from the ReplicaManager on receiving the StopReplicaRequest, then [...]
new 13372f0 [LI-HOTFIX] Add bounded flush to KafkaProducer. TICKET = KAFKA-7711 LI_DESCRIPTION = Add a bounded flush() API and timeout if producer is unable to flush all the batch records in a limited time.
new f529cd7 [LI-HOTFIX] Added controller sensors to measure queue and remote time for LeaderAndIsr, Update_metadata, Stop_replica requests TICKET = LI_DESCRIPTION = Add controller sensors for requests queue and remote times. Added kafka sensors to display LeaderAndIsr, Stop_replica, and Update_metadata request times (queue time, remote time) on InGraph. Displaying time for 999, 99, 75, 50, Avg, Max percentiles.
new 6a904fb [LI-HOTFIX] Add multiple config defaults for __consumer_offsets topic creation TICKET = LI_DESCRIPTION =
new a9d9428 [LI-HOTFIX] Log request quota metrics to kafka-quota-metrics.log TICKET = LI_DESCRIPTION =
new 320b70a [LI-HOTFIX] LIKAFKA-18568 : Adding new offset reset strategy - LICLOSEST (LI only) TICKET = LI_DESCRIPTION = New reset policy for consumers of topics affected by ULEs. Provides a trade-off between message loss and time to bootstrap the partition (aka availability).
new 32b1b3e [LI-HOTFIX] Add topic deletion hook in zookeeper to trigger in-memory topic deletion flag changes: TICKET = LI_DESCRIPTION =
new 5b99a6b [LI-HOTFIX] LIKAFKA-18349 - Reuse the same UpdateMetadataRequest object and struct to reduce controller memory usage TICKET = KAFKA-7186 LI_DESCRIPTION =
new 9b91b30 [LI-HOTFIX] Allow deleteRecordsBefore() to handle topics with only [compacted] in clean.up.policy TICKET = LI_DESCRIPTION =
new ac7ae81 [LI-HOTFIX] LIKAFKA-18966: do not expire quota sensors TICKET = LI_DESCRIPTION = The Kafka sensor for throttle time is recorded only when there is throttling and thus if a client is not throttled for a while, the sensor expires. And when it expires, it is not registered as an attribute of the corresponding mbean sensor. However, healthcheck expects this attribute to exist in the mbean sensor all the time and hence raising the attribute not found exception and polluting a [...]
new c3f4f21 [LI-HOTFIX] Showing the provided urls in the exception when no resolvable url can be found TICKET = LI_DESCRIPTION = Add url information to exception message to help debugging RB=1405576 BUG=TOOLS-194012 G=Kafka-Code-Reviews R=dolin,mgharat,rrosenbl A=rrosenbl,mgharat
new bc4791a [LI-HOTFIX] Added org.apache.kafka.common.protocol.SecurityProtocol, which is a duplicate of org.apache.kafka.common.security.auth.SecurityProtocol, to break circular dependency TICKET = LI_DESCRIPTION =
new d8a8ccf [LI-HOTFIX] KAFKA-6604; ReplicaManager should not remove partitions on the log dirctory from high watermark checkpoint file TICKET = KAFKA-6604 LI_DESCRIPTION =
new d3e3a0a [LI-HOTFIX] Log FindCoordinatorRequest send and failure to info in AbstractCoordinator TICKET = LI_DESCRIPTION = No logging for FindCooridnatorRequest send and failure makes it hard to investigate issues. Since there are no metrics for this having logging here makes investigation easier.
new feed875 [LI-HOTFIX] Reduce lock retention and improve broker shutdown time: TICKET = [KAFKA-8667, KAFKA-8668] LI_DESCRIPTION = - Avoid acquiring partitionMap lock in shutdownIdleFetcherThread - Avoid appending to the time index during shutdown if the time index has not yet be initialized
new 8aa5bd9 [LI-HOTFIX] Update fetcher thread idle flag in addPartitions TICKET = KAFKA-8667 LI_DESCRIPTION =
new 87ddb6d [LI-HOTFIX] Removing the PreferredReplicaImbalanceCount metric to make the controller performant TICKET = LI_DESCRIPTION = Avoid expensive update of PreferredReplicaImbalanceCount metric
new e302f88 [LI-HOTFIX] Mirror maker passthrough mode, including shallow iterator over record batches and producer compression config and enable passthrough for mirror maker TICKET = LI_DESCRIPTION =
new 28c6247 [LI-HOTFIX] Fix integ tests with added passthrough compression codec TICKET = LI_DESCRIPTION =
new cfe5130 [LI-HOTFIX] LIKAFKA-18913: fix bytebuffer size miscalculation when deallocating expanded buffer TICKET = LI_DESCRIPTION = When returning allocated memory buffer to available memory pool, do not return more than allocated size.
new 1bf1a8e [LI-HOTFIX] Protect UpdateMetadataRequest struct cache with a lock TICKET = LI_DESCRIPTION =
new baca2fc [LI-HOTFIX] Enforce minimum replication factor on topic creation via CreateTopicPolicy TICKET = LI_DESCRIPTION = On new topic creation, the controller will use a custom policy called LiCreateTopicPolicy to determine if new topic partition assignment satisfies minimum replication factor. If fails the check, will override the user assignment by generating new assignment with sufficient RF and write back to ZooKeeper. The same policy will also be used by each broker to vali [...]
new ca4a695 [LI-HOTFIX] LIKAFKA-20010 Disable/Enable auto-topic-creation at runtime TICKET = KAFKA-7650 LI_DESCRIPTION = enable dynamic broker config for auto-topic-creation.
new 7f3f41f [LI-HOTFIX] Add dynamic maintenance broker config TICKET = KAFKA-8527 LI_DESCRIPTION = When a broker is masked as maintenance broker, Kafka will not assign partitions of new topics to the broker if partition assignment is done by kafka brokers. 1) add dynamic broker config to support maintenance brokers 2) add logic to update maintenance broker info in controller 3) support maintenance broker in Kafka API 4) support maintenance broker in AdminZkClient 5) add logic to rea [...]
new 4a9cac6 [LI-HOTFIX] Add Apache License text to the begining of files. TICKET = LI_DESCRIPTION =
new 0f63123 [LI-HOTFIX] Add note on LinkedIn Kafka Branch to README TICKET = LI_DESCRIPTION =
new a177dbe [LI-HOTFIX] Fix NPE in KafkaConsumer Fetcher TICKET = LI_DESCRIPTION =
new 537749c [LI-HOTFIX] Rename the heap dump files to contain .hprof extension. TICKET = LI_DESCRIPTION =
new 748c377 [LI-HOTFIX] Fixed NPE in LiCreateTopicPolicy, setup test in AdminClientIntegrationTest. TICKET = LI_DESCRIPTION =
new a741190 [LI-HOTFIX] Cancel partition reassignment after topic deletion (#14) TICKET = KAFKA-8249 LI_DESCRIPTION =
new 8b26dce [LI-HOTFIX] Increase limits on non-commenting source statements (NCSS) style checks (#21) TICKET = LI_DESCRIPTION =
new d6a0365 [LI-HOTFIX] Avoid decompressing a batch under certain conditions to improve performance (reduce CPU usage). TICKET = LI_DESCRIPTION = Avoid decompressing a batch sent in ProduceRequest under the following conditions: - Batch sent by producer is greater than V1 - Version of batch sent by producer matches the boker message format version
new 30f2f3a [LI-HOTFIX] LIKAFKA-19419: Do not delete snapshot files during log recovery offset checkpoint when called for truncation TICKET = KAFKA-7452 LI_DESCRIPTION = In upstream, it is fixed by KAFKA-7557. However, we decide to keep this hotfix to provide further optimization since we are not using transactional producer in Linkedin currently. EXIT_CRITERIA = MANUAL ["when transactional producer is used"]
new 6bcbc39 [LI-HOTFIX] Create a KafkaZkClient#setOrCreatePartitionReassignment method with a single argument. TICKET = LI_DESCRIPTION = This change ensures that the API consistency is maintained with the upstream Kafka for the KafkaZkClient#setOrCreatePartitionReassignment method in Kafka 2.0. Originally this API exists in Kafka 2.0, but internal Kafka-server has removed this API when migrating from 0.11 -> 2.0, and cherry-picking this change from 2.1.
new 9dcfd84 [LI-HOTFIX] Add deletePartitionReassignment() in KafkaZkClient TICKET = LI_DESCRIPTION =
new 8f254b9 [LI-HOTFIX] Revert PR-4143: PartitionReassignmentHandler should only generate event when znode is created TICKET = LI_DESCRIPTION =
new 7431935 [LI-HOTFIX] Add logging when automatic topic creation happens in order to track which application might be relying on auto.topic.create.enable being true (#12) TICKET = LI_DESCRIPTION =
new a378c89 [LI-HOTFIX] LIKAFKA-21968: Add broker-side observer interface and NoOpObserver implementation (#6) TICKET = LI_DESCRIPTION = The observer interface lets us provide implementation which provides the usage accounting data unit for the C2S V3 service.
new 2a9a7d3 [LI-HOTFIX] add Bintray support to LinkedIn Kafka Github TICKET = LI_DESCRIPTION = This contains changes for CI builds and publishing artifacts to the maven repo under the LinkedIn Bintray account. Travis will kick off a build and publish artifacts to bintray upon creating a tag in the "x.y.z.w" format.
new de4ea93 [LI-HOTFIX] Duplicate metrics should not lead to failure (#24) TICKET = LI_DESCRIPTION =
new 7c69f9a [LI-HOTFIX] LIKAFKA-16384: brokers should suggest the max ProduceRequest ApiVersion that supports the broker default configured message format version instead of always suggesting the maximum ApiVersion. TICKET = LI_DESCRIPTION =
new 27fbe3a [LI-HOTFIX] [ScalaConsumer] Added back the old Scala consumer code, which was removed by "KAFKA-2983: Remove Scala consumers and related code (#5230)" (commit cc4dce94af8b19a796eeb7a9be78640739cb1a48) in upstream. TICKET = LI_DESCRIPTION = This patch included fix by Jon Lee from 2.0-li branch and a follow up fix by Xiongqi Welsey Wu for 2.3-li branch. EXIT_CRITERIA = MANUAL ["When old Scala consumer is no longer needed"]
new 36436a0 [LI-HOTFIX] LIKAFKA-5686: Add error logging for topic, partition and offset information for invalid message. TICKET = LI_DESCRIPTION =
new 16789e2 [LI-HOTFIX] LIKAFKA-8207: Changed the old consumer TopicPartitionChangeListner to listen on child changes of the topic path TICKET = LI_DESCRIPTION =
new 0289a95 [LI-HOTFIX] Implement metrics to detect inactive MirrorMakerThread and AbstractFetcherThread TICKET = LI_DESCRIPTION = Add MaxFetcherThreadInactiveTimeMs and MirrorMaker-maxMirrorMakerThreadNoCommitTimeMs metrics Part of this fix has been moved to "Added back the old scala consumer code" patch
new 219c90f [LI-HOTFIX] Avoid NPE if two topics are created back to back. See LIKAFKA-10614 TICKET = LI_DESCRIPTION =
new 37acae8 [LI-HOTFIX] Support old consumer SSL TICKET = LI_DESCRIPTION =
new f334137 [LI-HOTFIX] relex method length checkstyle requirements since hotfix makes some method longer TICKET = LI_DESCRIPTION = EXIT_CRITERIA = MANUAL ["when the method length doesn't go beyond the upstream defined 150 line maximum "]
new 660839d [LI-HOTFIX] About supporting old consumer SSL, changes the ConsumerFetcherManager to get bootstrap server values from ZK instead of cfg2 TICKET = LI_DESCRIPTION = obtain bootstrap servers from zookeeper for old consumers
new 1855ccb [LI-HOTFIX] fix selector leak in ZookeeperConsumerConnector LI_DESCRIPTION = fix selector leak in ZookeeperConsumerConnector TICKET =
new d0c006b [LI-HOTFIX] Old consumer client should not trigger topic re-creation for deleted topics, when auto.create.topics.enable=true on broker TICKET = LI_DESCRIPTION = Metadata request can trigger topic re-creation of a deleted topic, if cluster has auto topic creation enabled
new 4c95a53 [LI-HOTFIX] Expose last committed offsets in ZookeeperConsumerConnector (old consumer) to facilitate old consumer migration in kafka-rest TICKET = LI_DESCRIPTION =
new f7835f6 [LI-HOTFIX] Make lastCommittedPartitionsAndOffsets volatile in ZookeeperConsumerConnector TICKET = LI_DESCRIPTION =
new 2024c6d [LI-HOTFIX] LIKAFKA-19608 Refresh bootstrap server in ConsumerFetcherManager when TopicMetadata request fails TICKET = LI_DESCRIPTION = As part of GDPR, the bootstrap server were fetched from the ZK for updating TopicMetadata. This list of bootstrap servers was never refreshed after reboot. Recently all the broker in Kafka cluster were swapped out resulting in all TopicMetadata fetch request to fail because the request was being set to decommissioned brokers.
new dc8a49a [LI-HOTFIX] passthrough performance improvement in Log.append TICKET = LI_DESCRIPTION = Broker-side changes for pass-through solution
new 44ed09d [LI-HOTFIX] Add recompressionRate sensor TICKET = LI_DESCRIPTION =
new d977af4 [LI-HOTFIX] Exclude topics being deleted from the offlinePartitionCount metric and clean up partitionState in PartitionStateMachine after topic deletion is done (#13) TICKET = LI_DESCRIPTION =
new 83be700 [LI-HOTFIX] Always set lastCommittedPartitionsAndOffsets in scala consumer (#26) TICKET = LI_DESCRIPTION =
new e0c7183 [LI-HOTFIX] Fix flush behavior
new 2eb5359 [LI-HOTFIX] LIKAFKA-24478: Reduce UpdateMetadataRequest toString() result (#27) TICKET = LI_DESCRIPTION = In large clusters with large metadata size the UpdateMetadataRequest::toString can generate really large strings. If there are n/w issue these strings are logged resulting in lots of these string to be generated and cause high memory usage.
new 5d9de17 [LI-HOTFIX] Clean up purgatory when leader replica is kicked out of replica list. TICKET = KAFKA-8571
new 2a928d5 [LI-CHERRY-PICK] [4fdfe2b2] KAFKA-8591; WorkerConfigTransformer NPE on connector configuration reloading (#6991) TICKET = KAFKA-8591 LI_DESCRIPTION = EXIT_CRITERIA = HASH [4fdfe2b2c4f744b0e9a8ac1c36f68c3fa58c48e3] ORIGINAL_DESCRIPTION =
new 39d0b85 [LI-CHERRY-PICK] [b725b3cb] KAFKA-8653; Default rebalance timeout to session timeout for JoinGroup v0 (#7072) TICKET = KAFKA-8653 LI_DESCRIPTION = EXIT_CRITERIA = HASH [b725b3cb2e18278669023edc90ab4585c6624b9a] ORIGINAL_DESCRIPTION =
new 13090cb [LI-CHERRY-PICK] [1052d87d] KAFKA-5998: fix checkpointableOffsets handling (#7030) TICKET = KAFKA-5998 LI_DESCRIPTION = EXIT_CRITERIA = HASH [1052d87d37bdc0bab085de2bcf8f49a344dfcdd5] ORIGINAL_DESCRIPTION =
new 4f982aa [LI-CHERRY-PICK] [62617b93] Fixes #8198 KStreams testing docs use non-existent method pipe (#6678) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [62617b93d13215716600aa498f6806978be07c30] ORIGINAL_DESCRIPTION =
new 1bbcfbe [LI-CHERRY-PICK] [2400f729] KAFKA-6605: Fix NPE in Flatten when optional Struct is null (#5705) TICKET = KAFKA-6605 LI_DESCRIPTION = EXIT_CRITERIA = HASH [2400f729a1069393503b8657cb69ed524c466ff4] ORIGINAL_DESCRIPTION =
new c3f7bc0 [LI-CHERRY-PICK] [813bf6c3] KAFKA-7157: Fix handling of nulls in TimestampConverter (#7070) TICKET = KAFKA-7157 LI_DESCRIPTION = EXIT_CRITERIA = HASH [813bf6c31ee84f66f517cfb6f44ca8abce37dcb9] ORIGINAL_DESCRIPTION =
new b115540 [LI-CHERRY-PICK] [5942700a] HOT FIX: close RocksDB objects in correct order (#7076) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [5942700a45363170c914f5a450bba0d9b3ca05d8] ORIGINAL_DESCRIPTION =
new 48e6981 [LI-CHERRY-PICK] [0f0093c1] KAFKA-8620: fix NPE due to race condition during shutdown while rebalancing (#7021) TICKET = KAFKA-8620 LI_DESCRIPTION = EXIT_CRITERIA = HASH [0f0093c1693d6ea4091228cd3a87db0219d028a2] ORIGINAL_DESCRIPTION =
new 4712752 [LI-CHERRY-PICK] [a32918b1] KAFKA-8637: WriteBatch objects leak off-heap memory (#7050) TICKET = KAFKA-8637 LI_DESCRIPTION = EXIT_CRITERIA = HASH [a32918b17766e24196e0af30daa19703986d3ee0] ORIGINAL_DESCRIPTION =
new 0e24ddf [LI-CHERRY-PICK] [27eba249] KAFKA-8662; Fix producer metadata error handling and consumer manual assignment (#7086) TICKET = KAFKA-8662 LI_DESCRIPTION = EXIT_CRITERIA = HASH [27eba2494b698ba48c6fbf3851ed36b5a287db22] ORIGINAL_DESCRIPTION =
new f25708c [LI-CHERRY-PICK] [426f4c7a] KAFKA-8530; Check for topic authorization errors in OffsetFetch response (#6928) TICKET = KAFKA-8530 LI_DESCRIPTION = EXIT_CRITERIA = HASH [426f4c7ac7fb46b0bf61541f84fca01ddbf72458] ORIGINAL_DESCRIPTION =
new 5a2d6c5 [LI-CHERRY-PICK] [011ec517] KAFKA-8602: Separate PR for 2.3 branch (#7092) TICKET = KAFKA-8602 LI_DESCRIPTION = EXIT_CRITERIA = HASH [011ec517f15cbcec4c7499980202a9f5485dabbf] ORIGINAL_DESCRIPTION =
new bf2735d [LI-CHERRY-PICK] [6f189d96] KAFKA-8670; Fix exception for kafka-topics.sh --describe without --topic mentioned (#7094) TICKET = KAFKA-8670 LI_DESCRIPTION = EXIT_CRITERIA = HASH [6f189d9609d513054ea31d2e997432a8a7635344] ORIGINAL_DESCRIPTION =
new 1f2d32b [LI-CHERRY-PICK] [3d7b989c] KAFKA-8615: Change to track partition time breaks TimestampExtractor (#7054) TICKET = KAFKA-8615 LI_DESCRIPTION = EXIT_CRITERIA = HASH [3d7b989cb7b6d48acefbb748b0927be2505c8da8] ORIGINAL_DESCRIPTION =
new e3e29d0 [LI-CHERRY-PICK] [23714574] KAFKA-8635; Skip client poll in Sender loop when no request is sent (#7085) TICKET = KAFKA-8635 LI_DESCRIPTION = EXIT_CRITERIA = HASH [23714574ae440654c23cc790af8d925ba85d7e40] ORIGINAL_DESCRIPTION =
new 90dd97e [LI-CHERRY-PICK] [aa1a285e] MINOR: Remove stale streams producer retry default docs. (#6844) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [aa1a285ed8babf1f39571440378162144c1453bf] ORIGINAL_DESCRIPTION =
new 1b1b6a8 [LI-CHERRY-PICK] [6916e861] MINOR: Update documentation for enabling optimizations (#7099) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [6916e8618c609a018df405b79e62fa550289e475] ORIGINAL_DESCRIPTION =
new 9b8230e [LI-CHERRY-PICK] [f94ec1c3] KAFKA-8678; Fix leave group protocol bug in throttling and error response (#7101) TICKET = KAFKA-8678 LI_DESCRIPTION = EXIT_CRITERIA = HASH [f94ec1c37088569931df706fd09fb1d1808f9be3] ORIGINAL_DESCRIPTION =
new d50e53c [LI-CHERRY-PICK] [c29380f4] KAFKA-8715; Fix buggy reliance on state timestamp in static member.id generation (#7116) TICKET = KAFKA-8715 LI_DESCRIPTION = EXIT_CRITERIA = HASH [c29380f40d0db6d0c4a549117ba910f915a5053a] ORIGINAL_DESCRIPTION =
new d2d71e0 [LI-CHERRY-PICK] [f86f7e21] KAFKA-8731: InMemorySessionStore throws NullPointerException on startup (#7132) TICKET = KAFKA-8731 LI_DESCRIPTION = EXIT_CRITERIA = HASH [f86f7e21d986b7cda3cf8c2e53b8500625846fa2] ORIGINAL_DESCRIPTION =
new 93adb6c [LI-CHERRY-PICK] [7b52feb8] MINOR: Avoid dividing by zero (#7143) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [7b52feb8deeeaf9af480161445be03ce979651ef] ORIGINAL_DESCRIPTION =
new 7fd0832 [LI-CHERRY-PICK] [0826d6e9] KAFKA-8736: Streams performance improvement, use isEmpty() rather than size() == 0 (#7164) TICKET = KAFKA-8736 LI_DESCRIPTION = EXIT_CRITERIA = HASH [0826d6e90d4ff9648f512cdd9bc00307d4ef3b3e] ORIGINAL_DESCRIPTION =
new 932a4be [LI-CHERRY-PICK] [8e870416] MINOR: Upgrade jackson-databind to 2.9.9.3 (#7125) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [8e870416e7929101679c66cbc0f3730f9d5bd003] ORIGINAL_DESCRIPTION =
new 995b533 [LI-CHERRY-PICK] [04cf8fb2] KAFKA-8550: Fix plugin loading of aliased converters in Connect (#6959) TICKET = KAFKA-8550 LI_DESCRIPTION = EXIT_CRITERIA = HASH [04cf8fb2c116812abaa1b348d5e30536b4a1061c] ORIGINAL_DESCRIPTION =
new a674b56 [LI-CHERRY-PICK] [b85707c0] KAFKA-8774: Regex can be found anywhere in config value (#7197) TICKET = KAFKA-8774 LI_DESCRIPTION = EXIT_CRITERIA = HASH [b85707c0fdb4c11448cdb5a1938e0488ddc91102] ORIGINAL_DESCRIPTION =
new 4bd037b [LI-CHERRY-PICK] [24269269] KAFKA-7941: Catch TimeoutException in KafkaBasedLog worker thread (#6283) TICKET = KAFKA-7941 LI_DESCRIPTION = EXIT_CRITERIA = HASH [24269269b58cba9a826d0ab507e1fcf89f814666] ORIGINAL_DESCRIPTION =
new 4e1ccbe [LI-CHERRY-PICK] [8d70218d] KAFKA-8391; Improved the Connect integration tests to make them less flaky TICKET = KAFKA-8391 LI_DESCRIPTION = EXIT_CRITERIA = HASH [8d70218de2ab8637f922a43993020216e57404c8] ORIGINAL_DESCRIPTION =
new ba41910 [LI-CHERRY-PICK] [f81189cd] KAFKA-8736: Track size in InMemoryKeyValueStore (#7177) TICKET = KAFKA-8736 LI_DESCRIPTION = EXIT_CRITERIA = HASH [f81189cd3915f0876f8e2ed440269c9c0ecea1e9] ORIGINAL_DESCRIPTION =
new f807018 [LI-CHERRY-PICK] [d5eda1ea] KAFKA-8791: RocksDBTimestampedStore should open in regular mode by default (#7201) TICKET = KAFKA-8791 LI_DESCRIPTION = EXIT_CRITERIA = HASH [d5eda1eac8314cc3107208c1098e1f89d41c2ed5] ORIGINAL_DESCRIPTION =
new e14fb47 [LI-CHERRY-PICK] [90386e89] MINOR: Correct typo in test name `TimetampedSegmentsTest` (#7210) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [90386e89be4d294baf63911af9012493a3faa35a] ORIGINAL_DESCRIPTION =
new 32fc264 [LI-CHERRY-PICK] [4d0cc439] KAFKA-8788: Optimize client metadata handling with a large number of partitions (#7192) TICKET = KAFKA-8788 LI_DESCRIPTION = EXIT_CRITERIA = HASH [4d0cc439eea0c57aba508fae257c366edfd39028] ORIGINAL_DESCRIPTION =
new b5f003a [LI-CHERRY-PICK] [9cb27f5f] MINOR: Fix bugs in handling zero-length ImplicitLinkedHashCollections (#7163) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [9cb27f5f80b82aca65ccb89f3b9ba4d07222c9df] ORIGINAL_DESCRIPTION =
new a1732a7 [LI-CHERRY-PICK] [051d2909] KAFKA-8802: ConcurrentSkipListMap shows performance regression in cache and in-memory store (#7212) TICKET = KAFKA-8802 LI_DESCRIPTION = EXIT_CRITERIA = HASH [051d29098ac7529f54475899c3441ed918a6882c] ORIGINAL_DESCRIPTION =
new a89170a [LI-CHERRY-PICK] [71e20193] KAFKA-8800: Increase poll timeout in poll[Records]UntilTrue (#7211) TICKET = KAFKA-8800 LI_DESCRIPTION = EXIT_CRITERIA = HASH [71e20193e1fe70e10e4c6961a6db14768f6e0c88] ORIGINAL_DESCRIPTION =
new 1a4492d [LI-CHERRY-PICK] [e323f4be] MINOR: Fixing log format typo (#7219) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH [e323f4be5deceb1e6f48a7f179e0447000e8e6a4] ORIGINAL_DESCRIPTION =
new e194c85 [LI-HOTFIX] include gradle wrapper and ignore a failed unit test due to port binding error for travis build (#37)
new da8d07a [LI-CHERRY-PICK] [db8cb96a] KAFKA-8325; Remove batch from in-flight requests on MESSAGE_TOO_LARGE errors (#7176) TICKET = KAFKA-8325 LI_DESCRIPTION =
new 52e2cd5 [LI-CHERRY-PICK] [91000095] KAFKA-8824: bypass value serde on null (#7235) TICKET = KAFKA-8824 LI_DESCRIPTION =
new afe27b4 [LI-CHERRY-PICK] [1a5062cc] KAFKA-8586: Fail source tasks when producers fail to send records (#6993) TICKET = KAFKA-8586 LI_DESCRIPTION =
new 7eb9b2a [LI-CHERRY-PICK] [5b4e749d] KAFKA-8391; Temporarily ignore flaky Connect rebalance integration tests TICKET = KAFKA-8391 LI_DESCRIPTION =
new d902f8d [LI-HOTFIX] add prepare-commit-msg hook to help format commit message (#38)
new 851a0f9 [LI-HOTFIX] add back old parseAndValidateAddresses API for backward compatibility (#39)
new 5ffb0db [LI-HOTFIX] embed versioning information in jars (#45)
new 33c52ea [LI-HOTFIX] embed versioning information in jars (v2) (#46)
new c2a69f3 [HOTFIX] Allocate correct size for ArrayList when parsing UpdateMetadataRequest (#51)
new 223587f [LI-HOTFIX] Log the partition being made online due to unclean leader election. (#52)
new d6b30ae Implementation of memory pool based on weak references. (#49)
new 15ee7e2 Preallocate maps with exact size instead of the default(which is 16) (#50)
new 85ebb3a [LI-HOTFIX] Make client-side auto.topic.creation configurable and def… (#54)
new 89d1672 [LI-HOTFIX] Separate Kafka Controller Node from Non-Controller Node (#42)
new b55f699 [LI-HOTFIX] exclude stream artifacts and connect artifacts from travis ci publication (#56)
new 3f78c42 [LI-HOTFIX] fix hard coded travis tag (#57)
new c8f3afc [LI-HOTFIX] Do not throw exceptions when internal headers are set and the coordinated channel with the broker is using Message_v1(magic = 1) (#58)
new aef87f918 Add counters for the following: (#59)
new 7c06d74 [LI-HOTFIX] Add sensor to collect statistics of KafkaChannel memory allocation size.
new 83b4112 [LI-HOTFIX] Change default value of config delivery.timeout.ms to MAX_INT.
new 1a4c6fd [LI-HOTFIX] Add support to use BoringSSL for SSL/TLS.
new c432d86 [LI-HOTFIX] Rollback KAFKA-7440 as a workaround for KAFKA-9212. (#61)
new 16dfeec [LI-HOTFIX] Remove KafkaZkClient#setOrCreatePartitionReassignment and add AdminZkClient#addPartitions (#60)
new 49d8318 [LI-HOTFIX] Rollback hotfix to pick up fix for KAFKA-9212 and KAFKA-9261. (#63)
new f5a78f4 [LI-HOTFIX] Guard costly trace- and debug-level logging to avoid unnecessary resource use during index operations. (#64)
new 23b1453 [LI-HOTFIX] Fix typo in docString of UpdateMetadataRequest. (#55)
new 12417cc [LI-HOTFIX] Improve shutdown performance via lazy accessing the offset and time indices. (#65)
new db8ecf6 [LI-HOTFIX] pick up KAFKA-8104 with modification (#66)
new 40065ac [LI-CHERRY-PICK][dca1bf1] Fix LazyTimeIndex & LazyOffsetIndex concurrency (#67)
new da84506 [LI-HOTFIX] Be ultra lazy in loading lazy indices during index deletion. (#68)
new 58acea2 [LI-HOTFIX] kafka-run-class.sh SCALA_VERSION should match gradle.properties TICKET = LI_DESCRIPTION = This is a follow-up to an earlier hotfix 2a9a7d3d2992f11f05ff4c147abd7f8d46935336 which added bintray support to LinkedIn Kafka Github. The Scala version in the run script needs to be updated.
new b345165 basic stress tool
new 281a036 add sample log configuration
new 4adc50fa props should be in kafkaconfig style
new c53a41a apply the right configs
new b62bc50 add tailing reader threads
new 1711fb1 log message format version should be 0.10.0
The 153 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.