You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ratis.apache.org by Attila Doroszlai <ad...@apache.org> on 2023/02/27 15:08:04 UTC

[DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Hi all,

I would like to propose preparing maintenance releases of Ratis
Third-party and Ratis with the following changes since 1.0.3 and
2.4.1, respectively:

Ratis Thirdparty 1.0.4
* RATIS-1760. Bump Netty to 4.1.86.Final to fix CVE-2022-41881

Ratis 2.4.2
* RATIS-1748. Cache getMetricName to reduce garbage
* Changes required for Ozone certificate improvements (RATIS-1747, RATIS-1753)
* RATIS-1745. Improve performance of AwaitForSignal by reducing amount
of exceptions created
* RATIS-1754. Set leader to null when stepping down
* RATIS-1756. Consistent usage of gapThreshold in getMajorityMin
* RATIS-1776. Switch to slf4j-reload4j
* RATIS-1792. Replace parallelStream usage in PeerProxyMap

Is there any other fix that should be backported from master to branch-2?

thanks,
Attila

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Xinyu Tan <tx...@gmail.com>.
Hi,

We Apache IoTDB Community have fixed many bugs based on the 2.4.1 branch.
We want to include these commits in the next release of Ratis.

Here are the list:

RATIS-1763. Purging logs in an ordered manner.
RATIS-1764. [GrpcLogAppender] create parent directory when installSnapshot
RATIS-1765. [GrpcLogAppender] Calculate streaming md5 file-wise when
installSnapshot
RATIS-1767. Initialize MatchIndex to RaftLog.INVALID_LOG_INDEX.
RATIS-1786. Reset the digester of the follower at the beginning of each
file transfer during a InstallSnapshot to avoid snapshot transfer failure


Thanks
----------------------
Xinyu Tan

Kaijie Chen <ck...@apache.org> 于2023年2月27日周一 23:47写道:

> +1,
>
> "Changes required for Ozone certificate improvements (RATIS-1747,
> RATIS-1753)"
> sounds like a new feature, shall we call it 2.5.0?
>
> Kaijie
>
>
>
> ---- On Mon, 27 Feb 2023 23:08:04 +0800  Attila Doroszlai <
> adoroszlai@apache.org> wrote ----
> Hi all,
>
> I would like to propose preparing maintenance releases of Ratis
> Third-party and Ratis with the following changes since 1.0.3 and
> 2.4.1, respectively:
>
> Ratis Thirdparty 1.0.4
> * RATIS-1760. Bump Netty to 4.1.86.Final to fix CVE-2022-41881
>
> Ratis 2.4.2
> * RATIS-1748. Cache getMetricName to reduce garbage
> * Changes required for Ozone certificate improvements (RATIS-1747,
> RATIS-1753)
> * RATIS-1745. Improve performance of AwaitForSignal by reducing amount
> of exceptions created
> * RATIS-1754. Set leader to null when stepping down
> * RATIS-1756. Consistent usage of gapThreshold in getMajorityMin
> * RATIS-1776. Switch to slf4j-reload4j
> * RATIS-1792. Replace parallelStream usage in PeerProxyMap
>
> Is there any other fix that should be backported from master to branch-2?
>
> thanks,
> Attila
>
>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Kaijie Chen <ck...@apache.org>.
+1,

"Changes required for Ozone certificate improvements (RATIS-1747, RATIS-1753)"
sounds like a new feature, shall we call it 2.5.0?

Kaijie



---- On Mon, 27 Feb 2023 23:08:04 +0800  Attila Doroszlai <ad...@apache.org> wrote ----
Hi all, 
 
I would like to propose preparing maintenance releases of Ratis 
Third-party and Ratis with the following changes since 1.0.3 and 
2.4.1, respectively: 
 
Ratis Thirdparty 1.0.4 
* RATIS-1760. Bump Netty to 4.1.86.Final to fix CVE-2022-41881 
 
Ratis 2.4.2 
* RATIS-1748. Cache getMetricName to reduce garbage 
* Changes required for Ozone certificate improvements (RATIS-1747, RATIS-1753) 
* RATIS-1745. Improve performance of AwaitForSignal by reducing amount 
of exceptions created 
* RATIS-1754. Set leader to null when stepping down 
* RATIS-1756. Consistent usage of gapThreshold in getMajorityMin 
* RATIS-1776. Switch to slf4j-reload4j 
* RATIS-1792. Replace parallelStream usage in PeerProxyMap 
 
Is there any other fix that should be backported from master to branch-2? 
 
thanks, 
Attila 


Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Kaijie,

Sure, we should call it 2.5.0.  If we want to have a 2.4.2 release, it can
use https://github.com/apache/ratis/tree/branch-2_tmp

Tsz-Wo


On Sun, Mar 5, 2023 at 11:02 PM Kaijie Chen <ck...@apache.org> wrote:

> Thanks Tsz-Wo for preparing the proposed changes.
>
> Besides linearizable read and Ozone certificate improvements,
> it is worth noting that there is also a transfer leadership improvement
> included:
>   1. Transferring leader to a peer with same priority is now supported.
>   2. The transfer command in ratis-shell will minimize priority changes as
> possible.
>
> Since there are several new features introduced, let's call the new
> version 2.5.0?
>
> Best,
> Kaijie
>
>  ---- On Mon, 06 Mar 2023 04:04:35 +0800  Tsz Wo Sze  wrote ---
>  > Hi dev,
>  >
>  > Just have checked the JIRAs including
>  > - Xinyu's list,
>  > - Yaolong's list (linearizable read),
>  > - other bug fixes and improvements.
>  >
>  > There are 51 new commits compared to branch-2.
>  > See https://github.com/apache/ratis/tree/branch-2_readIndex and
>  > the diff
>  > https://github.com/apache/ratis/compare/branch-2...branch-2_readIndex
>  >
>  > Please check.  Thanks.
>  >
>  > Tsz-Wo
>  > ------ 51 commits
>  >      new f54754a04 RATIS-1643. Add heartbeat broadcast mechanism for
> leader
>  > readIndex. (#730)
>  >      new 9270bb3ce RATIS-1697.
>  > StateMachineUpdater.getStateMachineLastAppliedIndex should handle null.
>  > (#736)
>  >      new b6468dbff RATIS-1696. Support linearizable read-only requests
> in
>  > leader (#735)
>  >      new 22c6a036a RATIS-1701. Add new Server RPC: readIndex (#738)
>  >      new 3fcf38812 RATIS-1706. Move heartbeat listeners to LeaderState
>  > (#743)
>  >      new 1375bdb9b RATIS-1715. Support linearizable read in AsyncApi.
> (#754)
>  >      new 242df11b0 RATIS-1716. Separate ReadException and
>  > ReadIndexException for client retry (#758)
>  >      new bbadb4144 RATIS-1652. Fix NP_NULL_PARAM_DEREF in
>  > DataStreamManagement (#763)
>  >      new bd8a12cf4 RATIS-1722. Fix the suppressed findbugs warnings in
>  > SimpleStateMachineStorage. (#760)
>  >      new fd7a6f373 RATIS-1723. CounterStateMachine should update the
> latest
>  > snapshot. (#765)
>  >      new c8f8145e1 RATIS-1728. Avoid org.apache.log4j imports. (#768)
>  >      new cc807fda9 RATIS-1733. Typo: fix misleading params names in
>  > `RaftServerConfigKeys` (#771)
>  >      new da23510d8 RATIS-1732. Add configuration reference for
> RaftServer
>  > (#770)
>  >      new 43d8f220f RATIS-1742. Remove slf4j-log4j12 test dependency from
>  > ratis-common and ratis-server. (#781)
>  >      new 59eae1106 RATIS-1752. Clean md5 file created by old ratis
> version.
>  > (#790)
>  >      new 99640255b RATIS-1750. Add snapshot section in dev guide (#788)
>  >      new 615a03853 RATIS-1744. NullPointerException causes RaftClient
> retry
>  > failure. (#794)
>  >      new f58e2a5c5 RATIS-1751. Race condition between LeaderStateImpl &
>  > ServerState. (#789)
>  >      new e489fd67c RATIS-1757: Missing some metrics for listener. (#796)
>  >      new 053a815d9 RATIS-1758. Add linearizable read in Counter example
>  > (#797)
>  >      new 5fa608d4b RATIS-1759. Support client use linearizable read per
>  > request (#798)
>  >      new 9628ae999 RATIS-1761. If LeaderStateImpl is not running, it
> should
>  > not restart a LogAppender. (#799)
>  >      new 25552d6cd RATIS-1763. Purging logs in an ordered manner. (#801)
>  >      new d11663562 RATIS-1764. installSnapshot failed due to file
> already
>  > exists (#802)
>  >      new 743f86a05 RATIS-1765. [GrpcLogAppender] Calculate streaming md5
>  > file-wise when installSnapshot (#803)
>  >      new 32a22a47c RATIS-1767. Initialize MatchIndex to
>  > RaftLog.INVALID_LOG_INDEX. (#805)
>  >      new f8634e52a RATIS-1768. Fix stepDown command don't work issue
> (#806)
>  >      new db6944eac RATIS-1766. Add descriptions to metrics entries
> (#804)
>  >      new 960950795 RATIS-1772. Refactor the startLeaderElection code in
>  > LeaderStateImpl. (#811)
>  >      new d3d7d6eab RATIS-1773. Fix readIndexHeartbeat using incorrct
> index
>  > handle onAppendEntriesReply method (#810)
>  >      new 8908caf73 RATIS-1775. FollowerInfoImpl should not store
> RaftPeer.
>  > (#812)
>  >      new b6e8c9e9d RATIS-1774. Change SenderList in LeaderStateImpl to
>  > implement Iterable. (#813)
>  >      new 5d98c64a9 RATIS-1762. Support transfer leadership between nodes
>  > with same priority (#807)
>  >      new e7f25ed5c RATIS-1778. Fix NPE in readIndexHeartbeats (#819)
>  >      new f6b5efc62 RATIS-1779. Refactor: Reduce nesting in
>  > TransferLeadership (#820)
>  >      new 755399407 RATIS-1784. Ignore .vscode in source repo. (#822)
>  >      new e0b97879a RATIS-1783. MAX_OP_SIZE is not configurable on raft
> log
>  > read. (#823)
>  >      new 54bcb7471 RATIS-1543. Log from GrpcLogAppender is confusing.
> (#821)
>  >      new 4efca7871 RATIS-1769. Avoid changing priorities in
> TransferCommand
>  > unless necessary (#808)
>  >      new 1f54d4552 RATIS-1786. Reset the digester of the follower at the
>  > beginning of each file transfer during a InstallSnapshot to avoid
> snapshot
>  > transfer failure (#825)
>  >      new 2954754e4 RATIS-1785. Use SingleThreadExecutor to manage the
>  > lifetime of single thread (#824)
>  >      new 3a3fafb96 RATIS-1788. Improve the JvmPauseMonitor log messages.
>  > (#826)
>  >      new 15474faf5 RATIS-1791. Intermittent failure in
>  > ServerRestartTests#testRestartFollower (#827)
>  >      new fd7ccbecb RATIS-1794. Intermittent failure in
>  > PreAppendLeaderStepDownTest#testLeaderStepDown (#833)
>  >      new c1da37cb4 RATIS-1793. Enforce
>  > raft.server.log.appender.wait-time.min. (#832)
>  >      new 4d0c7d0e9 RATIS-1799. Make shell scripts in binary package
>  > executable (#835)
>  >      new dae9a5fbf RATIS-1801. Fix flaky test of
>  > TestLogAppenderWithGrpc.testPendingLimits (#837)
>  >      new 03e99088f RATIS-1800. Remove unused ratis-shell properties
> (#836)
>  >      new 12e0c6e10 RATIS-1798. Make ratis-shell command respect
>  > GENERIC_COMMAND_OPTIONS (#834)
>  >      new d1d13fe70 RATIS-1806. Further fix for
>  > TestLogAppenderWithGrpc#testPendingLimits (#841)
>  >      new 6748ec853 RATIS-1805. Add doc about GENERIC_COMMAND_OPTIONS of
>  > ratis-shell (#840)
>  > ------ END
>  >
>  > On Wed, Mar 1, 2023 at 10:44 AM Tsz Wo Sze szetszwo@gmail.com> wrote:
>  >
>  > > Hi Attila,
>  > >
>  > > The list only contains bug fixes and performance improvements but not
> new
>  > > features (e.g. linearizable read).  Let me go through the JIRAs again
> to
>  > > include linearizable read.
>  > >
>  > > Tsz-Wo
>  > >
>  > > On Wed, Mar 1, 2023 at 12:21 AM Attila Doroszlai
> adoroszlai@apache.org>
>  > > wrote:
>  > >
>  > >> Hi Tsz-Wo,
>  > >>
>  > >> > Just have checked the commit list of the master branch.  I suggest
>  > >> > including the following 16 commits for bug fixes and
> improvements.  I
>  > >> have
>  > >> > tried to cherry-pick them to branch-2; see
>  > >> > https://github.com/apache/ratis/tree/branch-2_tmp
>  > >>
>  > >> Do you mean only these, or in addition to the ones already mentioned
>  > >> in previous emails?  (Some are present in both your list and the
>  > >> previous ones, hence the question.)
>  > >>
>  > >> -Attila
>  > >>
>  > >
>  >
>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Kaijie Chen <ck...@apache.org>.
Thanks Tsz-Wo for preparing the proposed changes.

Besides linearizable read and Ozone certificate improvements,
it is worth noting that there is also a transfer leadership improvement included:
  1. Transferring leader to a peer with same priority is now supported.
  2. The transfer command in ratis-shell will minimize priority changes as possible.

Since there are several new features introduced, let's call the new version 2.5.0?

Best,
Kaijie

 ---- On Mon, 06 Mar 2023 04:04:35 +0800  Tsz Wo Sze  wrote --- 
 > Hi dev,
 > 
 > Just have checked the JIRAs including
 > - Xinyu's list,
 > - Yaolong's list (linearizable read),
 > - other bug fixes and improvements.
 > 
 > There are 51 new commits compared to branch-2.
 > See https://github.com/apache/ratis/tree/branch-2_readIndex and
 > the diff
 > https://github.com/apache/ratis/compare/branch-2...branch-2_readIndex
 > 
 > Please check.  Thanks.
 > 
 > Tsz-Wo
 > ------ 51 commits
 >      new f54754a04 RATIS-1643. Add heartbeat broadcast mechanism for leader
 > readIndex. (#730)
 >      new 9270bb3ce RATIS-1697.
 > StateMachineUpdater.getStateMachineLastAppliedIndex should handle null.
 > (#736)
 >      new b6468dbff RATIS-1696. Support linearizable read-only requests in
 > leader (#735)
 >      new 22c6a036a RATIS-1701. Add new Server RPC: readIndex (#738)
 >      new 3fcf38812 RATIS-1706. Move heartbeat listeners to LeaderState
 > (#743)
 >      new 1375bdb9b RATIS-1715. Support linearizable read in AsyncApi. (#754)
 >      new 242df11b0 RATIS-1716. Separate ReadException and
 > ReadIndexException for client retry (#758)
 >      new bbadb4144 RATIS-1652. Fix NP_NULL_PARAM_DEREF in
 > DataStreamManagement (#763)
 >      new bd8a12cf4 RATIS-1722. Fix the suppressed findbugs warnings in
 > SimpleStateMachineStorage. (#760)
 >      new fd7a6f373 RATIS-1723. CounterStateMachine should update the latest
 > snapshot. (#765)
 >      new c8f8145e1 RATIS-1728. Avoid org.apache.log4j imports. (#768)
 >      new cc807fda9 RATIS-1733. Typo: fix misleading params names in
 > `RaftServerConfigKeys` (#771)
 >      new da23510d8 RATIS-1732. Add configuration reference for RaftServer
 > (#770)
 >      new 43d8f220f RATIS-1742. Remove slf4j-log4j12 test dependency from
 > ratis-common and ratis-server. (#781)
 >      new 59eae1106 RATIS-1752. Clean md5 file created by old ratis version.
 > (#790)
 >      new 99640255b RATIS-1750. Add snapshot section in dev guide (#788)
 >      new 615a03853 RATIS-1744. NullPointerException causes RaftClient retry
 > failure. (#794)
 >      new f58e2a5c5 RATIS-1751. Race condition between LeaderStateImpl &
 > ServerState. (#789)
 >      new e489fd67c RATIS-1757: Missing some metrics for listener. (#796)
 >      new 053a815d9 RATIS-1758. Add linearizable read in Counter example
 > (#797)
 >      new 5fa608d4b RATIS-1759. Support client use linearizable read per
 > request (#798)
 >      new 9628ae999 RATIS-1761. If LeaderStateImpl is not running, it should
 > not restart a LogAppender. (#799)
 >      new 25552d6cd RATIS-1763. Purging logs in an ordered manner. (#801)
 >      new d11663562 RATIS-1764. installSnapshot failed due to file already
 > exists (#802)
 >      new 743f86a05 RATIS-1765. [GrpcLogAppender] Calculate streaming md5
 > file-wise when installSnapshot (#803)
 >      new 32a22a47c RATIS-1767. Initialize MatchIndex to
 > RaftLog.INVALID_LOG_INDEX. (#805)
 >      new f8634e52a RATIS-1768. Fix stepDown command don't work issue (#806)
 >      new db6944eac RATIS-1766. Add descriptions to metrics entries (#804)
 >      new 960950795 RATIS-1772. Refactor the startLeaderElection code in
 > LeaderStateImpl. (#811)
 >      new d3d7d6eab RATIS-1773. Fix readIndexHeartbeat using incorrct index
 > handle onAppendEntriesReply method (#810)
 >      new 8908caf73 RATIS-1775. FollowerInfoImpl should not store RaftPeer.
 > (#812)
 >      new b6e8c9e9d RATIS-1774. Change SenderList in LeaderStateImpl to
 > implement Iterable. (#813)
 >      new 5d98c64a9 RATIS-1762. Support transfer leadership between nodes
 > with same priority (#807)
 >      new e7f25ed5c RATIS-1778. Fix NPE in readIndexHeartbeats (#819)
 >      new f6b5efc62 RATIS-1779. Refactor: Reduce nesting in
 > TransferLeadership (#820)
 >      new 755399407 RATIS-1784. Ignore .vscode in source repo. (#822)
 >      new e0b97879a RATIS-1783. MAX_OP_SIZE is not configurable on raft log
 > read. (#823)
 >      new 54bcb7471 RATIS-1543. Log from GrpcLogAppender is confusing. (#821)
 >      new 4efca7871 RATIS-1769. Avoid changing priorities in TransferCommand
 > unless necessary (#808)
 >      new 1f54d4552 RATIS-1786. Reset the digester of the follower at the
 > beginning of each file transfer during a InstallSnapshot to avoid snapshot
 > transfer failure (#825)
 >      new 2954754e4 RATIS-1785. Use SingleThreadExecutor to manage the
 > lifetime of single thread (#824)
 >      new 3a3fafb96 RATIS-1788. Improve the JvmPauseMonitor log messages.
 > (#826)
 >      new 15474faf5 RATIS-1791. Intermittent failure in
 > ServerRestartTests#testRestartFollower (#827)
 >      new fd7ccbecb RATIS-1794. Intermittent failure in
 > PreAppendLeaderStepDownTest#testLeaderStepDown (#833)
 >      new c1da37cb4 RATIS-1793. Enforce
 > raft.server.log.appender.wait-time.min. (#832)
 >      new 4d0c7d0e9 RATIS-1799. Make shell scripts in binary package
 > executable (#835)
 >      new dae9a5fbf RATIS-1801. Fix flaky test of
 > TestLogAppenderWithGrpc.testPendingLimits (#837)
 >      new 03e99088f RATIS-1800. Remove unused ratis-shell properties (#836)
 >      new 12e0c6e10 RATIS-1798. Make ratis-shell command respect
 > GENERIC_COMMAND_OPTIONS (#834)
 >      new d1d13fe70 RATIS-1806. Further fix for
 > TestLogAppenderWithGrpc#testPendingLimits (#841)
 >      new 6748ec853 RATIS-1805. Add doc about GENERIC_COMMAND_OPTIONS of
 > ratis-shell (#840)
 > ------ END
 > 
 > On Wed, Mar 1, 2023 at 10:44 AM Tsz Wo Sze szetszwo@gmail.com> wrote:
 > 
 > > Hi Attila,
 > >
 > > The list only contains bug fixes and performance improvements but not new
 > > features (e.g. linearizable read).  Let me go through the JIRAs again to
 > > include linearizable read.
 > >
 > > Tsz-Wo
 > >
 > > On Wed, Mar 1, 2023 at 12:21 AM Attila Doroszlai adoroszlai@apache.org>
 > > wrote:
 > >
 > >> Hi Tsz-Wo,
 > >>
 > >> > Just have checked the commit list of the master branch.  I suggest
 > >> > including the following 16 commits for bug fixes and improvements.  I
 > >> have
 > >> > tried to cherry-pick them to branch-2; see
 > >> > https://github.com/apache/ratis/tree/branch-2_tmp
 > >>
 > >> Do you mean only these, or in addition to the ones already mentioned
 > >> in previous emails?  (Some are present in both your list and the
 > >> previous ones, hence the question.)
 > >>
 > >> -Attila
 > >>
 > >
 > 

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Just have pushed all 18 recent commits:
     new 08dc58fcb RATIS-1807. Support timeout in gRPC. (#842)
     new 252446070 RATIS-1811. Improve StreamObserver's log messages (#849)
     new 1c500bbaf RATIS-1810. Intermittent failure in
TestRaftServerWithGrpc#testRaftClientMetrics (#847)
     new 3ed7c481c RATIS-1808. Rerun PreVote when Vote is timed out (#846)
     new 70fe68f0d RATIS-1815. GitHub: Enable autolink to Jira (#853)
     new 5d9e4b538 RATIS-1813. Allow ratis-shell to run in JDK 8+ (#851)
     new ee8aef255 RATIS-1796. Fix TransferLeadership stopped by heartbeat
from old leader (#844)
     new 2fc1c83a6 RATIS-1814: The group info command of the Ratis shell
does not show the listener (#852)
     new 5a996a42f RATIS-1812. Enforce a outstanding request limit in
StreamObserverWithTimeout. (#850)
     new 80617d4bb RATIS-1809. Use separated timeout for GrpcLogAppender's
streaming RPC (#848)
     new e20a2e83b RATIS-1816. appendEntryTimer is not accurate due to the
return of writeFuture (#855)
     new f0d9d566e RATIS-1770. Yield leader to higher priority peer by
TransferLeadership (#845)
     new c727be372 RATIS-1795. Add and distribute a Maven Wrapper (#856)
     new f50965d56 RATIS-1817. Do not send StartLeaderElection when
leaderLastEntry is null (#857)
     new 649e5fef2 RATIS-1819. Use Maven Wrapper in CI workflows (#859)
     new c19db251d RATIS-1820. Update apache parent pom version and other
versions. (#861)
     new 14ae143fb RATIS-1662. Intermittent failure in testEnforceLeader
(#860)
     new 42c3c6ba4 RATIS-1821. Upgrade ratis-thirdparty version to 1.0.4
(#862)

Please check.  Thanks.

Tsz-Wo

On Wed, Mar 22, 2023 at 1:04 PM Tsz Wo Sze <sz...@gmail.com> wrote:

> We already have released Ratis Thirdparty 1.0.4 and updated Ratis using it
> (RATIS-1821).  Let me merge the new commits from the master branch to
> branch-2_readIndex
> <https://github.com/apache/ratis/tree/branch-2_readIndex>.  Then, we are
> ready to release 2.5.0.
>
> Tsz-Wo
>
> On Sun, Mar 12, 2023 at 2:14 PM Tsz Wo Sze <sz...@gmail.com> wrote:
>
>> Hi William,
>>
>> Thanks for helping out the release!
>>
>> Tsz-Wo
>>
>> On Sun, Mar 12, 2023 at 10:59 AM William Song <sz...@163.com> wrote:
>>
>>> Hi Attila, I would love to do the release of Ratis Thirdparty 1.0.4. Let
>>> me start by bumping the version first.
>>>
>>> William Song
>>>
>>> > 2023年3月10日 00:23,Attila Doroszlai <ad...@apache.org> 写道:
>>> >
>>> >> There are 51 new commits compared to branch-2.
>>> >> See https://github.com/apache/ratis/tree/branch-2_readIndex
>>> >
>>> > Thanks Tsz-Wo for the backports.
>>> >
>>> > I have added RATIS-1802 to branch-2_readIndex.
>>> >
>>> > In the meantime I think we should start the release of Ratis
>>> > Thirdparty 1.0.4.  Any volunteers for this?
>>> >
>>> > -Attila
>>>
>>>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Thanks a lot for taking care of this!

Tsz-Wo

On Wed, Apr 12, 2023 at 1:28 AM William Song <sz...@163.com> wrote:

> Merged branch-2_readIndex to branch-2. Will clean up branch-2_readIndex
> later.
>
> -William
>
> > 2023年4月12日 15:09,Attila Doroszlai <ad...@apache.org> 写道:
> >
> >> Let me merge the new commits from the master branch to
> >> branch-2_readIndex <
> https://github.com/apache/ratis/tree/branch-2_readIndex>.
> >> Then, we are ready to release 2.5.0.
> >
> > Now that 2.5.0 is released, I think we should update branch-2 with
> > these commits from branch-2_readIndex.
> >
> > -Attila
>
>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by William Song <sz...@163.com>.
Merged branch-2_readIndex to branch-2. Will clean up branch-2_readIndex later.

-William

> 2023年4月12日 15:09,Attila Doroszlai <ad...@apache.org> 写道:
> 
>> Let me merge the new commits from the master branch to
>> branch-2_readIndex <https://github.com/apache/ratis/tree/branch-2_readIndex>.
>> Then, we are ready to release 2.5.0.
> 
> Now that 2.5.0 is released, I think we should update branch-2 with
> these commits from branch-2_readIndex.
> 
> -Attila


Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Attila Doroszlai <ad...@apache.org>.
> Let me merge the new commits from the master branch to
> branch-2_readIndex <https://github.com/apache/ratis/tree/branch-2_readIndex>.
> Then, we are ready to release 2.5.0.

Now that 2.5.0 is released, I think we should update branch-2 with
these commits from branch-2_readIndex.

-Attila

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
We already have released Ratis Thirdparty 1.0.4 and updated Ratis using it
(RATIS-1821).  Let me merge the new commits from the master branch to
branch-2_readIndex <https://github.com/apache/ratis/tree/branch-2_readIndex>.
Then, we are ready to release 2.5.0.

Tsz-Wo

On Sun, Mar 12, 2023 at 2:14 PM Tsz Wo Sze <sz...@gmail.com> wrote:

> Hi William,
>
> Thanks for helping out the release!
>
> Tsz-Wo
>
> On Sun, Mar 12, 2023 at 10:59 AM William Song <sz...@163.com> wrote:
>
>> Hi Attila, I would love to do the release of Ratis Thirdparty 1.0.4. Let
>> me start by bumping the version first.
>>
>> William Song
>>
>> > 2023年3月10日 00:23,Attila Doroszlai <ad...@apache.org> 写道:
>> >
>> >> There are 51 new commits compared to branch-2.
>> >> See https://github.com/apache/ratis/tree/branch-2_readIndex
>> >
>> > Thanks Tsz-Wo for the backports.
>> >
>> > I have added RATIS-1802 to branch-2_readIndex.
>> >
>> > In the meantime I think we should start the release of Ratis
>> > Thirdparty 1.0.4.  Any volunteers for this?
>> >
>> > -Attila
>>
>>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Hi William,

Thanks for helping out the release!

Tsz-Wo

On Sun, Mar 12, 2023 at 10:59 AM William Song <sz...@163.com> wrote:

> Hi Attila, I would love to do the release of Ratis Thirdparty 1.0.4. Let
> me start by bumping the version first.
>
> William Song
>
> > 2023年3月10日 00:23,Attila Doroszlai <ad...@apache.org> 写道:
> >
> >> There are 51 new commits compared to branch-2.
> >> See https://github.com/apache/ratis/tree/branch-2_readIndex
> >
> > Thanks Tsz-Wo for the backports.
> >
> > I have added RATIS-1802 to branch-2_readIndex.
> >
> > In the meantime I think we should start the release of Ratis
> > Thirdparty 1.0.4.  Any volunteers for this?
> >
> > -Attila
>
>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by William Song <sz...@163.com>.
Hi Attila, I would love to do the release of Ratis Thirdparty 1.0.4. Let me start by bumping the version first.

William Song

> 2023年3月10日 00:23,Attila Doroszlai <ad...@apache.org> 写道:
> 
>> There are 51 new commits compared to branch-2.
>> See https://github.com/apache/ratis/tree/branch-2_readIndex
> 
> Thanks Tsz-Wo for the backports.
> 
> I have added RATIS-1802 to branch-2_readIndex.
> 
> In the meantime I think we should start the release of Ratis
> Thirdparty 1.0.4.  Any volunteers for this?
> 
> -Attila


Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Attila Doroszlai <ad...@apache.org>.
> There are 51 new commits compared to branch-2.
> See https://github.com/apache/ratis/tree/branch-2_readIndex

Thanks Tsz-Wo for the backports.

I have added RATIS-1802 to branch-2_readIndex.

In the meantime I think we should start the release of Ratis
Thirdparty 1.0.4.  Any volunteers for this?

-Attila

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Hi dev,

Just have checked the JIRAs including
- Xinyu's list,
- Yaolong's list (linearizable read),
- other bug fixes and improvements.

There are 51 new commits compared to branch-2.
See https://github.com/apache/ratis/tree/branch-2_readIndex and
the diff
https://github.com/apache/ratis/compare/branch-2...branch-2_readIndex

Please check.  Thanks.

Tsz-Wo
------ 51 commits
     new f54754a04 RATIS-1643. Add heartbeat broadcast mechanism for leader
readIndex. (#730)
     new 9270bb3ce RATIS-1697.
StateMachineUpdater.getStateMachineLastAppliedIndex should handle null.
(#736)
     new b6468dbff RATIS-1696. Support linearizable read-only requests in
leader (#735)
     new 22c6a036a RATIS-1701. Add new Server RPC: readIndex (#738)
     new 3fcf38812 RATIS-1706. Move heartbeat listeners to LeaderState
(#743)
     new 1375bdb9b RATIS-1715. Support linearizable read in AsyncApi. (#754)
     new 242df11b0 RATIS-1716. Separate ReadException and
ReadIndexException for client retry (#758)
     new bbadb4144 RATIS-1652. Fix NP_NULL_PARAM_DEREF in
DataStreamManagement (#763)
     new bd8a12cf4 RATIS-1722. Fix the suppressed findbugs warnings in
SimpleStateMachineStorage. (#760)
     new fd7a6f373 RATIS-1723. CounterStateMachine should update the latest
snapshot. (#765)
     new c8f8145e1 RATIS-1728. Avoid org.apache.log4j imports. (#768)
     new cc807fda9 RATIS-1733. Typo: fix misleading params names in
`RaftServerConfigKeys` (#771)
     new da23510d8 RATIS-1732. Add configuration reference for RaftServer
(#770)
     new 43d8f220f RATIS-1742. Remove slf4j-log4j12 test dependency from
ratis-common and ratis-server. (#781)
     new 59eae1106 RATIS-1752. Clean md5 file created by old ratis version.
(#790)
     new 99640255b RATIS-1750. Add snapshot section in dev guide (#788)
     new 615a03853 RATIS-1744. NullPointerException causes RaftClient retry
failure. (#794)
     new f58e2a5c5 RATIS-1751. Race condition between LeaderStateImpl &
ServerState. (#789)
     new e489fd67c RATIS-1757: Missing some metrics for listener. (#796)
     new 053a815d9 RATIS-1758. Add linearizable read in Counter example
(#797)
     new 5fa608d4b RATIS-1759. Support client use linearizable read per
request (#798)
     new 9628ae999 RATIS-1761. If LeaderStateImpl is not running, it should
not restart a LogAppender. (#799)
     new 25552d6cd RATIS-1763. Purging logs in an ordered manner. (#801)
     new d11663562 RATIS-1764. installSnapshot failed due to file already
exists (#802)
     new 743f86a05 RATIS-1765. [GrpcLogAppender] Calculate streaming md5
file-wise when installSnapshot (#803)
     new 32a22a47c RATIS-1767. Initialize MatchIndex to
RaftLog.INVALID_LOG_INDEX. (#805)
     new f8634e52a RATIS-1768. Fix stepDown command don't work issue (#806)
     new db6944eac RATIS-1766. Add descriptions to metrics entries (#804)
     new 960950795 RATIS-1772. Refactor the startLeaderElection code in
LeaderStateImpl. (#811)
     new d3d7d6eab RATIS-1773. Fix readIndexHeartbeat using incorrct index
handle onAppendEntriesReply method (#810)
     new 8908caf73 RATIS-1775. FollowerInfoImpl should not store RaftPeer.
(#812)
     new b6e8c9e9d RATIS-1774. Change SenderList in LeaderStateImpl to
implement Iterable. (#813)
     new 5d98c64a9 RATIS-1762. Support transfer leadership between nodes
with same priority (#807)
     new e7f25ed5c RATIS-1778. Fix NPE in readIndexHeartbeats (#819)
     new f6b5efc62 RATIS-1779. Refactor: Reduce nesting in
TransferLeadership (#820)
     new 755399407 RATIS-1784. Ignore .vscode in source repo. (#822)
     new e0b97879a RATIS-1783. MAX_OP_SIZE is not configurable on raft log
read. (#823)
     new 54bcb7471 RATIS-1543. Log from GrpcLogAppender is confusing. (#821)
     new 4efca7871 RATIS-1769. Avoid changing priorities in TransferCommand
unless necessary (#808)
     new 1f54d4552 RATIS-1786. Reset the digester of the follower at the
beginning of each file transfer during a InstallSnapshot to avoid snapshot
transfer failure (#825)
     new 2954754e4 RATIS-1785. Use SingleThreadExecutor to manage the
lifetime of single thread (#824)
     new 3a3fafb96 RATIS-1788. Improve the JvmPauseMonitor log messages.
(#826)
     new 15474faf5 RATIS-1791. Intermittent failure in
ServerRestartTests#testRestartFollower (#827)
     new fd7ccbecb RATIS-1794. Intermittent failure in
PreAppendLeaderStepDownTest#testLeaderStepDown (#833)
     new c1da37cb4 RATIS-1793. Enforce
raft.server.log.appender.wait-time.min. (#832)
     new 4d0c7d0e9 RATIS-1799. Make shell scripts in binary package
executable (#835)
     new dae9a5fbf RATIS-1801. Fix flaky test of
TestLogAppenderWithGrpc.testPendingLimits (#837)
     new 03e99088f RATIS-1800. Remove unused ratis-shell properties (#836)
     new 12e0c6e10 RATIS-1798. Make ratis-shell command respect
GENERIC_COMMAND_OPTIONS (#834)
     new d1d13fe70 RATIS-1806. Further fix for
TestLogAppenderWithGrpc#testPendingLimits (#841)
     new 6748ec853 RATIS-1805. Add doc about GENERIC_COMMAND_OPTIONS of
ratis-shell (#840)
------ END

On Wed, Mar 1, 2023 at 10:44 AM Tsz Wo Sze <sz...@gmail.com> wrote:

> Hi Attila,
>
> The list only contains bug fixes and performance improvements but not new
> features (e.g. linearizable read).  Let me go through the JIRAs again to
> include linearizable read.
>
> Tsz-Wo
>
> On Wed, Mar 1, 2023 at 12:21 AM Attila Doroszlai <ad...@apache.org>
> wrote:
>
>> Hi Tsz-Wo,
>>
>> > Just have checked the commit list of the master branch.  I suggest
>> > including the following 16 commits for bug fixes and improvements.  I
>> have
>> > tried to cherry-pick them to branch-2; see
>> > https://github.com/apache/ratis/tree/branch-2_tmp
>>
>> Do you mean only these, or in addition to the ones already mentioned
>> in previous emails?  (Some are present in both your list and the
>> previous ones, hence the question.)
>>
>> -Attila
>>
>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Hi Attila,

The list only contains bug fixes and performance improvements but not new
features (e.g. linearizable read).  Let me go through the JIRAs again to
include linearizable read.

Tsz-Wo

On Wed, Mar 1, 2023 at 12:21 AM Attila Doroszlai <ad...@apache.org>
wrote:

> Hi Tsz-Wo,
>
> > Just have checked the commit list of the master branch.  I suggest
> > including the following 16 commits for bug fixes and improvements.  I
> have
> > tried to cherry-pick them to branch-2; see
> > https://github.com/apache/ratis/tree/branch-2_tmp
>
> Do you mean only these, or in addition to the ones already mentioned
> in previous emails?  (Some are present in both your list and the
> previous ones, hence the question.)
>
> -Attila
>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Attila Doroszlai <ad...@apache.org>.
Hi Tsz-Wo,

> Just have checked the commit list of the master branch.  I suggest
> including the following 16 commits for bug fixes and improvements.  I have
> tried to cherry-pick them to branch-2; see
> https://github.com/apache/ratis/tree/branch-2_tmp

Do you mean only these, or in addition to the ones already mentioned
in previous emails?  (Some are present in both your list and the
previous ones, hence the question.)

-Attila

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Hi dev,

Just have checked the commit list of the master branch.  I suggest
including the following 16 commits for bug fixes and improvements.  I have
tried to cherry-pick them to branch-2; see
https://github.com/apache/ratis/tree/branch-2_tmp

Tsz-Wo

commit 8247d3c6b637d6155c76a03dbb8bd9504cacbdb3
Author: Tsz-Wo Nicholas Sze <sz...@apache.org>
Date:   Tue Feb 28 05:00:02 2023 -0800

    RATIS-1793. Enforce raft.server.log.appender.wait-time.min. (#832)

    (cherry picked from commit fdd7c5c98beaeed6aa33261752554575282e1a43)

commit beb6a5dfd3a59cbc78103490917e7ad473baa6f4
Author: Kaijie Chen <ck...@apache.org>
Date:   Sat Feb 25 04:04:01 2023 +0800

    RATIS-1791. Intermittent failure in
ServerRestartTests#testRestartFollower (#827)

    (cherry picked from commit 3a19630a8fe17e055f820b712450123201641421)

commit 74830239efd359216406459cc50047d22e2c39f8
Author: Tsz-Wo Nicholas Sze <sz...@apache.org>
Date:   Thu Feb 23 00:32:46 2023 -0800

    RATIS-1788. Improve the JvmPauseMonitor log messages. (#826)

    (cherry picked from commit 655db36c68a4c46a59150b548e76f2e92c33bf84)

commit f348cac8b07ff111e57af702a0efd94999a7e2c5
Author: Potato <ta...@apache.org>
Date:   Wed Feb 22 06:15:36 2023 +0800

    RATIS-1785. Use SingleThreadExecutor to manage the lifetime of single
thread (#824)

    (cherry picked from commit d838c56772568211b9af617d78c5182af641faac)

commit e47fcb96217e6e2b44fa1c36e8b4106de9f0d490
Author: Potato <ta...@apache.org>
Date:   Wed Feb 22 04:02:47 2023 +0800

    RATIS-1786. Reset the digester of the follower at the beginning of each
file transfer during a InstallSnapshot to avoid snapshot transfer failure
(#825)

    (cherry picked from commit 4ba1e71a3a0c0110421c459d7c2d116c0bed10ea)

commit c2e3bcca06ab3b566959133358a7f4399bd613bb
Author: Tsz-Wo Nicholas Sze <sz...@apache.org>
Date:   Fri Feb 17 01:22:28 2023 -0800

    RATIS-1543. Log from GrpcLogAppender is confusing. (#821)

    (cherry picked from commit ca9fdd29e15b81464fd20d73a1d070a050bae30c)

commit 4a0496b188cd96f05fbab10a4327714bb8408d17
Author: Tsz-Wo Nicholas Sze <sz...@apache.org>
Date:   Thu Feb 16 16:34:18 2023 -0800

    RATIS-1783. MAX_OP_SIZE is not configurable on raft log read. (#823)

    (cherry picked from commit c4f54dfe88d1b574a03688f16a592cf0d59d13a9)

commit ed481ff95f9b6688108616df1380a83e4e9ca74b
Author: Arpit Agarwal <ar...@users.noreply.github.com>
Date:   Thu Feb 16 14:46:59 2023 -0800

    RATIS-1784. Ignore .vscode in source repo. (#822)

    (cherry picked from commit dd488f8b29fd1647da15c9609778f6ba97ddc4e0)

commit f18bce302cfc847ba9f0b83a56a7e2674b50830f
Author: Tsz-Wo Nicholas Sze <sz...@apache.org>
Date:   Thu Jan 19 22:35:24 2023 +0800

    RATIS-1772. Refactor the startLeaderElection code in LeaderStateImpl.
(#811)

    (cherry picked from commit 8c16c28351576b893564c5cc621c7d069b1de14a)

commit 272eeae2a253fc86d72fccc536aff0fcbbfc82b9
Author: William Song <48...@users.noreply.github.com>
Date:   Fri Jan 13 19:43:35 2023 +0800

    RATIS-1766. Add descriptions to metrics entries (#804)

    (cherry picked from commit c2181e5fab51254452db094693d5bddbda78d5ba)

commit 070a3aa1a254e3403c14389796bfe1a4b177967c
Author: Yaolong Liu <ly...@163.com>
Date:   Fri Jan 13 17:36:03 2023 +0800

    RATIS-1768. Fix stepDown command don't work issue (#806)

    (cherry picked from commit 71a9fdffa9ab49d6f4f39402ff3873423021c107)

commit 3e1419c72ad10d6c14385a3daf2f1f25ea8bcdc7
Author: William Song <48...@users.noreply.github.com>
Date:   Tue Jan 10 14:45:05 2023 +0800

    RATIS-1767. Initialize MatchIndex to RaftLog.INVALID_LOG_INDEX. (#805)

    (cherry picked from commit c62c9e22557bb55173f0668fd196ee51fb1f73be)

commit e40a5f8aa35a0438c9d21c2139d85a29556c9b40
Author: William Song <48...@users.noreply.github.com>
Date:   Tue Jan 3 13:54:18 2023 +0800

    RATIS-1763. Purging logs in an ordered manner. (#801)

commit e01c8e579e0cac8b918de7348afc409bf1e218c8
Author: Tsz-Wo Nicholas Sze <sz...@apache.org>
Date:   Sat Dec 24 16:41:50 2022 +0800

    RATIS-1761. If LeaderStateImpl is not running, it should not restart a
LogAppender. (#799)

    (cherry picked from commit 77a9949f98d6c80a8c1466887763d44fb64c9ccc)

commit 3923d64bf02c0e2fbc0915dae5fcc0ea9b12204e
Author: Tsz-Wo Nicholas Sze <sz...@apache.org>
Date:   Tue Dec 6 05:00:47 2022 -0800

    RATIS-1751. Race condition between LeaderStateImpl & ServerState. (#789)

    (cherry picked from commit 1c00461b93a2d259bf810713b00a9791a6bd292d)

commit fb176cfea734fc5cc489c08adb0aa8be61894f3f
Author: William Song <48...@users.noreply.github.com>
Date:   Tue Nov 29 08:06:26 2022 +0800

    RATIS-1750. Add snapshot section in dev guide (#788)

    (cherry picked from commit 96b2f267e81959d345725a5dc840725b32fd1b2b)
----- END ------

On Tue, Feb 28, 2023 at 8:56 AM Tsz Wo Sze <sz...@gmail.com> wrote:

> Thanks a lot for the release discussion!  Will go through the JIRA list to
> see which ones should be included.
> Tsz-Wo
>
> On Mon, Feb 27, 2023 at 11:36 PM Yaolong Liu <ly...@163.com> wrote:
>
>> Hi Attila,
>>
>>
>> Thanks for starting this discussion, I want to include linearizable read
>> related commits in the next release of Ratis.
>> Here is the list:
>>
>>
>>
>> RATIS-1643. Add heartbeat broadcast mechanism for leader readIndex
>>
>> RATIS-1696. Support linearizable read-only requests in leader
>>
>> RATIS-1701. Add new Server RPC: readIndex
>>
>> RATIS-1706. Move heartbeat listeners to LeaderState
>>
>> RATIS-1715. Support linearizable read in AsyncApi
>>
>> RATIS-1716. Separate ReadException and ReadIndexException for client retry
>>
>> RATIS-1758. Add linearizable read in Counter example
>>
>> RATIS-1759. Support client use linearizable read per request
>>
>> RATIS-1773. Fix readIndexHeartbeat using incorrct index handle
>> onAppendEntriesReply method
>>
>> RATIS-1778. Fix NPE in readIndexHeartbeats
>>
>>
>>
>> BTW, since linearizable read is a relatively large feature,  should we
>> directly use 2.5.0 as the next release version number.
>>
>>
>> Regards,
>> Yaolong
>>
>>
>>
>>
>>
>> At 2023-02-27 23:08:04, "Attila Doroszlai" <ad...@apache.org> wrote:
>> >Hi all,
>> >
>> >I would like to propose preparing maintenance releases of Ratis
>> >Third-party and Ratis with the following changes since 1.0.3 and
>> >2.4.1, respectively:
>> >
>> >Ratis Thirdparty 1.0.4
>> >* RATIS-1760. Bump Netty to 4.1.86.Final to fix CVE-2022-41881
>> >
>> >Ratis 2.4.2
>> >* RATIS-1748. Cache getMetricName to reduce garbage
>> >* Changes required for Ozone certificate improvements (RATIS-1747,
>> RATIS-1753)
>> >* RATIS-1745. Improve performance of AwaitForSignal by reducing amount
>> >of exceptions created
>> >* RATIS-1754. Set leader to null when stepping down
>> >* RATIS-1756. Consistent usage of gapThreshold in getMajorityMin
>> >* RATIS-1776. Switch to slf4j-reload4j
>> >* RATIS-1792. Replace parallelStream usage in PeerProxyMap
>> >
>> >Is there any other fix that should be backported from master to branch-2?
>> >
>> >thanks,
>> >Attila
>>
>

Re: [DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Tsz Wo Sze <sz...@gmail.com>.
Thanks a lot for the release discussion!  Will go through the JIRA list to
see which ones should be included.
Tsz-Wo

On Mon, Feb 27, 2023 at 11:36 PM Yaolong Liu <ly...@163.com> wrote:

> Hi Attila,
>
>
> Thanks for starting this discussion, I want to include linearizable read
> related commits in the next release of Ratis.
> Here is the list:
>
>
>
> RATIS-1643. Add heartbeat broadcast mechanism for leader readIndex
>
> RATIS-1696. Support linearizable read-only requests in leader
>
> RATIS-1701. Add new Server RPC: readIndex
>
> RATIS-1706. Move heartbeat listeners to LeaderState
>
> RATIS-1715. Support linearizable read in AsyncApi
>
> RATIS-1716. Separate ReadException and ReadIndexException for client retry
>
> RATIS-1758. Add linearizable read in Counter example
>
> RATIS-1759. Support client use linearizable read per request
>
> RATIS-1773. Fix readIndexHeartbeat using incorrct index handle
> onAppendEntriesReply method
>
> RATIS-1778. Fix NPE in readIndexHeartbeats
>
>
>
> BTW, since linearizable read is a relatively large feature,  should we
> directly use 2.5.0 as the next release version number.
>
>
> Regards,
> Yaolong
>
>
>
>
>
> At 2023-02-27 23:08:04, "Attila Doroszlai" <ad...@apache.org> wrote:
> >Hi all,
> >
> >I would like to propose preparing maintenance releases of Ratis
> >Third-party and Ratis with the following changes since 1.0.3 and
> >2.4.1, respectively:
> >
> >Ratis Thirdparty 1.0.4
> >* RATIS-1760. Bump Netty to 4.1.86.Final to fix CVE-2022-41881
> >
> >Ratis 2.4.2
> >* RATIS-1748. Cache getMetricName to reduce garbage
> >* Changes required for Ozone certificate improvements (RATIS-1747,
> RATIS-1753)
> >* RATIS-1745. Improve performance of AwaitForSignal by reducing amount
> >of exceptions created
> >* RATIS-1754. Set leader to null when stepping down
> >* RATIS-1756. Consistent usage of gapThreshold in getMajorityMin
> >* RATIS-1776. Switch to slf4j-reload4j
> >* RATIS-1792. Replace parallelStream usage in PeerProxyMap
> >
> >Is there any other fix that should be backported from master to branch-2?
> >
> >thanks,
> >Attila
>

Re:[DISCUSS] Maintenance releases Ratis Third-party 1.0.4 and Ratis 2.4.2

Posted by Yaolong Liu <ly...@163.com>.
Hi Attila,


Thanks for starting this discussion, I want to include linearizable read related commits in the next release of Ratis.
Here is the list:



RATIS-1643. Add heartbeat broadcast mechanism for leader readIndex

RATIS-1696. Support linearizable read-only requests in leader

RATIS-1701. Add new Server RPC: readIndex

RATIS-1706. Move heartbeat listeners to LeaderState

RATIS-1715. Support linearizable read in AsyncApi

RATIS-1716. Separate ReadException and ReadIndexException for client retry

RATIS-1758. Add linearizable read in Counter example

RATIS-1759. Support client use linearizable read per request

RATIS-1773. Fix readIndexHeartbeat using incorrct index handle onAppendEntriesReply method

RATIS-1778. Fix NPE in readIndexHeartbeats



BTW, since linearizable read is a relatively large feature,  should we directly use 2.5.0 as the next release version number.


Regards,
Yaolong





At 2023-02-27 23:08:04, "Attila Doroszlai" <ad...@apache.org> wrote:
>Hi all,
>
>I would like to propose preparing maintenance releases of Ratis
>Third-party and Ratis with the following changes since 1.0.3 and
>2.4.1, respectively:
>
>Ratis Thirdparty 1.0.4
>* RATIS-1760. Bump Netty to 4.1.86.Final to fix CVE-2022-41881
>
>Ratis 2.4.2
>* RATIS-1748. Cache getMetricName to reduce garbage
>* Changes required for Ozone certificate improvements (RATIS-1747, RATIS-1753)
>* RATIS-1745. Improve performance of AwaitForSignal by reducing amount
>of exceptions created
>* RATIS-1754. Set leader to null when stepping down
>* RATIS-1756. Consistent usage of gapThreshold in getMajorityMin
>* RATIS-1776. Switch to slf4j-reload4j
>* RATIS-1792. Replace parallelStream usage in PeerProxyMap
>
>Is there any other fix that should be backported from master to branch-2?
>
>thanks,
>Attila