回复：[Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0

["郑锴(铁杰)" <zh...@alibaba-inc.com>]

Cool Runlin. I'm pretty happy you folks finally benefit from Hadoop 3 and HDFS Erasure Coding feature now. Guess you could have an Apache blog introducing this great work?

-kai


------------------------------------------------------------------
发件人：Runlin zhang <ru...@gmail.com>
发送时间：2019年12月12日(星期四) 02:14
收件人：Weiwei Yang <ab...@gmail.com>
抄　送：Eric Badger <eb...@verizonmedia.com.invalid>; Hui Fei <fe...@gmail.com>; yarn-dev <ya...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; submarine-dev <su...@hadoop.apache.org>
主　题：Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0

Yes, we also plan to upgrade YARN, and we expect to complete the upgrade
in  Q3-Q4 of 2020

Weiwei Yang <ab...@gmail.com> 于2019年12月10日周二 上午10:24写道：

> Awesome! You guys rock!!
> Any plan to upgrade YARN to latest version too?
>
> --
> Weiwei
> On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
>
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> Hi Folks,
>
> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
>
> has
>
> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
>
> nearly
>
> 10,000 nodes，Now the cluster services are stable and we are using new
> features, such as EC, that bring huge benefits！ Here I want to thank my
> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> Linhai, Wu Tong; And thanks to the community.
>
> It is also highly recommended that you upgrade the version to 3.2.1,
>
> If
>
> you have any problems in the upgrade, you can also communicate and
>
> discuss
>
> with me.
>
>
> Thanks
> Runlin Zhang
>
>
>