You are viewing a plain text version of this content. The canonical link for it is here.
Posted to submarine-dev@hadoop.apache.org by Eric Badger <eb...@verizonmedia.com.INVALID> on 2019/12/09 03:53:59 UTC
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Hi Runlin,
Awesome to hear that you've been able to upgrade! Do you mind sharing some
thoughts on your experience with the upgrade? Did you take a cluster
downtime to do the upgrade? How long did the upgrade take? Did you find any
incompatibilities or issues during or after the upgrade? Do you know if
your performance is better, worse, or similar?
Feel free to answer as many or as few of these as you would like.
Thanks!
Eric
On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
> Hi Folks,
>
> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS has
> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has nearly
> 10,000 nodes，Now the cluster services are stable and we are using new
> features, such as EC, that bring huge benefits！ Here I want to thank my
> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> Linhai, Wu Tong; And thanks to the community.
>
> It is also highly recommended that you upgrade the version to 3.2.1, If
> you have any problems in the upgrade, you can also communicate and discuss
> with me.
>
>
> Thanks
> Runlin Zhang
>
回复：[Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by "郑锴(铁杰)" <zh...@alibaba-inc.com>.
Cool Runlin. I'm pretty happy you folks finally benefit from Hadoop 3 and HDFS Erasure Coding feature now. Guess you could have an Apache blog introducing this great work?
-kai
------------------------------------------------------------------
发件人：Runlin zhang <ru...@gmail.com>
发送时间：2019年12月12日(星期四) 02:14
收件人：Weiwei Yang <ab...@gmail.com>
抄 送：Eric Badger <eb...@verizonmedia.com.invalid>; Hui Fei <fe...@gmail.com>; yarn-dev <ya...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; submarine-dev <su...@hadoop.apache.org>
主 题：Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Yes, we also plan to upgrade YARN, and we expect to complete the upgrade
in Q3-Q4 of 2020
Weiwei Yang <ab...@gmail.com> 于2019年12月10日周二 上午10:24写道：
> Awesome! You guys rock!!
> Any plan to upgrade YARN to latest version too?
>
> --
> Weiwei
> On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
>
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> Hi Folks,
>
> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
>
> has
>
> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
>
> nearly
>
> 10,000 nodes，Now the cluster services are stable and we are using new
> features, such as EC, that bring huge benefits！ Here I want to thank my
> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> Linhai, Wu Tong; And thanks to the community.
>
> It is also highly recommended that you upgrade the version to 3.2.1,
>
> If
>
> you have any problems in the upgrade, you can also communicate and
>
> discuss
>
> with me.
>
>
> Thanks
> Runlin Zhang
>
>
>
回复：[Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by "郑锴(铁杰)" <zh...@alibaba-inc.com>.
Cool Runlin. I'm pretty happy you folks finally benefit from Hadoop 3 and HDFS Erasure Coding feature now. Guess you could have an Apache blog introducing this great work?
-kai
------------------------------------------------------------------
发件人：Runlin zhang <ru...@gmail.com>
发送时间：2019年12月12日(星期四) 02:14
收件人：Weiwei Yang <ab...@gmail.com>
抄 送：Eric Badger <eb...@verizonmedia.com.invalid>; Hui Fei <fe...@gmail.com>; yarn-dev <ya...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; submarine-dev <su...@hadoop.apache.org>
主 题：Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Yes, we also plan to upgrade YARN, and we expect to complete the upgrade
in Q3-Q4 of 2020
Weiwei Yang <ab...@gmail.com> 于2019年12月10日周二 上午10:24写道：
> Awesome! You guys rock!!
> Any plan to upgrade YARN to latest version too?
>
> --
> Weiwei
> On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
>
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> Hi Folks,
>
> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
>
> has
>
> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
>
> nearly
>
> 10,000 nodes，Now the cluster services are stable and we are using new
> features, such as EC, that bring huge benefits！ Here I want to thank my
> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> Linhai, Wu Tong; And thanks to the community.
>
> It is also highly recommended that you upgrade the version to 3.2.1,
>
> If
>
> you have any problems in the upgrade, you can also communicate and
>
> discuss
>
> with me.
>
>
> Thanks
> Runlin Zhang
>
>
>
回复：[Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by "郑锴(铁杰)" <zh...@alibaba-inc.com>.
Cool Runlin. I'm pretty happy you folks finally benefit from Hadoop 3 and HDFS Erasure Coding feature now. Guess you could have an Apache blog introducing this great work?
-kai
------------------------------------------------------------------
发件人：Runlin zhang <ru...@gmail.com>
发送时间：2019年12月12日(星期四) 02:14
收件人：Weiwei Yang <ab...@gmail.com>
抄 送：Eric Badger <eb...@verizonmedia.com.invalid>; Hui Fei <fe...@gmail.com>; yarn-dev <ya...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; submarine-dev <su...@hadoop.apache.org>
主 题：Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Yes, we also plan to upgrade YARN, and we expect to complete the upgrade
in Q3-Q4 of 2020
Weiwei Yang <ab...@gmail.com> 于2019年12月10日周二 上午10:24写道：
> Awesome! You guys rock!!
> Any plan to upgrade YARN to latest version too?
>
> --
> Weiwei
> On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
>
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> Hi Folks,
>
> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
>
> has
>
> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
>
> nearly
>
> 10,000 nodes，Now the cluster services are stable and we are using new
> features, such as EC, that bring huge benefits！ Here I want to thank my
> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> Linhai, Wu Tong; And thanks to the community.
>
> It is also highly recommended that you upgrade the version to 3.2.1,
>
> If
>
> you have any problems in the upgrade, you can also communicate and
>
> discuss
>
> with me.
>
>
> Thanks
> Runlin Zhang
>
>
>
回复：[Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by "郑锴(铁杰)" <zh...@alibaba-inc.com>.
Cool Runlin. I'm pretty happy you folks finally benefit from Hadoop 3 and HDFS Erasure Coding feature now. Guess you could have an Apache blog introducing this great work?
-kai
------------------------------------------------------------------
发件人：Runlin zhang <ru...@gmail.com>
发送时间：2019年12月12日(星期四) 02:14
收件人：Weiwei Yang <ab...@gmail.com>
抄 送：Eric Badger <eb...@verizonmedia.com.invalid>; Hui Fei <fe...@gmail.com>; yarn-dev <ya...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; submarine-dev <su...@hadoop.apache.org>
主 题：Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Yes, we also plan to upgrade YARN, and we expect to complete the upgrade
in Q3-Q4 of 2020
Weiwei Yang <ab...@gmail.com> 于2019年12月10日周二 上午10:24写道：
> Awesome! You guys rock!!
> Any plan to upgrade YARN to latest version too?
>
> --
> Weiwei
> On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
>
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> Hi Folks,
>
> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
>
> has
>
> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
>
> nearly
>
> 10,000 nodes，Now the cluster services are stable and we are using new
> features, such as EC, that bring huge benefits！ Here I want to thank my
> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> Linhai, Wu Tong; And thanks to the community.
>
> It is also highly recommended that you upgrade the version to 3.2.1,
>
> If
>
> you have any problems in the upgrade, you can also communicate and
>
> discuss
>
> with me.
>
>
> Thanks
> Runlin Zhang
>
>
>
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by Runlin zhang <ru...@gmail.com>.
Yes, we also plan to upgrade YARN, and we expect to complete the upgrade
in Q3-Q4 of 2020
Weiwei Yang <ab...@gmail.com> 于2019年12月10日周二 上午10:24写道：
> Awesome! You guys rock!!
> Any plan to upgrade YARN to latest version too?
>
> --
> Weiwei
> On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
>
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> Hi Folks,
>
> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
>
> has
>
> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
>
> nearly
>
> 10,000 nodes，Now the cluster services are stable and we are using new
> features, such as EC, that bring huge benefits！ Here I want to thank my
> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> Linhai, Wu Tong; And thanks to the community.
>
> It is also highly recommended that you upgrade the version to 3.2.1,
>
> If
>
> you have any problems in the upgrade, you can also communicate and
>
> discuss
>
> with me.
>
>
> Thanks
> Runlin Zhang
>
>
>
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to
3.2.0
Posted by runlin zhang <ru...@gmail.com>.
Yes, We also plan to upgrade YARN, and we expect to complete the upgrade in Q3-Q4 of 2020
> 在 2019年12月10日，上午10:23，Weiwei Yang <ab...@gmail.com> 写道：
>
> Awesome! You guys rock!!
> Any plan to upgrade YARN to latest version too?
>
> --
> Weiwei
> On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
>> Hi Eric,
>>
>> It's Rolling Upgrade without downtime. We have a cluster with thousands of
>> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
>> Service includes JournalNode, NameNode, ZKFC and DataNode.
>> Related issues of rolling upgrade
>> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
>> Watching HDFS-13671 about performance.
>>
>> Thanks!
>>
>> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>>
>>> Hi Runlin,
>>>
>>> Awesome to hear that you've been able to upgrade! Do you mind sharing some
>>> thoughts on your experience with the upgrade? Did you take a cluster
>>> downtime to do the upgrade? How long did the upgrade take? Did you find any
>>> incompatibilities or issues during or after the upgrade? Do you know if
>>> your performance is better, worse, or similar?
>>>
>>> Feel free to answer as many or as few of these as you would like.
>>>
>>> Thanks!
>>>
>>> Eric
>>>
>>> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>>>
>>>> Hi Folks,
>>>>
>>>> This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
>>> has
>>>> just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
>>> nearly
>>>> 10,000 nodes，Now the cluster services are stable and we are using new
>>>> features, such as EC, that bring huge benefits！ Here I want to thank my
>>>> colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
>>>> Linhai, Wu Tong; And thanks to the community.
>>>>
>>>> It is also highly recommended that you upgrade the version to 3.2.1,
>>> If
>>>> you have any problems in the upgrade, you can also communicate and
>>> discuss
>>>> with me.
>>>>
>>>>
>>>> Thanks
>>>> Runlin Zhang
>>>>
>>>
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2
to 3.2.0
Posted by Weiwei Yang <ab...@gmail.com>.
Awesome! You guys rock!!
Any plan to upgrade YARN to latest version too?
--
Weiwei
On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> > Hi Runlin,
> >
> > Awesome to hear that you've been able to upgrade! Do you mind sharing some
> > thoughts on your experience with the upgrade? Did you take a cluster
> > downtime to do the upgrade? How long did the upgrade take? Did you find any
> > incompatibilities or issues during or after the upgrade? Do you know if
> > your performance is better, worse, or similar?
> >
> > Feel free to answer as many or as few of these as you would like.
> >
> > Thanks!
> >
> > Eric
> >
> > On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
> >
> > > Hi Folks,
> > >
> > > This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
> > has
> > > just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
> > nearly
> > > 10,000 nodes，Now the cluster services are stable and we are using new
> > > features, such as EC, that bring huge benefits！ Here I want to thank my
> > > colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> > > Linhai, Wu Tong; And thanks to the community.
> > >
> > > It is also highly recommended that you upgrade the version to 3.2.1,
> > If
> > > you have any problems in the upgrade, you can also communicate and
> > discuss
> > > with me.
> > >
> > >
> > > Thanks
> > > Runlin Zhang
> > >
> >
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2
to 3.2.0
Posted by Weiwei Yang <ab...@gmail.com>.
Awesome! You guys rock!!
Any plan to upgrade YARN to latest version too?
--
Weiwei
On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> > Hi Runlin,
> >
> > Awesome to hear that you've been able to upgrade! Do you mind sharing some
> > thoughts on your experience with the upgrade? Did you take a cluster
> > downtime to do the upgrade? How long did the upgrade take? Did you find any
> > incompatibilities or issues during or after the upgrade? Do you know if
> > your performance is better, worse, or similar?
> >
> > Feel free to answer as many or as few of these as you would like.
> >
> > Thanks!
> >
> > Eric
> >
> > On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
> >
> > > Hi Folks,
> > >
> > > This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
> > has
> > > just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
> > nearly
> > > 10,000 nodes，Now the cluster services are stable and we are using new
> > > features, such as EC, that bring huge benefits！ Here I want to thank my
> > > colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> > > Linhai, Wu Tong; And thanks to the community.
> > >
> > > It is also highly recommended that you upgrade the version to 3.2.1,
> > If
> > > you have any problems in the upgrade, you can also communicate and
> > discuss
> > > with me.
> > >
> > >
> > > Thanks
> > > Runlin Zhang
> > >
> >
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2
to 3.2.0
Posted by Weiwei Yang <ab...@gmail.com>.
Awesome! You guys rock!!
Any plan to upgrade YARN to latest version too?
--
Weiwei
On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> > Hi Runlin,
> >
> > Awesome to hear that you've been able to upgrade! Do you mind sharing some
> > thoughts on your experience with the upgrade? Did you take a cluster
> > downtime to do the upgrade? How long did the upgrade take? Did you find any
> > incompatibilities or issues during or after the upgrade? Do you know if
> > your performance is better, worse, or similar?
> >
> > Feel free to answer as many or as few of these as you would like.
> >
> > Thanks!
> >
> > Eric
> >
> > On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
> >
> > > Hi Folks,
> > >
> > > This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
> > has
> > > just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
> > nearly
> > > 10,000 nodes，Now the cluster services are stable and we are using new
> > > features, such as EC, that bring huge benefits！ Here I want to thank my
> > > colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> > > Linhai, Wu Tong; And thanks to the community.
> > >
> > > It is also highly recommended that you upgrade the version to 3.2.1,
> > If
> > > you have any problems in the upgrade, you can also communicate and
> > discuss
> > > with me.
> > >
> > >
> > > Thanks
> > > Runlin Zhang
> > >
> >
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2
to 3.2.0
Posted by Weiwei Yang <ab...@gmail.com>.
Awesome! You guys rock!!
Any plan to upgrade YARN to latest version too?
--
Weiwei
On Dec 9, 2019, 5:20 PM -0800, Hui Fei <fe...@gmail.com>, wrote:
> Hi Eric,
>
> It's Rolling Upgrade without downtime. We have a cluster with thousands of
> nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
> Service includes JournalNode, NameNode, ZKFC and DataNode.
> Related issues of rolling upgrade
> are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
> Watching HDFS-13671 about performance.
>
> Thanks!
>
> Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
>
> > Hi Runlin,
> >
> > Awesome to hear that you've been able to upgrade! Do you mind sharing some
> > thoughts on your experience with the upgrade? Did you take a cluster
> > downtime to do the upgrade? How long did the upgrade take? Did you find any
> > incompatibilities or issues during or after the upgrade? Do you know if
> > your performance is better, worse, or similar?
> >
> > Feel free to answer as many or as few of these as you would like.
> >
> > Thanks!
> >
> > Eric
> >
> > On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
> >
> > > Hi Folks,
> > >
> > > This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
> > has
> > > just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
> > nearly
> > > 10,000 nodes，Now the cluster services are stable and we are using new
> > > features, such as EC, that bring huge benefits！ Here I want to thank my
> > > colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> > > Linhai, Wu Tong; And thanks to the community.
> > >
> > > It is also highly recommended that you upgrade the version to 3.2.1,
> > If
> > > you have any problems in the upgrade, you can also communicate and
> > discuss
> > > with me.
> > >
> > >
> > > Thanks
> > > Runlin Zhang
> > >
> >
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by Hui Fei <fe...@gmail.com>.
Hi Eric,
It's Rolling Upgrade without downtime. We have a cluster with thousands of
nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
Service includes JournalNode, NameNode, ZKFC and DataNode.
Related issues of rolling upgrade
are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
Watching HDFS-13671 about performance.
Thanks!
Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> > Hi Folks,
> >
> > This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
> has
> > just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
> nearly
> > 10,000 nodes，Now the cluster services are stable and we are using new
> > features, such as EC, that bring huge benefits！ Here I want to thank my
> > colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> > Linhai, Wu Tong; And thanks to the community.
> >
> > It is also highly recommended that you upgrade the version to 3.2.1,
> If
> > you have any problems in the upgrade, you can also communicate and
> discuss
> > with me.
> >
> >
> > Thanks
> > Runlin Zhang
> >
>
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by Hui Fei <fe...@gmail.com>.
Hi Eric,
It's Rolling Upgrade without downtime. We have a cluster with thousands of
nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
Service includes JournalNode, NameNode, ZKFC and DataNode.
Related issues of rolling upgrade
are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
Watching HDFS-13671 about performance.
Thanks!
Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> > Hi Folks,
> >
> > This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
> has
> > just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
> nearly
> > 10,000 nodes，Now the cluster services are stable and we are using new
> > features, such as EC, that bring huge benefits！ Here I want to thank my
> > colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> > Linhai, Wu Tong; And thanks to the community.
> >
> > It is also highly recommended that you upgrade the version to 3.2.1,
> If
> > you have any problems in the upgrade, you can also communicate and
> discuss
> > with me.
> >
> >
> > Thanks
> > Runlin Zhang
> >
>
Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0
Posted by Hui Fei <fe...@gmail.com>.
Hi Eric,
It's Rolling Upgrade without downtime. We have a cluster with thousands of
nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading
Service includes JournalNode, NameNode, ZKFC and DataNode.
Related issues of rolling upgrade
are HDFS-13596，HDFS-14396，HDFS-14831，HDFS-14509.
Watching HDFS-13671 about performance.
Thanks!
Eric Badger <eb...@verizonmedia.com.invalid> 于2019年12月9日周一 上午11:54写道：
> Hi Runlin,
>
> Awesome to hear that you've been able to upgrade! Do you mind sharing some
> thoughts on your experience with the upgrade? Did you take a cluster
> downtime to do the upgrade? How long did the upgrade take? Did you find any
> incompatibilities or issues during or after the upgrade? Do you know if
> your performance is better, worse, or similar?
>
> Feel free to answer as many or as few of these as you would like.
>
> Thanks!
>
> Eric
>
> On Sun, Dec 8, 2019 at 9:14 PM Runlin zhang <ru...@gmail.com> wrote:
>
> > Hi Folks,
> >
> > This is Runlin Zhang from DiDi. I'm glad to announce that our HDFS
> has
> > just been successfully upgraded from 2.7.2 to 3.2.0， Our cluster has
> nearly
> > 10,000 nodes，Now the cluster services are stable and we are using new
> > features, such as EC, that bring huge benefits！ Here I want to thank my
> > colleagues for their efforts, Fei Hui, Hu Haiyang, Wang Hongbing, Zhu
> > Linhai, Wu Tong; And thanks to the community.
> >
> > It is also highly recommended that you upgrade the version to 3.2.1,
> If
> > you have any problems in the upgrade, you can also communicate and
> discuss
> > with me.
> >
> >
> > Thanks
> > Runlin Zhang
> >
>