You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Wei-Chiu Chuang <we...@apache.org> on 2022/01/03 09:39:13 UTC
Next Mandarin Hadoop Online Meetup Jan 6th.
Hello community,
This week we'll going to have Tao Li (tomscut) speaking about the
experience of operating HDFS at BIGO. See you on Thursday!
题目：《HDFS在BIGO的实践》
概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
关键词：Router，Slow Node，Slow Disk
演讲者：Tao Li (Apache id: tomscut)
Date/Time: Jan 6 2PM Beijing Time.
Zoom link: https://cloudera.zoom.us/j/97264903288
One tap mobile
+16465588656,,880548968# US (New York)
+17207072699,,880548968# US
Download Center <https://cloudera.zoom.us/j/880548968>
Dial by your location
+1 646 558 8656 US (New York)
+1 720 707 2699 US
877 853 5257 US Toll-free
888 475 4499 US Toll-free
Meeting ID: 972 6490 3288
Find your local number: https://zoom.us/u/acaGRDfMVl
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by tom lee <to...@gmail.com>.
Thanks @Wei-Chiu Chuang <we...@apache.org>, @Hui Fei for informing us of
this.
Looking forward to more discussions.😊
Wei-Chiu Chuang <we...@apache.org> 于2022年1月3日周一 17:40写道：
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by tom lee <to...@gmail.com>.
Thanks @Wei-Chiu Chuang <we...@apache.org>, @Hui Fei for informing us of
this.
Looking forward to more discussions.😊
Wei-Chiu Chuang <we...@apache.org> 于2022年1月3日周一 17:40写道：
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by Wei-Chiu Chuang <we...@apache.org>.
Hello
Thanks for joining this event.
The presentation slides (in English) is available at
https://drive.google.com/file/d/1PiZYhzxANqtoyO_nSLt_-v7aP3j17Sbg/view
The recording (in Mandarin) is available at
https://cloudera.zoom.us/rec/share/JaNm70lZQGCZdlFzh9ZbsfrR7MJ7Nazb2g6NCtYPqsRLWtyEhLfgwXOppzMR3csp.HqRJNGXUGSaPu1qw
Access Passcode: 4g1ZF&%f
On Mon, Jan 3, 2022 at 5:39 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Just a gentle reminder this is happening now.
On Mon, Jan 3, 2022 at 5:39 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by Wei-Chiu Chuang <we...@apache.org>.
Hello
Thanks for joining this event.
The presentation slides (in English) is available at
https://drive.google.com/file/d/1PiZYhzxANqtoyO_nSLt_-v7aP3j17Sbg/view
The recording (in Mandarin) is available at
https://cloudera.zoom.us/rec/share/JaNm70lZQGCZdlFzh9ZbsfrR7MJ7Nazb2g6NCtYPqsRLWtyEhLfgwXOppzMR3csp.HqRJNGXUGSaPu1qw
Access Passcode: 4g1ZF&%f
On Mon, Jan 3, 2022 at 5:39 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by tom lee <to...@gmail.com>.
Thanks @Wei-Chiu Chuang <we...@apache.org>, @Hui Fei for informing us of
this.
Looking forward to more discussions.😊
Wei-Chiu Chuang <we...@apache.org> 于2022年1月3日周一 17:40写道：
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Just a gentle reminder this is happening now.
On Mon, Jan 3, 2022 at 5:39 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Just a gentle reminder this is happening now.
On Mon, Jan 3, 2022 at 5:39 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>
Re: Next Mandarin Hadoop Online Meetup Jan 6th.
Posted by Wei-Chiu Chuang <we...@apache.org>.
Hello
Thanks for joining this event.
The presentation slides (in English) is available at
https://drive.google.com/file/d/1PiZYhzxANqtoyO_nSLt_-v7aP3j17Sbg/view
The recording (in Mandarin) is available at
https://cloudera.zoom.us/rec/share/JaNm70lZQGCZdlFzh9ZbsfrR7MJ7Nazb2g6NCtYPqsRLWtyEhLfgwXOppzMR3csp.HqRJNGXUGSaPu1qw
Access Passcode: 4g1ZF&%f
On Mon, Jan 3, 2022 at 5:39 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> Hello community,
>
> This week we'll going to have Tao Li (tomscut) speaking about the
> experience of operating HDFS at BIGO. See you on Thursday!
>
> 题目：《HDFS在BIGO的实践》
> 概要：HDFS作为大数据底层存储服务，在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长，HDFS单个集群的瓶颈愈发凸显，我们借助Router，将多个HDFS集群整合成一个Namespace，增强集群的扩展能力；改造Router，使其支持Alluxio和自定义策略，并开启HDFS
> EC，实现热、温、冷数据分层存储。同时，通过对HDFS集群慢节点和慢盘的处理，提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验，以及对慢节点和慢盘的处理经验。
> 关键词：Router，Slow Node，Slow Disk
> 演讲者：Tao Li (Apache id: tomscut)
>
> Date/Time: Jan 6 2PM Beijing Time.
>
> Zoom link: https://cloudera.zoom.us/j/97264903288
>
> One tap mobile
>
> +16465588656,,880548968# US (New York)
>
> +17207072699,,880548968# US
>
> Download Center <https://cloudera.zoom.us/j/880548968>
>
> Dial by your location
>
> +1 646 558 8656 US (New York)
>
> +1 720 707 2699 US
>
> 877 853 5257 US Toll-free
>
> 888 475 4499 US Toll-free
>
> Meeting ID: 972 6490 3288
> Find your local number: https://zoom.us/u/acaGRDfMVl
>