You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Wei-Chiu Chuang <we...@cloudera.com.INVALID> on 2020/04/23 18:56:22 UTC

Next week's Hadoop storage community call: HDFS-15289

Hi!

I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
talk about a new feature proposal HDFS-15289
<https://issues.apache.org/jira/browse/HDFS-15289> and invite the community
to discuss it. This feature is built upon ViewFS and overcomes its
limitations. It is intended to bridge Ozone and HDFS, making the migration
to Ozone more seamless. It can also make migration to cloud easier.

For details, please check out the design doc in the JIRA attachment.

April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm

Please join via Zoom:
https://cloudera.zoom.us/j/880548968

Past meeting minutes
https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit

Re: Next week's Hadoop storage community call: HDFS-15289

Posted by Uma Maheswara Rao Gangumalla <um...@cloudera.com.INVALID>.
Thanks Wei-Chiu for setting up the call and thanks everyone for joining.

Regards,
Uma

On Wed, Apr 29, 2020 at 3:34 PM Wei-Chiu Chuang <we...@cloudera.com>
wrote:

> Thanks Uma and everyone who joined today.
>
> 4/29 HDFS-15289 Allow viewfs mounts with hdfs scheme and centralized
> mount table
>
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing
>
> Speaker: Uma
>
> Participants: Weichiu, Nanda, Sree, Craig, Kevin, Yisheng, Chen, Seth,
> Shashikant
>
> Viewfs use cases: HDFS federation, heterogenerous file systems, hbrid
> cloud, multi-cloud
>
> The challenge of changing scheme and what is proposed to configure
> ViewFSOverloadScheme.
>
> Central mount table
>
>
> Please find the recording below:
>
> https://cloudera.zoom.us/rec/play/vJx8deD5rG43SNySuQSDBPV9W9S0K_qs2ihLrPUIxBm3UHcKY1Ogb7YWMOPp1lMTvnpe4vlA6DI2Icfn?continueMode=true
> Password: 1i&h9!?#
>
> Uma’s slides
>
> https://drive.google.com/open?id=1HGODu5KF6Djn0fup1WAl1U4rbcgQpcvQ
>
>
> On Wed, Apr 29, 2020 at 9:02 AM Wei-Chiu Chuang <we...@apache.org>
> wrote:
>
>> Reminder: this call is going to happen in about an hour.
>> I see that LinkedIn is working on something similar. It would be great if
>> the team can join the call and share your use cases so we can iron out
>> potential problems.
>>
>> On Thu, Apr 23, 2020 at 11:56 AM Wei-Chiu Chuang <we...@cloudera.com>
>> wrote:
>>
>>> Hi!
>>>
>>> I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
>>> talk about a new feature proposal HDFS-15289
>>> <https://issues.apache.org/jira/browse/HDFS-15289> and invite the
>>> community to discuss it. This feature is built upon ViewFS and overcomes
>>> its limitations. It is intended to bridge Ozone and HDFS, making the
>>> migration to Ozone more seamless. It can also make migration to cloud
>>> easier.
>>>
>>> For details, please check out the design doc in the JIRA attachment.
>>>
>>> April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm
>>>
>>> Please join via Zoom:
>>> https://cloudera.zoom.us/j/880548968
>>>
>>> Past meeting minutes
>>>
>>> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>>>
>>>

Re: Next week's Hadoop storage community call: HDFS-15289

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Thanks Uma and everyone who joined today.

4/29 HDFS-15289 Allow viewfs mounts with hdfs scheme and centralized mount
table

https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing

Speaker: Uma

Participants: Weichiu, Nanda, Sree, Craig, Kevin, Yisheng, Chen, Seth,
Shashikant

Viewfs use cases: HDFS federation, heterogenerous file systems, hbrid
cloud, multi-cloud

The challenge of changing scheme and what is proposed to configure
ViewFSOverloadScheme.

Central mount table


Please find the recording below:
https://cloudera.zoom.us/rec/play/vJx8deD5rG43SNySuQSDBPV9W9S0K_qs2ihLrPUIxBm3UHcKY1Ogb7YWMOPp1lMTvnpe4vlA6DI2Icfn?continueMode=true
Password: 1i&h9!?#

Uma’s slides

https://drive.google.com/open?id=1HGODu5KF6Djn0fup1WAl1U4rbcgQpcvQ


On Wed, Apr 29, 2020 at 9:02 AM Wei-Chiu Chuang <we...@apache.org> wrote:

> Reminder: this call is going to happen in about an hour.
> I see that LinkedIn is working on something similar. It would be great if
> the team can join the call and share your use cases so we can iron out
> potential problems.
>
> On Thu, Apr 23, 2020 at 11:56 AM Wei-Chiu Chuang <we...@cloudera.com>
> wrote:
>
>> Hi!
>>
>> I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
>> talk about a new feature proposal HDFS-15289
>> <https://issues.apache.org/jira/browse/HDFS-15289> and invite the
>> community to discuss it. This feature is built upon ViewFS and overcomes
>> its limitations. It is intended to bridge Ozone and HDFS, making the
>> migration to Ozone more seamless. It can also make migration to cloud
>> easier.
>>
>> For details, please check out the design doc in the JIRA attachment.
>>
>> April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm
>>
>> Please join via Zoom:
>> https://cloudera.zoom.us/j/880548968
>>
>> Past meeting minutes
>>
>> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>>
>>

Re: Next week's Hadoop storage community call: HDFS-15289

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Thanks Uma and everyone who joined today.

4/29 HDFS-15289 Allow viewfs mounts with hdfs scheme and centralized mount
table

https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing

Speaker: Uma

Participants: Weichiu, Nanda, Sree, Craig, Kevin, Yisheng, Chen, Seth,
Shashikant

Viewfs use cases: HDFS federation, heterogenerous file systems, hbrid
cloud, multi-cloud

The challenge of changing scheme and what is proposed to configure
ViewFSOverloadScheme.

Central mount table


Please find the recording below:
https://cloudera.zoom.us/rec/play/vJx8deD5rG43SNySuQSDBPV9W9S0K_qs2ihLrPUIxBm3UHcKY1Ogb7YWMOPp1lMTvnpe4vlA6DI2Icfn?continueMode=true
Password: 1i&h9!?#

Uma’s slides

https://drive.google.com/open?id=1HGODu5KF6Djn0fup1WAl1U4rbcgQpcvQ


On Wed, Apr 29, 2020 at 9:02 AM Wei-Chiu Chuang <we...@apache.org> wrote:

> Reminder: this call is going to happen in about an hour.
> I see that LinkedIn is working on something similar. It would be great if
> the team can join the call and share your use cases so we can iron out
> potential problems.
>
> On Thu, Apr 23, 2020 at 11:56 AM Wei-Chiu Chuang <we...@cloudera.com>
> wrote:
>
>> Hi!
>>
>> I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
>> talk about a new feature proposal HDFS-15289
>> <https://issues.apache.org/jira/browse/HDFS-15289> and invite the
>> community to discuss it. This feature is built upon ViewFS and overcomes
>> its limitations. It is intended to bridge Ozone and HDFS, making the
>> migration to Ozone more seamless. It can also make migration to cloud
>> easier.
>>
>> For details, please check out the design doc in the JIRA attachment.
>>
>> April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm
>>
>> Please join via Zoom:
>> https://cloudera.zoom.us/j/880548968
>>
>> Past meeting minutes
>>
>> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>>
>>

Re: Next week's Hadoop storage community call: HDFS-15289

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Thanks Uma and everyone who joined today.

4/29 HDFS-15289 Allow viewfs mounts with hdfs scheme and centralized mount
table

https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing

Speaker: Uma

Participants: Weichiu, Nanda, Sree, Craig, Kevin, Yisheng, Chen, Seth,
Shashikant

Viewfs use cases: HDFS federation, heterogenerous file systems, hbrid
cloud, multi-cloud

The challenge of changing scheme and what is proposed to configure
ViewFSOverloadScheme.

Central mount table


Please find the recording below:
https://cloudera.zoom.us/rec/play/vJx8deD5rG43SNySuQSDBPV9W9S0K_qs2ihLrPUIxBm3UHcKY1Ogb7YWMOPp1lMTvnpe4vlA6DI2Icfn?continueMode=true
Password: 1i&h9!?#

Uma’s slides

https://drive.google.com/open?id=1HGODu5KF6Djn0fup1WAl1U4rbcgQpcvQ


On Wed, Apr 29, 2020 at 9:02 AM Wei-Chiu Chuang <we...@apache.org> wrote:

> Reminder: this call is going to happen in about an hour.
> I see that LinkedIn is working on something similar. It would be great if
> the team can join the call and share your use cases so we can iron out
> potential problems.
>
> On Thu, Apr 23, 2020 at 11:56 AM Wei-Chiu Chuang <we...@cloudera.com>
> wrote:
>
>> Hi!
>>
>> I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
>> talk about a new feature proposal HDFS-15289
>> <https://issues.apache.org/jira/browse/HDFS-15289> and invite the
>> community to discuss it. This feature is built upon ViewFS and overcomes
>> its limitations. It is intended to bridge Ozone and HDFS, making the
>> migration to Ozone more seamless. It can also make migration to cloud
>> easier.
>>
>> For details, please check out the design doc in the JIRA attachment.
>>
>> April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm
>>
>> Please join via Zoom:
>> https://cloudera.zoom.us/j/880548968
>>
>> Past meeting minutes
>>
>> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>>
>>

Re: Next week's Hadoop storage community call: HDFS-15289

Posted by Wei-Chiu Chuang <we...@apache.org>.
Reminder: this call is going to happen in about an hour.
I see that LinkedIn is working on something similar. It would be great if
the team can join the call and share your use cases so we can iron out
potential problems.

On Thu, Apr 23, 2020 at 11:56 AM Wei-Chiu Chuang <we...@cloudera.com>
wrote:

> Hi!
>
> I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
> talk about a new feature proposal HDFS-15289
> <https://issues.apache.org/jira/browse/HDFS-15289> and invite the
> community to discuss it. This feature is built upon ViewFS and overcomes
> its limitations. It is intended to bridge Ozone and HDFS, making the
> migration to Ozone more seamless. It can also make migration to cloud
> easier.
>
> For details, please check out the design doc in the JIRA attachment.
>
> April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>

Re: Next week's Hadoop storage community call: HDFS-15289

Posted by Wei-Chiu Chuang <we...@apache.org>.
Reminder: this call is going to happen in about an hour.
I see that LinkedIn is working on something similar. It would be great if
the team can join the call and share your use cases so we can iron out
potential problems.

On Thu, Apr 23, 2020 at 11:56 AM Wei-Chiu Chuang <we...@cloudera.com>
wrote:

> Hi!
>
> I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
> talk about a new feature proposal HDFS-15289
> <https://issues.apache.org/jira/browse/HDFS-15289> and invite the
> community to discuss it. This feature is built upon ViewFS and overcomes
> its limitations. It is intended to bridge Ozone and HDFS, making the
> migration to Ozone more seamless. It can also make migration to cloud
> easier.
>
> For details, please check out the design doc in the JIRA attachment.
>
> April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>

Fwd: Next week's Hadoop storage community call: HDFS-15289

Posted by Wei-Chiu Chuang <we...@apache.org>.
Welcome Ozone devs to join too.
---------- Forwarded message ---------
From: Wei-Chiu Chuang <we...@cloudera.com>
Date: Thu, Apr 23, 2020 at 11:56 AM
Subject: Next week's Hadoop storage community call: HDFS-15289
To: Hadoop Common <co...@hadoop.apache.org>, Hdfs-dev <
hdfs-dev@hadoop.apache.org>, Uma Maheswara Rao Gangumalla <
umagangumalla@cloudera.com>


Hi!

I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
talk about a new feature proposal HDFS-15289
<https://issues.apache.org/jira/browse/HDFS-15289> and invite the community
to discuss it. This feature is built upon ViewFS and overcomes its
limitations. It is intended to bridge Ozone and HDFS, making the migration
to Ozone more seamless. It can also make migration to cloud easier.

For details, please check out the design doc in the JIRA attachment.

April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm

Please join via Zoom:
https://cloudera.zoom.us/j/880548968

Past meeting minutes
https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit

Re: Next week's Hadoop storage community call: HDFS-15289

Posted by Wei-Chiu Chuang <we...@apache.org>.
Reminder: this call is going to happen in about an hour.
I see that LinkedIn is working on something similar. It would be great if
the team can join the call and share your use cases so we can iron out
potential problems.

On Thu, Apr 23, 2020 at 11:56 AM Wei-Chiu Chuang <we...@cloudera.com>
wrote:

> Hi!
>
> I am inviting @Uma Maheswara Rao Gangumalla <um...@cloudera.com> to
> talk about a new feature proposal HDFS-15289
> <https://issues.apache.org/jira/browse/HDFS-15289> and invite the
> community to discuss it. This feature is built upon ViewFS and overcomes
> its limitations. It is intended to bridge Ozone and HDFS, making the
> migration to Ozone more seamless. It can also make migration to cloud
> easier.
>
> For details, please check out the design doc in the JIRA attachment.
>
> April 29th (Wednesday) US Pacific: 10am, GMT 5pm, India 10:30pm
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>