You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Wei-Chiu Chuang <we...@apache.org> on 2020/03/25 00:44:03 UTC

Hadoop Storage community call

Hi!

For the bi-weekly Hadoop Storage community next week, we'll do something
different this time:

Gabor Bota is going to talk about "404 Not Found" -- New and old issues
with S3A; Current state and what's next.

Stay tuned. Looking forward to seeing more cloud connector topics in the
future.

April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm


Please join via Zoom:
https://cloudera.zoom.us/j/880548968

Past meeting minutes
https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit

Re: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Reminder -- this call is happening in about 2 hours.

Stay safe!
Weichiu

On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang <we...@apache.org> wrote:

> Hi!
>
> For the bi-weekly Hadoop Storage community next week, we'll do something
> different this time:
>
> Gabor Bota is going to talk about "404 Not Found" -- New and old issues
> with S3A; Current state and what's next.
>
> Stay tuned. Looking forward to seeing more cloud connector topics in the
> future.
>
> April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm
>
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>

Re: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Reminder -- this call is happening in about 2 hours.

Stay safe!
Weichiu

On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang <we...@apache.org> wrote:

> Hi!
>
> For the bi-weekly Hadoop Storage community next week, we'll do something
> different this time:
>
> Gabor Bota is going to talk about "404 Not Found" -- New and old issues
> with S3A; Current state and what's next.
>
> Stay tuned. Looking forward to seeing more cloud connector topics in the
> future.
>
> April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm
>
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>

Fwd: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Forwarding this to the user mailing list since the topic may be more
interesting for users.

---------- Forwarded message ---------
From: Wei-Chiu Chuang <we...@apache.org>
Date: Tue, Mar 24, 2020 at 5:44 PM
Subject: Hadoop Storage community call
To: Hadoop Common <co...@hadoop.apache.org>, Hdfs-dev <
hdfs-dev@hadoop.apache.org>
Cc: Gabor Bota <ga...@cloudera.com>


Hi!

For the bi-weekly Hadoop Storage community next week, we'll do something
different this time:

Gabor Bota is going to talk about "404 Not Found" -- New and old issues
with S3A; Current state and what's next.

Stay tuned. Looking forward to seeing more cloud connector topics in the
future.

April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm


Please join via Zoom:
https://cloudera.zoom.us/j/880548968

Past meeting minutes
https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit

Re: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Here's the slides:
https://www.slideshare.net/GaborBota/hadoop-330-s3a-community-call-202004

On Wed, Apr 1, 2020 at 11:43 AM Wei-Chiu Chuang <we...@cloudera.com>
wrote:

> Thanks Gabor for today's discussion.
>
> Please find the recording here:
> https://cloudera.zoom.us/rec/play/6ccrJOiuqD43SdeUsQSDVvQvW9S8LK6s0CRK-fsNzkazViNQNAGlMudGN7dEOJ4JkMw9i6ZXHCbML8l9?continueMode=true
>
>
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing
>
> 4/1/2020
>
> Speaker: Gabor
>
> Participants: Weichiu, Chen, Clay, Fabbri, Kevin, Mukund, Stephen, Steve,
> Brahma
>
> S3Guard no longer experimental
>
> S3 behavior caveats -- inconsistency, caching
>
> S3A new features in Hadoop 3.3
>
> → delegation token, etags and versioning, openssl support, s3 select,
> better delete throttling to avoid thundering herd effect, S3Guard Fsck
>
> Future: IOStatistics, Vectored IO
>
>
>
> On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang <we...@apache.org>
> wrote:
>
>> Hi!
>>
>> For the bi-weekly Hadoop Storage community next week, we'll do something
>> different this time:
>>
>> Gabor Bota is going to talk about "404 Not Found" -- New and old issues
>> with S3A; Current state and what's next.
>>
>> Stay tuned. Looking forward to seeing more cloud connector topics in the
>> future.
>>
>> April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm
>>
>>
>> Please join via Zoom:
>> https://cloudera.zoom.us/j/880548968
>>
>> Past meeting minutes
>>
>> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>>
>>

Re: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Here's the slides:
https://www.slideshare.net/GaborBota/hadoop-330-s3a-community-call-202004

On Wed, Apr 1, 2020 at 11:43 AM Wei-Chiu Chuang <we...@cloudera.com>
wrote:

> Thanks Gabor for today's discussion.
>
> Please find the recording here:
> https://cloudera.zoom.us/rec/play/6ccrJOiuqD43SdeUsQSDVvQvW9S8LK6s0CRK-fsNzkazViNQNAGlMudGN7dEOJ4JkMw9i6ZXHCbML8l9?continueMode=true
>
>
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing
>
> 4/1/2020
>
> Speaker: Gabor
>
> Participants: Weichiu, Chen, Clay, Fabbri, Kevin, Mukund, Stephen, Steve,
> Brahma
>
> S3Guard no longer experimental
>
> S3 behavior caveats -- inconsistency, caching
>
> S3A new features in Hadoop 3.3
>
> → delegation token, etags and versioning, openssl support, s3 select,
> better delete throttling to avoid thundering herd effect, S3Guard Fsck
>
> Future: IOStatistics, Vectored IO
>
>
>
> On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang <we...@apache.org>
> wrote:
>
>> Hi!
>>
>> For the bi-weekly Hadoop Storage community next week, we'll do something
>> different this time:
>>
>> Gabor Bota is going to talk about "404 Not Found" -- New and old issues
>> with S3A; Current state and what's next.
>>
>> Stay tuned. Looking forward to seeing more cloud connector topics in the
>> future.
>>
>> April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm
>>
>>
>> Please join via Zoom:
>> https://cloudera.zoom.us/j/880548968
>>
>> Past meeting minutes
>>
>> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>>
>>

Re: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Thanks Gabor for today's discussion.

Please find the recording here:
https://cloudera.zoom.us/rec/play/6ccrJOiuqD43SdeUsQSDVvQvW9S8LK6s0CRK-fsNzkazViNQNAGlMudGN7dEOJ4JkMw9i6ZXHCbML8l9?continueMode=true


https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing

4/1/2020

Speaker: Gabor

Participants: Weichiu, Chen, Clay, Fabbri, Kevin, Mukund, Stephen, Steve,
Brahma

S3Guard no longer experimental

S3 behavior caveats -- inconsistency, caching

S3A new features in Hadoop 3.3

→ delegation token, etags and versioning, openssl support, s3 select,
better delete throttling to avoid thundering herd effect, S3Guard Fsck

Future: IOStatistics, Vectored IO



On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang <we...@apache.org> wrote:

> Hi!
>
> For the bi-weekly Hadoop Storage community next week, we'll do something
> different this time:
>
> Gabor Bota is going to talk about "404 Not Found" -- New and old issues
> with S3A; Current state and what's next.
>
> Stay tuned. Looking forward to seeing more cloud connector topics in the
> future.
>
> April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm
>
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>

Re: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Thanks Gabor for today's discussion.

Please find the recording here:
https://cloudera.zoom.us/rec/play/6ccrJOiuqD43SdeUsQSDVvQvW9S8LK6s0CRK-fsNzkazViNQNAGlMudGN7dEOJ4JkMw9i6ZXHCbML8l9?continueMode=true


https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing

4/1/2020

Speaker: Gabor

Participants: Weichiu, Chen, Clay, Fabbri, Kevin, Mukund, Stephen, Steve,
Brahma

S3Guard no longer experimental

S3 behavior caveats -- inconsistency, caching

S3A new features in Hadoop 3.3

→ delegation token, etags and versioning, openssl support, s3 select,
better delete throttling to avoid thundering herd effect, S3Guard Fsck

Future: IOStatistics, Vectored IO



On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang <we...@apache.org> wrote:

> Hi!
>
> For the bi-weekly Hadoop Storage community next week, we'll do something
> different this time:
>
> Gabor Bota is going to talk about "404 Not Found" -- New and old issues
> with S3A; Current state and what's next.
>
> Stay tuned. Looking forward to seeing more cloud connector topics in the
> future.
>
> April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm
>
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>

Re: Hadoop Storage community call

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Reminder -- this call is happening in about 2 hours.

Stay safe!
Weichiu

On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang <we...@apache.org> wrote:

> Hi!
>
> For the bi-weekly Hadoop Storage community next week, we'll do something
> different this time:
>
> Gabor Bota is going to talk about "404 Not Found" -- New and old issues
> with S3A; Current state and what's next.
>
> Stay tuned. Looking forward to seeing more cloud connector topics in the
> future.
>
> April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm
>
>
> Please join via Zoom:
> https://cloudera.zoom.us/j/880548968
>
> Past meeting minutes
>
> https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit
>
>