You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ozone.apache.org by "Elek, Marton" <el...@apache.org> on 2020/08/31 14:45:07 UTC
Topics for the community sync
Some possible topics which might need a discussion:
1. HDDS-4097 (s3 compatibility vs. file system semantics)
2. HDDS-4119 (Incremental Buffer)
3. storage-class proposal (PR is ready)
4. TLP proposal
If you have anything else, you can add it to here or during the call.
Marton
ps: Work on feature branches are very important and sometimes doesn't
get the deserved attention. I think it would be great to provide a quick
(monthly?) update about the bigger projects (SCM-HA, EC, upgrade). Just
to have a high level info about the status. But can be started later.
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: Topics for the community sync
Posted by "Elek, Marton" <el...@apache.org>.
Yes, it's weekly, or more precisely, there are two syncs per week. A
second one is also opened to make it easier to discuss from APAC time zones.
Scheduling is here:
https://cwiki.apache.org/confluence/display/HADOOP/Ozone+Community+Calls
Marton
On 9/2/20 7:37 AM, Rui Wang wrote:
> Hello,
>
> I might be missing it, is the community sync schedule documented somewhere?
> E.g. is it a weekly sync?
>
>
> -Rui
>
> On Mon, Aug 31, 2020 at 7:41 PM Lin, Yiqun <yi...@ebay.com.invalid> wrote:
>
>> Rakesh, thank you for updating current status of HDDS-2939.
>> Will have a look for the WIP PR.
>>
>> Thanks,
>> Yiqun
>>
>> On 2020/9/1, 12:44 AM, "Rakesh Radhakrishnan" <ra...@gmail.com>
>> wrote:
>>
>> External Email
>>
>> Thank you for your interest in HDDS-2939 (Ozone FS namespace)
>> optimization.
>> PoC has been done and please feel free to look into WIP PR
>> <
>> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F912&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=8jb%2FRzo8mxFXNhjFdup42LaPCa0RlVVSg5nDyNVbAlM%3D&reserved=0>to
>> understand the feature.
>> There is a branch HDDS-2939 feature branch
>> <
>> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F1230&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=GDPdUdBAy88XkLqJtZwojCESamwA%2F80s8Rq491haWwU%3D&reserved=0>
>> created to upstream the
>> sub-tasks incrementally. I saw you have reviewed the first patch
>> created
>> <
>> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F1230&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=GDPdUdBAy88XkLqJtZwojCESamwA%2F80s8Rq491haWwU%3D&reserved=0>
>> on this branch. Thanks a
>> lot for the help!
>>
>> Presently, I am working on the directory cache design and upgrade
>> design.
>> These two tasks are very important as the first one would help to
>> *reduce
>> the performance penalties on the path traversal*. Later one is to
>> provide
>> an efficient way to make a smooth upgrade experience to the users.
>>
>> Thanks,
>> Rakesh
>>
>> On Mon, Aug 31, 2020 at 8:39 PM Lin, Yiqun <yi...@ebay.com.invalid>
>> wrote:
>>
>> > Hi Marton,
>> >
>> > Can we additionally add topic for HDDS-2939 (Ozone FS namespace)?
>> > I notice this feature hasn't been updated for nearly one month.
>> > This is a good feature to support efficient FS namespace operations
>> in
>> > Ozone.
>> >
>> > I can help the review if there needs someone to help do this, : ).
>> >
>> > Thanks,
>> > Yiqun
>> >
>> > On 2020/8/31, 10:45 PM, "Elek, Marton" <el...@apache.org> wrote:
>> >
>> > External Email
>> >
>> > Some possible topics which might need a discussion:
>> >
>> > 1. HDDS-4097 (s3 compatibility vs. file system semantics)
>> > 2. HDDS-4119 (Incremental Buffer)
>> > 3. storage-class proposal (PR is ready)
>> > 4. TLP proposal
>> >
>> > If you have anything else, you can add it to here or during the
>> call.
>> >
>> > Marton
>> >
>> > ps: Work on feature branches are very important and sometimes
>> doesn't
>> > get the deserved attention. I think it would be great to provide
>> a
>> > quick
>> > (monthly?) update about the bigger projects (SCM-HA, EC,
>> upgrade).
>> > Just
>> > to have a high level info about the status. But can be started
>> later.
>> >
>> >
>> ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail:
>> ozone-dev-help@hadoop.apache.org
>> >
>> >
>> >
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: Topics for the community sync
Posted by Rui Wang <am...@apache.org>.
Hello,
I might be missing it, is the community sync schedule documented somewhere?
E.g. is it a weekly sync?
-Rui
On Mon, Aug 31, 2020 at 7:41 PM Lin, Yiqun <yi...@ebay.com.invalid> wrote:
> Rakesh, thank you for updating current status of HDDS-2939.
> Will have a look for the WIP PR.
>
> Thanks,
> Yiqun
>
> On 2020/9/1, 12:44 AM, "Rakesh Radhakrishnan" <ra...@gmail.com>
> wrote:
>
> External Email
>
> Thank you for your interest in HDDS-2939 (Ozone FS namespace)
> optimization.
> PoC has been done and please feel free to look into WIP PR
> <
> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F912&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=8jb%2FRzo8mxFXNhjFdup42LaPCa0RlVVSg5nDyNVbAlM%3D&reserved=0>to
> understand the feature.
> There is a branch HDDS-2939 feature branch
> <
> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F1230&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=GDPdUdBAy88XkLqJtZwojCESamwA%2F80s8Rq491haWwU%3D&reserved=0>
> created to upstream the
> sub-tasks incrementally. I saw you have reviewed the first patch
> created
> <
> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F1230&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=GDPdUdBAy88XkLqJtZwojCESamwA%2F80s8Rq491haWwU%3D&reserved=0>
> on this branch. Thanks a
> lot for the help!
>
> Presently, I am working on the directory cache design and upgrade
> design.
> These two tasks are very important as the first one would help to
> *reduce
> the performance penalties on the path traversal*. Later one is to
> provide
> an efficient way to make a smooth upgrade experience to the users.
>
> Thanks,
> Rakesh
>
> On Mon, Aug 31, 2020 at 8:39 PM Lin, Yiqun <yi...@ebay.com.invalid>
> wrote:
>
> > Hi Marton,
> >
> > Can we additionally add topic for HDDS-2939 (Ozone FS namespace)?
> > I notice this feature hasn't been updated for nearly one month.
> > This is a good feature to support efficient FS namespace operations
> in
> > Ozone.
> >
> > I can help the review if there needs someone to help do this, : ).
> >
> > Thanks,
> > Yiqun
> >
> > On 2020/8/31, 10:45 PM, "Elek, Marton" <el...@apache.org> wrote:
> >
> > External Email
> >
> > Some possible topics which might need a discussion:
> >
> > 1. HDDS-4097 (s3 compatibility vs. file system semantics)
> > 2. HDDS-4119 (Incremental Buffer)
> > 3. storage-class proposal (PR is ready)
> > 4. TLP proposal
> >
> > If you have anything else, you can add it to here or during the
> call.
> >
> > Marton
> >
> > ps: Work on feature branches are very important and sometimes
> doesn't
> > get the deserved attention. I think it would be great to provide
> a
> > quick
> > (monthly?) update about the bigger projects (SCM-HA, EC,
> upgrade).
> > Just
> > to have a high level info about the status. But can be started
> later.
> >
> >
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail:
> ozone-dev-help@hadoop.apache.org
> >
> >
> >
>
>
Re: Topics for the community sync
Posted by "Lin, Yiqun" <yi...@ebay.com.INVALID>.
Rakesh, thank you for updating current status of HDDS-2939.
Will have a look for the WIP PR.
Thanks,
Yiqun
On 2020/9/1, 12:44 AM, "Rakesh Radhakrishnan" <ra...@gmail.com> wrote:
External Email
Thank you for your interest in HDDS-2939 (Ozone FS namespace) optimization.
PoC has been done and please feel free to look into WIP PR
<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F912&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=8jb%2FRzo8mxFXNhjFdup42LaPCa0RlVVSg5nDyNVbAlM%3D&reserved=0>to understand the feature.
There is a branch HDDS-2939 feature branch
<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F1230&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=GDPdUdBAy88XkLqJtZwojCESamwA%2F80s8Rq491haWwU%3D&reserved=0> created to upstream the
sub-tasks incrementally. I saw you have reviewed the first patch created
<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhadoop-ozone%2Fpull%2F1230&data=02%7C01%7Cyiqlin%40ebay.com%7C8b825a215cb14606e6fc08d84dcd27d9%7C46326bff992841a0baca17c16c94ea99%7C0%7C1%7C637344890815450413&sdata=GDPdUdBAy88XkLqJtZwojCESamwA%2F80s8Rq491haWwU%3D&reserved=0> on this branch. Thanks a
lot for the help!
Presently, I am working on the directory cache design and upgrade design.
These two tasks are very important as the first one would help to *reduce
the performance penalties on the path traversal*. Later one is to provide
an efficient way to make a smooth upgrade experience to the users.
Thanks,
Rakesh
On Mon, Aug 31, 2020 at 8:39 PM Lin, Yiqun <yi...@ebay.com.invalid> wrote:
> Hi Marton,
>
> Can we additionally add topic for HDDS-2939 (Ozone FS namespace)?
> I notice this feature hasn't been updated for nearly one month.
> This is a good feature to support efficient FS namespace operations in
> Ozone.
>
> I can help the review if there needs someone to help do this, : ).
>
> Thanks,
> Yiqun
>
> On 2020/8/31, 10:45 PM, "Elek, Marton" <el...@apache.org> wrote:
>
> External Email
>
> Some possible topics which might need a discussion:
>
> 1. HDDS-4097 (s3 compatibility vs. file system semantics)
> 2. HDDS-4119 (Incremental Buffer)
> 3. storage-class proposal (PR is ready)
> 4. TLP proposal
>
> If you have anything else, you can add it to here or during the call.
>
> Marton
>
> ps: Work on feature branches are very important and sometimes doesn't
> get the deserved attention. I think it would be great to provide a
> quick
> (monthly?) update about the bigger projects (SCM-HA, EC, upgrade).
> Just
> to have a high level info about the status. But can be started later.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
>
Re: Topics for the community sync
Posted by Rakesh Radhakrishnan <ra...@gmail.com>.
Thank you for your interest in HDDS-2939 (Ozone FS namespace) optimization.
PoC has been done and please feel free to look into WIP PR
<https://github.com/apache/hadoop-ozone/pull/912>to understand the feature.
There is a branch HDDS-2939 feature branch
<https://github.com/apache/hadoop-ozone/pull/1230> created to upstream the
sub-tasks incrementally. I saw you have reviewed the first patch created
<https://github.com/apache/hadoop-ozone/pull/1230> on this branch. Thanks a
lot for the help!
Presently, I am working on the directory cache design and upgrade design.
These two tasks are very important as the first one would help to *reduce
the performance penalties on the path traversal*. Later one is to provide
an efficient way to make a smooth upgrade experience to the users.
Thanks,
Rakesh
On Mon, Aug 31, 2020 at 8:39 PM Lin, Yiqun <yi...@ebay.com.invalid> wrote:
> Hi Marton,
>
> Can we additionally add topic for HDDS-2939 (Ozone FS namespace)?
> I notice this feature hasn't been updated for nearly one month.
> This is a good feature to support efficient FS namespace operations in
> Ozone.
>
> I can help the review if there needs someone to help do this, : ).
>
> Thanks,
> Yiqun
>
> On 2020/8/31, 10:45 PM, "Elek, Marton" <el...@apache.org> wrote:
>
> External Email
>
> Some possible topics which might need a discussion:
>
> 1. HDDS-4097 (s3 compatibility vs. file system semantics)
> 2. HDDS-4119 (Incremental Buffer)
> 3. storage-class proposal (PR is ready)
> 4. TLP proposal
>
> If you have anything else, you can add it to here or during the call.
>
> Marton
>
> ps: Work on feature branches are very important and sometimes doesn't
> get the deserved attention. I think it would be great to provide a
> quick
> (monthly?) update about the bigger projects (SCM-HA, EC, upgrade).
> Just
> to have a high level info about the status. But can be started later.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
>
Re: Topics for the community sync
Posted by "Lin, Yiqun" <yi...@ebay.com.INVALID>.
Hi Marton,
Can we additionally add topic for HDDS-2939 (Ozone FS namespace)?
I notice this feature hasn't been updated for nearly one month.
This is a good feature to support efficient FS namespace operations in Ozone.
I can help the review if there needs someone to help do this, : ).
Thanks,
Yiqun
On 2020/8/31, 10:45 PM, "Elek, Marton" <el...@apache.org> wrote:
External Email
Some possible topics which might need a discussion:
1. HDDS-4097 (s3 compatibility vs. file system semantics)
2. HDDS-4119 (Incremental Buffer)
3. storage-class proposal (PR is ready)
4. TLP proposal
If you have anything else, you can add it to here or during the call.
Marton
ps: Work on feature branches are very important and sometimes doesn't
get the deserved attention. I think it would be great to provide a quick
(monthly?) update about the bigger projects (SCM-HA, EC, upgrade). Just
to have a high level info about the status. But can be started later.
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org