[DISCUSSION] Chukwa path to 1.0

[Eric Yang <er...@gmail.com>]

Hi all,

Hadoop 3.x has removed Hadoop metrics v1 api, and also Record IO, sequence
file related API.  For Chukwa to continue the path to 1.0, we have a few
options:

1.  Release whatever we have with Hadoop 2.9.2, and call it Chukwa 1.0.
Some metrics would not be accurate because reliance on Hadoop metrics v1
api.
2.  Update the code to use Hadoop metrics v2, and continue the path to 0.9,
and 0.x releases until Chukwa become stable with new API.  Chukwa 1.0 will
be base on Hadoop 3.x.
3.  Import Hadoop metrics v1 api to Chukwa to keep maintaining backward
compatibility.
4.  Retire the project.

I am in favor of option #2.  However, this will lead to replace parts of
Chukwa agent with metrics v2 api, and complete removal of Demux and
archival API, which are destructive to Chukwa project.  This can only be
done with a lot of planning and code contribution.  Thoughts?

regards,
Eric

Re: [DISCUSSION] Chukwa path to 1.0

[Eric Yang <er...@gmail.com>]

Ping.

On Sun, Jul 7, 2019 at 9:52 AM Eric Yang <er...@gmail.com> wrote:

> Hi all,
>
> Hadoop 3.x has removed Hadoop metrics v1 api, and also Record IO, sequence
> file related API.  For Chukwa to continue the path to 1.0, we have a few
> options:
>
> 1.  Release whatever we have with Hadoop 2.9.2, and call it Chukwa 1.0.
> Some metrics would not be accurate because reliance on Hadoop metrics v1
> api.
> 2.  Update the code to use Hadoop metrics v2, and continue the path to
> 0.9, and 0.x releases until Chukwa become stable with new API.  Chukwa 1.0
> will be base on Hadoop 3.x.
> 3.  Import Hadoop metrics v1 api to Chukwa to keep maintaining backward
> compatibility.
> 4.  Retire the project.
>
> I am in favor of option #2.  However, this will lead to replace parts of
> Chukwa agent with metrics v2 api, and complete removal of Demux and
> archival API, which are destructive to Chukwa project.  This can only be
> done with a lot of planning and code contribution.  Thoughts?
>
> regards,
> Eric
>