You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@community.apache.org by Alfred Webber <at...@wimss.com> on 2016/11/11 19:09:13 UTC

Metrics & Baseline Reporting to Apache

Hi team,


I am a SCM/Dev OPS Architect.   I would like to offer advanced CM Metrics and analysis features to the Apache project if you have not already done it or have any plans to do so.   I would like to discuss this with team leads if possible.  I will host the metrics if necessary as a benefit to the team.

The metrics will collect, collate, and chart information for all projects.  The data will be collected from

1.      SVN

2.      Jira

3.      Jenkins

4.      Sonar

5.      Etc.

The metrics could be a boon for those teams that make use of Apache projects to see a BI approach to the efforts of the Apache team.   Of course, like other partners, it would benefit myself as well.  Having provided this kind of service to the Apache project would illustrate the acumen of myself and my team.


I eagerly await your response :),


-Alfred Webber
[cid:image003.jpg@01D23C25.2DEE8AB0]<https://www.linkedin.com/in/atwebber>



RE: Metrics & Baseline Reporting to Apache

Posted by Alfred Webber <at...@wimss.com>.
Thanks Shane that was really helpful as well.   Thanks for advising me  the ban limits.  I won't come anywhere near those :)


Thanks again!


-Alfred

-----Original Message-----
From: Shane Curcuru [mailto:asf@shanecurcuru.org] 
Sent: Monday, November 14, 2016 10:49 AM
To: dev@community.apache.org; Alfred Webber <at...@wimss.com>
Subject: Re: Metrics & Baseline Reporting to Apache

Alfred Webber wrote on 11/14/16 3:31 PM:
> Thanks Niclas,
> 
> Openhub has most of what I was thinking.   It’s a case of not knowing
> what was out there.   Thanks so much for the link.  There is a little
> more I would like to see with this.  But this is a big help.    Now,
> I know that it can & has been done, I can add what I need or use as 
> is.

There are also some statistics collected in our projects listing, and the ComDev project (here) is interested in adding more data over time:

  https://projects.apache.org/

> Most of the information in OpenHub comes from version control logs
> which is awesome.   I wanted to report on builds, issues, unit tests
> (where they exists) as well.   The only missing piece was how to
> query ASF Jira without the 100 record limit.   Based on your
> feedback, this may be a non-issue as I’m connecting to the Jira 
> projects as ‘anonymous’ and anonymous users by default may have the
> 100 record limit.

If you're crawling any Apache service, just be aware of the ban rules:

  https://www.apache.org/dev/infra-ban.html

- Shane

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org


Re: Metrics & Baseline Reporting to Apache

Posted by Shane Curcuru <as...@shanecurcuru.org>.
Alfred Webber wrote on 11/14/16 3:31 PM:
> Thanks Niclas,
> 
> Openhub has most of what I was thinking.   It\u2019s a case of not knowing
> what was out there.   Thanks so much for the link.  There is a little
> more I would like to see with this.  But this is a big help.    Now,
> I know that it can & has been done, I can add what I need or use as
> is.

There are also some statistics collected in our projects listing, and
the ComDev project (here) is interested in adding more data over time:

  https://projects.apache.org/

> Most of the information in OpenHub comes from version control logs
> which is awesome.   I wanted to report on builds, issues, unit tests
> (where they exists) as well.   The only missing piece was how to
> query ASF Jira without the 100 record limit.   Based on your
> feedback, this may be a non-issue as I\u2019m connecting to the Jira
> projects as \u2018anonymous\u2019 and anonymous users by default may have the
> 100 record limit.

If you're crawling any Apache service, just be aware of the ban rules:

  https://www.apache.org/dev/infra-ban.html

- Shane

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org


RE: Metrics & Baseline Reporting to Apache

Posted by Alfred Webber <at...@wimss.com>.
Thanks Niclas,

Openhub has most of what I was thinking.   It’s a case of not knowing what was out there.   Thanks so much for the link.  There is a little more I would like to see with this.  But this is a big help.    Now, I know that it can & has been done, I can add what I need or use as is.

Most of the information in OpenHub comes from version control logs which is awesome.   I wanted to report on builds, issues, unit tests (where they exists) as well.   The only missing piece was how to query ASF Jira without the 100 record limit.   Based on your feedback, this may be a non-issue as I’m connecting to the Jira projects as ‘anonymous’ and anonymous users by default may have the 100 record limit.

Niclas, not many people take the time to respond to these types of requests/inquires.  I’m very guilty of that myself.   Thanks for your input!

-Alfred



From: hedhman@gmail.com [mailto:hedhman@gmail.com] On Behalf Of Niclas Hedhman
Sent: Monday, November 14, 2016 3:40 AM
To: Alfred Webber <at...@wimss.com>
Cc: dev@community.apache.org
Subject: Re: Metrics & Baseline Reporting to Apache


Trust me, I was not offended by your request, more "surprised" and somewhat "so what do you want from us". And maybe I should have dug up http://www.openhub.com that provides these kind of metrics, and I know of one other effort as well, but can't find the link (possibly not public yet).

I am just one peer here, and other people may have other opinion. In no way is my reply a stance of ASF itself, but I think you understand that.

Good Luck
Niclas

On Mon, Nov 14, 2016 at 11:41 AM, Alfred Webber <at...@wimss.com>> wrote:
Hi Niclas,

I’m not sure I wanted anyone to jump up and down as If I discovered water on Mars ☺.  This is not a new concept or idea.  I simply haven’t seen it being published and thought it would be a nice thing.

Of course, just because I haven’t seen it, doesn’t make it innovative and, of course, the technology involve is not earth shattering in the least and I never suggested as much.  In fact, I even mentioned that it may already be done.   I think that a simple message pointing me to the other efforts, if they are published, would have been a more appropriate response as that is what I suggested was a possibility in my message.

I understand the concept of ASF.  I understand that there are no “teams”.   The teams I was referencing were external teams.   I did, however, assume that there may be some gate-keeper[s] (team leads) for the ASF tools like Jira, SVN , and Jenkins and that I might need some understanding around access to these tools, Jira in particular.   I am very familiar with the tools but access to query Jira beyond the 100 record limit would require additional information.

Nicla, at times, I work on projects where teams are reluctant to use open source code.   This reluctance is, of course, largely unfounded.   Even in 2010 and beyond, I have had to fight to get tools like Jenkins, Maven, Rundeck, Nagios, Nexus, Python, etc. ‘approved’  I’m sure others know this pain.  By showing these teams that open source is ran more predictably and is usually more repeatable than many in-house projects, it would have some benefit.   The tools already in use by ASF do a wonderful job, I was simply looking for something that was more abstract/agnostic from the tools as some teams don’t use the same tools as ASF.  I wanted metrics capturing that looked at the lifecycle of the open source effort in total without respect of the tools that captured the data.   For example, something like an Elastic Search dashboard that gave a full view of the SDLC without having to go to Jira, Jenkins, SVN, etc. separately.

Sometimes in our field we can take offense when none was intended.  I think this was one of those times.  If anyone in the Apache dev community was offended by my request, please know that was not my goal.  I value your work and champion your efforts on all projects!  The entire IT community is in your debt.


Thanks a billion,


-Alfred

From: hedhman@gmail.com<ma...@gmail.com> [mailto:hedhman@gmail.com<ma...@gmail.com>] On Behalf Of Niclas Hedhman
Sent: Sunday, November 13, 2016 5:51 PM
To: Alfred Webber <at...@wimss.com>>
Cc: dev@community.apache.org<ma...@community.apache.org>
Subject: Re: Metrics & Baseline Reporting to Apache

Forgot to use Alfred's mail address, as I suspect he is not subscribed...

On Mon, Nov 14, 2016 at 6:49 AM, Niclas Hedhman <ni...@hedhman.org>> wrote:
Alfred,
The first metric that you should learn is that there are no "teams" and no "team leads" in ASF. There are Apache projects, and they are populated by individuals, operating independently of any organizational structure.

Secondly, you are welcome to collect, collate and chart any information that you want, as many other organizations and individuals have done in the past. I don't see anything new or remarkably innovative by your effort, so I can't imagine that anyone within the ASF will jump up and down in excitement over your request.


Good Luck
Niclas


On Sat, Nov 12, 2016 at 3:09 AM, Alfred Webber <at...@wimss.com>> wrote:
Hi team,


I am a SCM/Dev OPS Architect.   I would like to offer advanced CM Metrics and analysis features to the Apache project if you have not already done it or have any plans to do so.   I would like to discuss this with team leads if possible.  I will host the metrics if necessary as a benefit to the team.

The metrics will collect, collate, and chart information for all projects.  The data will be collected from

1.      SVN

2.      Jira

3.      Jenkins

4.      Sonar

5.      Etc.

The metrics could be a boon for those teams that make use of Apache projects to see a BI approach to the efforts of the Apache team.   Of course, like other partners, it would benefit myself as well.  Having provided this kind of service to the Apache project would illustrate the acumen of myself and my team.


I eagerly await your response ☺,


-Alfred Webber
 <https://www.linkedin.com/in/atwebber>
 <https://www.linkedin.com/in/atwebber>


<https://www.linkedin.com/in/atwebber>
 <https://www.linkedin.com/in/atwebber>
-- <https://www.linkedin.com/in/atwebber>
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java<https://www.linkedin.com/in/atwebber>


<https://www.linkedin.com/in/atwebber>
 <https://www.linkedin.com/in/atwebber>
-- <https://www.linkedin.com/in/atwebber>
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java<https://www.linkedin.com/in/atwebber>



--
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java

Re: Metrics & Baseline Reporting to Apache

Posted by Niclas Hedhman <ni...@hedhman.org>.
Trust me, I was not offended by your request, more "surprised" and somewhat
"so what do you want from us". And maybe I should have dug up
http://www.openhub.com that provides these kind of metrics, and I know of
one other effort as well, but can't find the link (possibly not public yet).

I am just one peer here, and other people may have other opinion. In no way
is my reply a stance of ASF itself, but I think you understand that.

Good Luck
Niclas

On Mon, Nov 14, 2016 at 11:41 AM, Alfred Webber <at...@wimss.com> wrote:

> Hi Niclas,
>
>
>
> I’m not sure I wanted anyone to jump up and down as If I discovered water
> on Mars J.  This is not a new concept or idea.  I simply haven’t seen it
> being published and thought it would be a nice thing.
>
>
>
> Of course, just because I haven’t seen it, doesn’t make it innovative and,
> of course, the technology involve is not earth shattering in the least and
> I never suggested as much.  In fact, I even mentioned that it may
> *already* be done.   I think that a simple message pointing me to the
> other efforts, if they are published, would have been a more appropriate
> response as that is what I suggested was a possibility in my message.
>
>
>
> I understand the concept of ASF.  I understand that there are no
> “teams”.   The teams I was referencing were *external* teams.   I did,
> however, assume that there may be some gate-keeper[s] (team leads) for the
> ASF tools like Jira, SVN , and Jenkins and that I might need some
> understanding around access to these tools, Jira in particular.   I am very
> familiar with the tools but access to query Jira beyond the 100 record
> limit would require additional information.
>
>
>
> Nicla, at times, I work on projects where teams are reluctant to use open
> source code.   This reluctance is, of course, largely unfounded.   Even in
> 2010 and beyond, I have had to fight to get tools like Jenkins, Maven,
> Rundeck, Nagios, Nexus, Python, etc. ‘approved’  I’m sure others know this
> pain.  By showing these teams that open source is ran more predictably and
> is usually more repeatable than many in-house projects, it would have some
> benefit.   The tools already in use by ASF do a *wonderful* job, I was
> simply looking for something that was more abstract/agnostic from the tools
> as some teams don’t use the same tools as ASF.  I wanted metrics capturing
> that looked at the lifecycle of the open source effort in total without
> respect of the tools that captured the data.   For example, something like
> an Elastic Search dashboard that gave a full view of the SDLC without
> having to go to Jira, Jenkins, SVN, etc. separately.
>
>
>
> Sometimes in our field we can take offense when none was intended.  I
> think this was one of those times.  If anyone in the Apache dev community
> was offended by my request, please know that was not my goal.  I value your
> work and champion your efforts on all projects!  The entire IT community is
> in your debt.
>
>
>
>
>
> Thanks a billion,
>
>
>
>
>
> -Alfred
>
>
>
> *From:* hedhman@gmail.com [mailto:hedhman@gmail.com] *On Behalf Of *Niclas
> Hedhman
> *Sent:* Sunday, November 13, 2016 5:51 PM
> *To:* Alfred Webber <at...@wimss.com>
> *Cc:* dev@community.apache.org
> *Subject:* Re: Metrics & Baseline Reporting to Apache
>
>
>
> Forgot to use Alfred's mail address, as I suspect he is not subscribed...
>
>
>
> On Mon, Nov 14, 2016 at 6:49 AM, Niclas Hedhman <ni...@hedhman.org>
> wrote:
>
> Alfred,
>
> The first metric that you should learn is that there are no "teams" and no
> "team leads" in ASF. There are Apache projects, and they are populated by
> individuals, operating independently of any organizational structure.
>
>
>
> Secondly, you are welcome to collect, collate and chart any information
> that you want, as many other organizations and individuals have done in the
> past. I don't see anything new or remarkably innovative by your effort, so
> I can't imagine that anyone within the ASF will jump up and down in
> excitement over your request.
>
>
>
>
>
> Good Luck
>
> Niclas
>
>
>
>
>
> On Sat, Nov 12, 2016 at 3:09 AM, Alfred Webber <at...@wimss.com> wrote:
>
> Hi team,
>
>
>
>
>
> I am a SCM/Dev OPS Architect.   I would like to offer advanced CM Metrics
> and analysis features to the Apache project if you have not already done it
> or have any plans to do so.   I would like to discuss this with team leads
> if possible.  I will host the metrics if necessary as a benefit to the team.
>
>
>
> The metrics will collect, collate, and chart information for all
> projects.  The data will be collected from
>
> 1.      SVN
>
> 2.      Jira
>
> 3.      Jenkins
>
> 4.      Sonar
>
> 5.      Etc.
>
>
>
> The metrics could be a boon for those teams that make use of Apache
> projects to see a BI approach to the efforts of the Apache team.   Of
> course, like other partners, it would benefit myself as well.  Having
> provided this kind of service to the Apache project would illustrate the
> acumen of myself and my team.
>
>
>
>
>
> I eagerly await your response J,
>
>
>
>
>
> -Alfred Webber
>
> <https://www.linkedin.com/in/atwebber>
>
>   <https://www.linkedin.com/in/atwebber>
>
>   <https://www.linkedin.com/in/atwebber>
>
>
>
> <https://www.linkedin.com/in/atwebber>
>
>   <https://www.linkedin.com/in/atwebber>
>
> -- <https://www.linkedin.com/in/atwebber>
>
> Niclas Hedhman, Software Developer
> *http://zest.apache.org* - New Energy for Java
> <https://www.linkedin.com/in/atwebber>
>
>
>
> <https://www.linkedin.com/in/atwebber>
>
>   <https://www.linkedin.com/in/atwebber>
>
> -- <https://www.linkedin.com/in/atwebber>
>
> Niclas Hedhman, Software Developer
> *http://zest.apache.org* - New Energy for Java
> <https://www.linkedin.com/in/atwebber>
>



-- 
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java

RE: Metrics & Baseline Reporting to Apache

Posted by Alfred Webber <at...@wimss.com>.
Hi Niclas,

I’m not sure I wanted anyone to jump up and down as If I discovered water on Mars ☺.  This is not a new concept or idea.  I simply haven’t seen it being published and thought it would be a nice thing.

Of course, just because I haven’t seen it, doesn’t make it innovative and, of course, the technology involve is not earth shattering in the least and I never suggested as much.  In fact, I even mentioned that it may already be done.   I think that a simple message pointing me to the other efforts, if they are published, would have been a more appropriate response as that is what I suggested was a possibility in my message.

I understand the concept of ASF.  I understand that there are no “teams”.   The teams I was referencing were external teams.   I did, however, assume that there may be some gate-keeper[s] (team leads) for the ASF tools like Jira, SVN , and Jenkins and that I might need some understanding around access to these tools, Jira in particular.   I am very familiar with the tools but access to query Jira beyond the 100 record limit would require additional information.

Nicla, at times, I work on projects where teams are reluctant to use open source code.   This reluctance is, of course, largely unfounded.   Even in 2010 and beyond, I have had to fight to get tools like Jenkins, Maven, Rundeck, Nagios, Nexus, Python, etc. ‘approved’  I’m sure others know this pain.  By showing these teams that open source is ran more predictably and is usually more repeatable than many in-house projects, it would have some benefit.   The tools already in use by ASF do a wonderful job, I was simply looking for something that was more abstract/agnostic from the tools as some teams don’t use the same tools as ASF.  I wanted metrics capturing that looked at the lifecycle of the open source effort in total without respect of the tools that captured the data.   For example, something like an Elastic Search dashboard that gave a full view of the SDLC without having to go to Jira, Jenkins, SVN, etc. separately.

Sometimes in our field we can take offense when none was intended.  I think this was one of those times.  If anyone in the Apache dev community was offended by my request, please know that was not my goal.  I value your work and champion your efforts on all projects!  The entire IT community is in your debt.


Thanks a billion,


-Alfred

From: hedhman@gmail.com [mailto:hedhman@gmail.com] On Behalf Of Niclas Hedhman
Sent: Sunday, November 13, 2016 5:51 PM
To: Alfred Webber <at...@wimss.com>
Cc: dev@community.apache.org
Subject: Re: Metrics & Baseline Reporting to Apache

Forgot to use Alfred's mail address, as I suspect he is not subscribed...

On Mon, Nov 14, 2016 at 6:49 AM, Niclas Hedhman <ni...@hedhman.org>> wrote:
Alfred,
The first metric that you should learn is that there are no "teams" and no "team leads" in ASF. There are Apache projects, and they are populated by individuals, operating independently of any organizational structure.

Secondly, you are welcome to collect, collate and chart any information that you want, as many other organizations and individuals have done in the past. I don't see anything new or remarkably innovative by your effort, so I can't imagine that anyone within the ASF will jump up and down in excitement over your request.


Good Luck
Niclas


On Sat, Nov 12, 2016 at 3:09 AM, Alfred Webber <at...@wimss.com>> wrote:
Hi team,


I am a SCM/Dev OPS Architect.   I would like to offer advanced CM Metrics and analysis features to the Apache project if you have not already done it or have any plans to do so.   I would like to discuss this with team leads if possible.  I will host the metrics if necessary as a benefit to the team.

The metrics will collect, collate, and chart information for all projects.  The data will be collected from

1.      SVN

2.      Jira

3.      Jenkins

4.      Sonar

5.      Etc.

The metrics could be a boon for those teams that make use of Apache projects to see a BI approach to the efforts of the Apache team.   Of course, like other partners, it would benefit myself as well.  Having provided this kind of service to the Apache project would illustrate the acumen of myself and my team.


I eagerly await your response ☺,


-Alfred Webber
<https://www.linkedin.com/in/atwebber>
 <https://www.linkedin.com/in/atwebber>
 <https://www.linkedin.com/in/atwebber>


<https://www.linkedin.com/in/atwebber>
 <https://www.linkedin.com/in/atwebber>
-- <https://www.linkedin.com/in/atwebber>
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java<https://www.linkedin.com/in/atwebber>


<https://www.linkedin.com/in/atwebber>
 <https://www.linkedin.com/in/atwebber>
-- <https://www.linkedin.com/in/atwebber>
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java<https://www.linkedin.com/in/atwebber>

Re: Metrics & Baseline Reporting to Apache

Posted by Niclas Hedhman <ni...@hedhman.org>.
Forgot to use Alfred's mail address, as I suspect he is not subscribed...

On Mon, Nov 14, 2016 at 6:49 AM, Niclas Hedhman <ni...@hedhman.org> wrote:

> Alfred,
> The first metric that you should learn is that there are no "teams" and no
> "team leads" in ASF. There are Apache projects, and they are populated by
> individuals, operating independently of any organizational structure.
>
> Secondly, you are welcome to collect, collate and chart any information
> that you want, as many other organizations and individuals have done in the
> past. I don't see anything new or remarkably innovative by your effort, so
> I can't imagine that anyone within the ASF will jump up and down in
> excitement over your request.
>
>
> Good Luck
> Niclas
>
>
> On Sat, Nov 12, 2016 at 3:09 AM, Alfred Webber <at...@wimss.com> wrote:
>
>> Hi team,
>>
>>
>>
>>
>>
>> I am a SCM/Dev OPS Architect.   I would like to offer advanced CM Metrics
>> and analysis features to the Apache project if you have not already done it
>> or have any plans to do so.   I would like to discuss this with team leads
>> if possible.  I will host the metrics if necessary as a benefit to the team.
>>
>>
>>
>> The metrics will collect, collate, and chart information for all
>> projects.  The data will be collected from
>>
>> 1.      SVN
>>
>> 2.      Jira
>>
>> 3.      Jenkins
>>
>> 4.      Sonar
>>
>> 5.      Etc.
>>
>>
>>
>> The metrics could be a boon for those teams that make use of Apache
>> projects to see a BI approach to the efforts of the Apache team.   Of
>> course, like other partners, it would benefit myself as well.  Having
>> provided this kind of service to the Apache project would illustrate the
>> acumen of myself and my team.
>>
>>
>>
>>
>>
>> I eagerly await your response J,
>>
>>
>>
>>
>>
>> -Alfred Webber
>>
>> <https://www.linkedin.com/in/atwebber>
>>
>>
>>
>>
>>
>
>
>
> --
> Niclas Hedhman, Software Developer
> http://zest.apache.org - New Energy for Java
>



-- 
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java

Re: Metrics & Baseline Reporting to Apache

Posted by Niclas Hedhman <ni...@hedhman.org>.
Alfred,
The first metric that you should learn is that there are no "teams" and no
"team leads" in ASF. There are Apache projects, and they are populated by
individuals, operating independently of any organizational structure.

Secondly, you are welcome to collect, collate and chart any information
that you want, as many other organizations and individuals have done in the
past. I don't see anything new or remarkably innovative by your effort, so
I can't imagine that anyone within the ASF will jump up and down in
excitement over your request.


Good Luck
Niclas


On Sat, Nov 12, 2016 at 3:09 AM, Alfred Webber <at...@wimss.com> wrote:

> Hi team,
>
>
>
>
>
> I am a SCM/Dev OPS Architect.   I would like to offer advanced CM Metrics
> and analysis features to the Apache project if you have not already done it
> or have any plans to do so.   I would like to discuss this with team leads
> if possible.  I will host the metrics if necessary as a benefit to the team.
>
>
>
> The metrics will collect, collate, and chart information for all
> projects.  The data will be collected from
>
> 1.      SVN
>
> 2.      Jira
>
> 3.      Jenkins
>
> 4.      Sonar
>
> 5.      Etc.
>
>
>
> The metrics could be a boon for those teams that make use of Apache
> projects to see a BI approach to the efforts of the Apache team.   Of
> course, like other partners, it would benefit myself as well.  Having
> provided this kind of service to the Apache project would illustrate the
> acumen of myself and my team.
>
>
>
>
>
> I eagerly await your response J,
>
>
>
>
>
> -Alfred Webber
>
> <https://www.linkedin.com/in/atwebber>
>
>
>
>
>



-- 
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java