You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Griselda Cuevas <gr...@apache.org> on 2020/04/09 22:29:21 UTC

Usage metrics for Beam

Hi folks - I'm interested in knowing more about Beam's adoption through
user downloads.

Do you know what's the protocol to access Maven and check on Java
downloads?

Also - do you have any other recos on how to measure the project's adoption
evolution?

Thanks!
G

Re: Usage metrics for Beam

Posted by Pablo Estrada <pa...@google.com>.
Thanks Luke!

On Mon, Apr 20, 2020 at 4:28 PM Ismaël Mejía <ie...@gmail.com> wrote:

> It works, thanks a lot Luke!
>
> On Tue, Apr 21, 2020 at 12:54 AM Luke Cwik <lc...@google.com> wrote:
> >
> > I went to repository.apache.org, logged in and clicked central
> statistics on the side and selected the project org.apache.beam and the
> group id org.apache.beam and was able to get stats.
> >
> > On Mon, Apr 20, 2020 at 3:27 PM Ismaël Mejía <ie...@gmail.com> wrote:
> >>
> >> Does anyone know or can explain how can we check the maven central
> >> stats mentioned in this thread? I cannot find how to get access to
> >> them.
> >>
> >> On Mon, Apr 13, 2020 at 11:53 PM Austin Bennett
> >> <wh...@gmail.com> wrote:
> >> >
> >> > @Pablo,
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
> suggests for Apache projects, if you have "deployer" permissions then you
> can access -- I gather that you have sufficient permissions, and that Kenn
> was able to follow the steps within.
> >> >
> >> >  Though, I bet there are other sources of info, too -- and seems
> quite interesting datasets to figure out how to source.  It seems like
> there is at least some curiosity, so I'll continue to see what might be
> available -- currently for some things requiring permissions, I likely do
> not have access, but will then share (as would anyways), whatever turns up.
> >> >
> >> >
> >> >
> >> > On Mon, Apr 13, 2020 at 1:29 PM Pablo Estrada <pa...@google.com>
> wrote:
> >> >>
> >> >> I'm also curious about this, but I don't know where to look for the
> maven numbers. Where exactly are they? Do I need to get access to the
> repository?
> >> >> Thanks
> >> >> -P.
> >> >>
> >> >> On Thu, Apr 9, 2020, 9:27 PM Robert Bradshaw <ro...@google.com>
> wrote:
> >> >>>
> >> >>> Yes, it's hard to know what can conclusively be drawn from the raw
> totals. I do think trends and ratios (e.g. Py2 vs. Py3) will, however,
> roughly reflect underlying usage (which itself is ambiguously defined).
> >> >>>
> >> >>> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles <ke...@apache.org>
> wrote:
> >> >>>>
> >> >>>> Yea, interpreting the raw absolute number is tricky. You can
> probably manage to see certain kinds of trends if you just look at relative
> numbers.
> >> >>>>
> >> >>>> Kenn
> >> >>>>
> >> >>>> On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <
> whatwouldaustindo@gmail.com> wrote:
> >> >>>>>
> >> >>>>> @Robert Bradshaw  , you sent that pypi link [1] the other day in
> response to something else, which is what prompted me to ask Gris about
> Maven (based on that link [2], @* Kenneth Knowles  ).  I recall talking to
> someone about Maven download statistics at ApacheCon.
> >> >>>>>
> >> >>>>> Perhaps these are not the only sources; happy to explore any/all
> that others may have in mind.  Generally (personally) interested in
> understanding our ecosystem, trends, etc.
> >> >>>>>
> >> >>>>> Naturally, there is a ton open to interpretation, even if we had
> absolute raw data (down to IP/account/etc, which would also have ManyIps to
> one user, as well as many users to one IP, in the case of uses on corporate
> networks).  Getting distinct users, for instance, would be incredibly
> challenging; not sure how/whether other projects even do such things.
> >> >>>>>
> >> >>>>> [1] https://pypistats.org/packages/apache-beam
> >> >>>>> [2]
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
> >> >>>>>
> >> >>>>> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org>
> wrote:
> >> >>>>>>
> >> >>>>>> I found some info from 2010 [1] that it was available to anyone
> with deploy permission. The instructions still work.
> >> >>>>>>
> >> >>>>>> Kenn
> >> >>>>>>
> >> >>>>>> [1]
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
> >> >>>>>>
> >> >>>>>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <
> robertwb@google.com> wrote:
> >> >>>>>>>
> >> >>>>>>> For Python, there's https://pypistats.org/packages/apache-beam
> . It's unclear how accurate these are, and how many of these downloads
> represent users vs. tools (e.g. setting up environments for continuous
> testing).
> >> >>>>>>>
> >> >>>>>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org>
> wrote:
> >> >>>>>>>>
> >> >>>>>>>> Hi folks - I'm interested in knowing more about Beam's
> adoption through user downloads.
> >> >>>>>>>>
> >> >>>>>>>> Do you know what's the protocol to access Maven and check on
> Java downloads?
> >> >>>>>>>>
> >> >>>>>>>> Also - do you have any other recos on how to measure the
> project's adoption evolution?
> >> >>>>>>>>
> >> >>>>>>>> Thanks!
> >> >>>>>>>> G
>

Re: Usage metrics for Beam

Posted by Ismaël Mejía <ie...@gmail.com>.
It works, thanks a lot Luke!

On Tue, Apr 21, 2020 at 12:54 AM Luke Cwik <lc...@google.com> wrote:
>
> I went to repository.apache.org, logged in and clicked central statistics on the side and selected the project org.apache.beam and the group id org.apache.beam and was able to get stats.
>
> On Mon, Apr 20, 2020 at 3:27 PM Ismaël Mejía <ie...@gmail.com> wrote:
>>
>> Does anyone know or can explain how can we check the maven central
>> stats mentioned in this thread? I cannot find how to get access to
>> them.
>>
>> On Mon, Apr 13, 2020 at 11:53 PM Austin Bennett
>> <wh...@gmail.com> wrote:
>> >
>> > @Pablo, https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/ suggests for Apache projects, if you have "deployer" permissions then you can access -- I gather that you have sufficient permissions, and that Kenn was able to follow the steps within.
>> >
>> >  Though, I bet there are other sources of info, too -- and seems quite interesting datasets to figure out how to source.  It seems like there is at least some curiosity, so I'll continue to see what might be available -- currently for some things requiring permissions, I likely do not have access, but will then share (as would anyways), whatever turns up.
>> >
>> >
>> >
>> > On Mon, Apr 13, 2020 at 1:29 PM Pablo Estrada <pa...@google.com> wrote:
>> >>
>> >> I'm also curious about this, but I don't know where to look for the maven numbers. Where exactly are they? Do I need to get access to the repository?
>> >> Thanks
>> >> -P.
>> >>
>> >> On Thu, Apr 9, 2020, 9:27 PM Robert Bradshaw <ro...@google.com> wrote:
>> >>>
>> >>> Yes, it's hard to know what can conclusively be drawn from the raw totals. I do think trends and ratios (e.g. Py2 vs. Py3) will, however, roughly reflect underlying usage (which itself is ambiguously defined).
>> >>>
>> >>> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles <ke...@apache.org> wrote:
>> >>>>
>> >>>> Yea, interpreting the raw absolute number is tricky. You can probably manage to see certain kinds of trends if you just look at relative numbers.
>> >>>>
>> >>>> Kenn
>> >>>>
>> >>>> On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <wh...@gmail.com> wrote:
>> >>>>>
>> >>>>> @Robert Bradshaw  , you sent that pypi link [1] the other day in response to something else, which is what prompted me to ask Gris about Maven (based on that link [2], @* Kenneth Knowles  ).  I recall talking to someone about Maven download statistics at ApacheCon.
>> >>>>>
>> >>>>> Perhaps these are not the only sources; happy to explore any/all that others may have in mind.  Generally (personally) interested in understanding our ecosystem, trends, etc.
>> >>>>>
>> >>>>> Naturally, there is a ton open to interpretation, even if we had absolute raw data (down to IP/account/etc, which would also have ManyIps to one user, as well as many users to one IP, in the case of uses on corporate networks).  Getting distinct users, for instance, would be incredibly challenging; not sure how/whether other projects even do such things.
>> >>>>>
>> >>>>> [1] https://pypistats.org/packages/apache-beam
>> >>>>> [2] https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>> >>>>>
>> >>>>> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org> wrote:
>> >>>>>>
>> >>>>>> I found some info from 2010 [1] that it was available to anyone with deploy permission. The instructions still work.
>> >>>>>>
>> >>>>>> Kenn
>> >>>>>>
>> >>>>>> [1] https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>> >>>>>>
>> >>>>>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com> wrote:
>> >>>>>>>
>> >>>>>>> For Python, there's https://pypistats.org/packages/apache-beam . It's unclear how accurate these are, and how many of these downloads represent users vs. tools (e.g. setting up environments for continuous testing).
>> >>>>>>>
>> >>>>>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org> wrote:
>> >>>>>>>>
>> >>>>>>>> Hi folks - I'm interested in knowing more about Beam's adoption through user downloads.
>> >>>>>>>>
>> >>>>>>>> Do you know what's the protocol to access Maven and check on Java downloads?
>> >>>>>>>>
>> >>>>>>>> Also - do you have any other recos on how to measure the project's adoption evolution?
>> >>>>>>>>
>> >>>>>>>> Thanks!
>> >>>>>>>> G

Re: Usage metrics for Beam

Posted by Luke Cwik <lc...@google.com>.
I went to repository.apache.org, logged in and clicked central statistics
on the side and selected the project org.apache.beam and the group id
org.apache.beam and was able to get stats.

On Mon, Apr 20, 2020 at 3:27 PM Ismaël Mejía <ie...@gmail.com> wrote:

> Does anyone know or can explain how can we check the maven central
> stats mentioned in this thread? I cannot find how to get access to
> them.
>
> On Mon, Apr 13, 2020 at 11:53 PM Austin Bennett
> <wh...@gmail.com> wrote:
> >
> > @Pablo,
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
> suggests for Apache projects, if you have "deployer" permissions then you
> can access -- I gather that you have sufficient permissions, and that Kenn
> was able to follow the steps within.
> >
> >  Though, I bet there are other sources of info, too -- and seems quite
> interesting datasets to figure out how to source.  It seems like there is
> at least some curiosity, so I'll continue to see what might be available --
> currently for some things requiring permissions, I likely do not have
> access, but will then share (as would anyways), whatever turns up.
> >
> >
> >
> > On Mon, Apr 13, 2020 at 1:29 PM Pablo Estrada <pa...@google.com>
> wrote:
> >>
> >> I'm also curious about this, but I don't know where to look for the
> maven numbers. Where exactly are they? Do I need to get access to the
> repository?
> >> Thanks
> >> -P.
> >>
> >> On Thu, Apr 9, 2020, 9:27 PM Robert Bradshaw <ro...@google.com>
> wrote:
> >>>
> >>> Yes, it's hard to know what can conclusively be drawn from the raw
> totals. I do think trends and ratios (e.g. Py2 vs. Py3) will, however,
> roughly reflect underlying usage (which itself is ambiguously defined).
> >>>
> >>> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles <ke...@apache.org>
> wrote:
> >>>>
> >>>> Yea, interpreting the raw absolute number is tricky. You can probably
> manage to see certain kinds of trends if you just look at relative numbers.
> >>>>
> >>>> Kenn
> >>>>
> >>>> On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <
> whatwouldaustindo@gmail.com> wrote:
> >>>>>
> >>>>> @Robert Bradshaw  , you sent that pypi link [1] the other day in
> response to something else, which is what prompted me to ask Gris about
> Maven (based on that link [2], @* Kenneth Knowles  ).  I recall talking to
> someone about Maven download statistics at ApacheCon.
> >>>>>
> >>>>> Perhaps these are not the only sources; happy to explore any/all
> that others may have in mind.  Generally (personally) interested in
> understanding our ecosystem, trends, etc.
> >>>>>
> >>>>> Naturally, there is a ton open to interpretation, even if we had
> absolute raw data (down to IP/account/etc, which would also have ManyIps to
> one user, as well as many users to one IP, in the case of uses on corporate
> networks).  Getting distinct users, for instance, would be incredibly
> challenging; not sure how/whether other projects even do such things.
> >>>>>
> >>>>> [1] https://pypistats.org/packages/apache-beam
> >>>>> [2]
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
> >>>>>
> >>>>> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org>
> wrote:
> >>>>>>
> >>>>>> I found some info from 2010 [1] that it was available to anyone
> with deploy permission. The instructions still work.
> >>>>>>
> >>>>>> Kenn
> >>>>>>
> >>>>>> [1]
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
> >>>>>>
> >>>>>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com>
> wrote:
> >>>>>>>
> >>>>>>> For Python, there's https://pypistats.org/packages/apache-beam .
> It's unclear how accurate these are, and how many of these downloads
> represent users vs. tools (e.g. setting up environments for continuous
> testing).
> >>>>>>>
> >>>>>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org>
> wrote:
> >>>>>>>>
> >>>>>>>> Hi folks - I'm interested in knowing more about Beam's adoption
> through user downloads.
> >>>>>>>>
> >>>>>>>> Do you know what's the protocol to access Maven and check on Java
> downloads?
> >>>>>>>>
> >>>>>>>> Also - do you have any other recos on how to measure the
> project's adoption evolution?
> >>>>>>>>
> >>>>>>>> Thanks!
> >>>>>>>> G
>

Re: Usage metrics for Beam

Posted by Ismaël Mejía <ie...@gmail.com>.
Does anyone know or can explain how can we check the maven central
stats mentioned in this thread? I cannot find how to get access to
them.

On Mon, Apr 13, 2020 at 11:53 PM Austin Bennett
<wh...@gmail.com> wrote:
>
> @Pablo, https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/ suggests for Apache projects, if you have "deployer" permissions then you can access -- I gather that you have sufficient permissions, and that Kenn was able to follow the steps within.
>
>  Though, I bet there are other sources of info, too -- and seems quite interesting datasets to figure out how to source.  It seems like there is at least some curiosity, so I'll continue to see what might be available -- currently for some things requiring permissions, I likely do not have access, but will then share (as would anyways), whatever turns up.
>
>
>
> On Mon, Apr 13, 2020 at 1:29 PM Pablo Estrada <pa...@google.com> wrote:
>>
>> I'm also curious about this, but I don't know where to look for the maven numbers. Where exactly are they? Do I need to get access to the repository?
>> Thanks
>> -P.
>>
>> On Thu, Apr 9, 2020, 9:27 PM Robert Bradshaw <ro...@google.com> wrote:
>>>
>>> Yes, it's hard to know what can conclusively be drawn from the raw totals. I do think trends and ratios (e.g. Py2 vs. Py3) will, however, roughly reflect underlying usage (which itself is ambiguously defined).
>>>
>>> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles <ke...@apache.org> wrote:
>>>>
>>>> Yea, interpreting the raw absolute number is tricky. You can probably manage to see certain kinds of trends if you just look at relative numbers.
>>>>
>>>> Kenn
>>>>
>>>> On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <wh...@gmail.com> wrote:
>>>>>
>>>>> @Robert Bradshaw  , you sent that pypi link [1] the other day in response to something else, which is what prompted me to ask Gris about Maven (based on that link [2], @* Kenneth Knowles  ).  I recall talking to someone about Maven download statistics at ApacheCon.
>>>>>
>>>>> Perhaps these are not the only sources; happy to explore any/all that others may have in mind.  Generally (personally) interested in understanding our ecosystem, trends, etc.
>>>>>
>>>>> Naturally, there is a ton open to interpretation, even if we had absolute raw data (down to IP/account/etc, which would also have ManyIps to one user, as well as many users to one IP, in the case of uses on corporate networks).  Getting distinct users, for instance, would be incredibly challenging; not sure how/whether other projects even do such things.
>>>>>
>>>>> [1] https://pypistats.org/packages/apache-beam
>>>>> [2] https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>>>>
>>>>> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org> wrote:
>>>>>>
>>>>>> I found some info from 2010 [1] that it was available to anyone with deploy permission. The instructions still work.
>>>>>>
>>>>>> Kenn
>>>>>>
>>>>>> [1] https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>>>>>
>>>>>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com> wrote:
>>>>>>>
>>>>>>> For Python, there's https://pypistats.org/packages/apache-beam . It's unclear how accurate these are, and how many of these downloads represent users vs. tools (e.g. setting up environments for continuous testing).
>>>>>>>
>>>>>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org> wrote:
>>>>>>>>
>>>>>>>> Hi folks - I'm interested in knowing more about Beam's adoption through user downloads.
>>>>>>>>
>>>>>>>> Do you know what's the protocol to access Maven and check on Java downloads?
>>>>>>>>
>>>>>>>> Also - do you have any other recos on how to measure the project's adoption evolution?
>>>>>>>>
>>>>>>>> Thanks!
>>>>>>>> G

Re: Usage metrics for Beam

Posted by Austin Bennett <wh...@gmail.com>.
@Pablo,
https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
suggests for Apache projects, if you have "deployer" permissions then you
can access -- I gather that you have sufficient permissions, and that Kenn
was able to follow the steps within.

 Though, I bet there are other sources of info, too -- and seems quite
interesting datasets to figure out how to source.  It seems like there is
at least some curiosity, so I'll continue to see what might be available --
currently for some things requiring permissions, I likely do not have
access, but will then share (as would anyways), whatever turns up.



On Mon, Apr 13, 2020 at 1:29 PM Pablo Estrada <pa...@google.com> wrote:

> I'm also curious about this, but I don't know where to look for the maven
> numbers. Where exactly are they? Do I need to get access to the repository?
> Thanks
> -P.
>
> On Thu, Apr 9, 2020, 9:27 PM Robert Bradshaw <ro...@google.com> wrote:
>
>> Yes, it's hard to know what can conclusively be drawn from the raw
>> totals. I do think trends and ratios (e.g. Py2 vs. Py3) will, however,
>> roughly reflect underlying usage (which itself is ambiguously defined).
>>
>> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles <ke...@apache.org> wrote:
>>
>>> Yea, interpreting the raw absolute number is tricky. You can probably
>>> manage to see certain kinds of trends if you just look at relative numbers.
>>>
>>> Kenn
>>>
>>> On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <
>>> whatwouldaustindo@gmail.com> wrote:
>>>
>>>> @Robert Bradshaw <ro...@google.com>  , you sent that pypi link [1]
>>>> the other day in response to something else, which is what prompted me to
>>>> ask Gris about Maven (based on that link [2], @* Kenneth Knowles
>>>> <ke...@apache.org>  ).  I recall talking to someone about Maven
>>>> download statistics at ApacheCon.
>>>>
>>>> Perhaps these are not the only sources; happy to explore any/all that
>>>> others may have in mind.  Generally (personally) interested in
>>>> understanding our ecosystem, trends, etc.
>>>>
>>>> Naturally, there is a ton open to interpretation, even if we had
>>>> absolute raw data (down to IP/account/etc, which would also have ManyIps to
>>>> one user, as well as many users to one IP, in the case of uses on corporate
>>>> networks).  Getting distinct users, for instance, would be incredibly
>>>> challenging; not sure how/whether other projects even do such things.
>>>>
>>>> [1] https://pypistats.org/packages/apache-beam
>>>> [2]
>>>> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>>>
>>>> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org> wrote:
>>>>
>>>>> I found some info from 2010 [1] that it was available to anyone with
>>>>> deploy permission. The instructions still work.
>>>>>
>>>>> Kenn
>>>>>
>>>>> [1]
>>>>> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>>>>
>>>>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com>
>>>>> wrote:
>>>>>
>>>>>> For Python, there's https://pypistats.org/packages/apache-beam .
>>>>>> It's unclear how accurate these are, and how many of these downloads
>>>>>> represent users vs. tools (e.g. setting up environments for continuous
>>>>>> testing).
>>>>>>
>>>>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi folks - I'm interested in knowing more about Beam's adoption
>>>>>>> through user downloads.
>>>>>>>
>>>>>>> Do you know what's the protocol to access Maven and check on Java
>>>>>>> downloads?
>>>>>>>
>>>>>>> Also - do you have any other recos on how to measure the project's
>>>>>>> adoption evolution?
>>>>>>>
>>>>>>> Thanks!
>>>>>>> G
>>>>>>>
>>>>>>

Re: Usage metrics for Beam

Posted by Pablo Estrada <pa...@google.com>.
I'm also curious about this, but I don't know where to look for the maven
numbers. Where exactly are they? Do I need to get access to the repository?
Thanks
-P.

On Thu, Apr 9, 2020, 9:27 PM Robert Bradshaw <ro...@google.com> wrote:

> Yes, it's hard to know what can conclusively be drawn from the raw totals.
> I do think trends and ratios (e.g. Py2 vs. Py3) will, however,
> roughly reflect underlying usage (which itself is ambiguously defined).
>
> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles <ke...@apache.org> wrote:
>
>> Yea, interpreting the raw absolute number is tricky. You can probably
>> manage to see certain kinds of trends if you just look at relative numbers.
>>
>> Kenn
>>
>> On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <
>> whatwouldaustindo@gmail.com> wrote:
>>
>>> @Robert Bradshaw <ro...@google.com>  , you sent that pypi link [1]
>>> the other day in response to something else, which is what prompted me to
>>> ask Gris about Maven (based on that link [2], @* Kenneth Knowles
>>> <ke...@apache.org>  ).  I recall talking to someone about Maven download
>>> statistics at ApacheCon.
>>>
>>> Perhaps these are not the only sources; happy to explore any/all that
>>> others may have in mind.  Generally (personally) interested in
>>> understanding our ecosystem, trends, etc.
>>>
>>> Naturally, there is a ton open to interpretation, even if we had
>>> absolute raw data (down to IP/account/etc, which would also have ManyIps to
>>> one user, as well as many users to one IP, in the case of uses on corporate
>>> networks).  Getting distinct users, for instance, would be incredibly
>>> challenging; not sure how/whether other projects even do such things.
>>>
>>> [1] https://pypistats.org/packages/apache-beam
>>> [2]
>>> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>>
>>> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org> wrote:
>>>
>>>> I found some info from 2010 [1] that it was available to anyone with
>>>> deploy permission. The instructions still work.
>>>>
>>>> Kenn
>>>>
>>>> [1]
>>>> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>>>
>>>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com>
>>>> wrote:
>>>>
>>>>> For Python, there's https://pypistats.org/packages/apache-beam . It's
>>>>> unclear how accurate these are, and how many of these downloads represent
>>>>> users vs. tools (e.g. setting up environments for continuous testing).
>>>>>
>>>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org>
>>>>> wrote:
>>>>>
>>>>>> Hi folks - I'm interested in knowing more about Beam's adoption
>>>>>> through user downloads.
>>>>>>
>>>>>> Do you know what's the protocol to access Maven and check on Java
>>>>>> downloads?
>>>>>>
>>>>>> Also - do you have any other recos on how to measure the project's
>>>>>> adoption evolution?
>>>>>>
>>>>>> Thanks!
>>>>>> G
>>>>>>
>>>>>

Re: Usage metrics for Beam

Posted by Robert Bradshaw <ro...@google.com>.
Yes, it's hard to know what can conclusively be drawn from the raw totals.
I do think trends and ratios (e.g. Py2 vs. Py3) will, however,
roughly reflect underlying usage (which itself is ambiguously defined).

On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles <ke...@apache.org> wrote:

> Yea, interpreting the raw absolute number is tricky. You can probably
> manage to see certain kinds of trends if you just look at relative numbers.
>
> Kenn
>
> On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <wh...@gmail.com>
> wrote:
>
>> @Robert Bradshaw <ro...@google.com>  , you sent that pypi link [1]
>> the other day in response to something else, which is what prompted me to
>> ask Gris about Maven (based on that link [2], @* Kenneth Knowles
>> <ke...@apache.org>  ).  I recall talking to someone about Maven download
>> statistics at ApacheCon.
>>
>> Perhaps these are not the only sources; happy to explore any/all that
>> others may have in mind.  Generally (personally) interested in
>> understanding our ecosystem, trends, etc.
>>
>> Naturally, there is a ton open to interpretation, even if we had absolute
>> raw data (down to IP/account/etc, which would also have ManyIps to one
>> user, as well as many users to one IP, in the case of uses on corporate
>> networks).  Getting distinct users, for instance, would be incredibly
>> challenging; not sure how/whether other projects even do such things.
>>
>> [1] https://pypistats.org/packages/apache-beam
>> [2]
>> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>
>> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org> wrote:
>>
>>> I found some info from 2010 [1] that it was available to anyone with
>>> deploy permission. The instructions still work.
>>>
>>> Kenn
>>>
>>> [1]
>>> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>>
>>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com>
>>> wrote:
>>>
>>>> For Python, there's https://pypistats.org/packages/apache-beam . It's
>>>> unclear how accurate these are, and how many of these downloads represent
>>>> users vs. tools (e.g. setting up environments for continuous testing).
>>>>
>>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org> wrote:
>>>>
>>>>> Hi folks - I'm interested in knowing more about Beam's adoption
>>>>> through user downloads.
>>>>>
>>>>> Do you know what's the protocol to access Maven and check on Java
>>>>> downloads?
>>>>>
>>>>> Also - do you have any other recos on how to measure the project's
>>>>> adoption evolution?
>>>>>
>>>>> Thanks!
>>>>> G
>>>>>
>>>>

Re: Usage metrics for Beam

Posted by Kenneth Knowles <ke...@apache.org>.
Yea, interpreting the raw absolute number is tricky. You can probably
manage to see certain kinds of trends if you just look at relative numbers.

Kenn

On Thu, Apr 9, 2020 at 6:42 PM Austin Bennett <wh...@gmail.com>
wrote:

> @Robert Bradshaw <ro...@google.com>  , you sent that pypi link [1] the
> other day in response to something else, which is what prompted me to ask
> Gris about Maven (based on that link [2], @* Kenneth Knowles
> <ke...@apache.org>  ).  I recall talking to someone about Maven download
> statistics at ApacheCon.
>
> Perhaps these are not the only sources; happy to explore any/all that
> others may have in mind.  Generally (personally) interested in
> understanding our ecosystem, trends, etc.
>
> Naturally, there is a ton open to interpretation, even if we had absolute
> raw data (down to IP/account/etc, which would also have ManyIps to one
> user, as well as many users to one IP, in the case of uses on corporate
> networks).  Getting distinct users, for instance, would be incredibly
> challenging; not sure how/whether other projects even do such things.
>
> [1] https://pypistats.org/packages/apache-beam
> [2]
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>
> On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org> wrote:
>
>> I found some info from 2010 [1] that it was available to anyone with
>> deploy permission. The instructions still work.
>>
>> Kenn
>>
>> [1]
>> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>>
>> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com>
>> wrote:
>>
>>> For Python, there's https://pypistats.org/packages/apache-beam . It's
>>> unclear how accurate these are, and how many of these downloads represent
>>> users vs. tools (e.g. setting up environments for continuous testing).
>>>
>>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org> wrote:
>>>
>>>> Hi folks - I'm interested in knowing more about Beam's adoption through
>>>> user downloads.
>>>>
>>>> Do you know what's the protocol to access Maven and check on Java
>>>> downloads?
>>>>
>>>> Also - do you have any other recos on how to measure the project's
>>>> adoption evolution?
>>>>
>>>> Thanks!
>>>> G
>>>>
>>>

Re: Usage metrics for Beam

Posted by Austin Bennett <wh...@gmail.com>.
@Robert Bradshaw <ro...@google.com>  , you sent that pypi link [1] the
other day in response to something else, which is what prompted me to ask
Gris about Maven (based on that link [2], @* Kenneth Knowles
<ke...@apache.org>  ).  I recall talking to someone about Maven download
statistics at ApacheCon.

Perhaps these are not the only sources; happy to explore any/all that
others may have in mind.  Generally (personally) interested in
understanding our ecosystem, trends, etc.

Naturally, there is a ton open to interpretation, even if we had absolute
raw data (down to IP/account/etc, which would also have ManyIps to one
user, as well as many users to one IP, in the case of uses on corporate
networks).  Getting distinct users, for instance, would be incredibly
challenging; not sure how/whether other projects even do such things.

[1] https://pypistats.org/packages/apache-beam
[2]
https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/

On Thu, Apr 9, 2020 at 4:02 PM Kenneth Knowles <ke...@apache.org> wrote:

> I found some info from 2010 [1] that it was available to anyone with
> deploy permission. The instructions still work.
>
> Kenn
>
> [1]
> https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/
>
> On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com>
> wrote:
>
>> For Python, there's https://pypistats.org/packages/apache-beam . It's
>> unclear how accurate these are, and how many of these downloads represent
>> users vs. tools (e.g. setting up environments for continuous testing).
>>
>> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org> wrote:
>>
>>> Hi folks - I'm interested in knowing more about Beam's adoption through
>>> user downloads.
>>>
>>> Do you know what's the protocol to access Maven and check on Java
>>> downloads?
>>>
>>> Also - do you have any other recos on how to measure the project's
>>> adoption evolution?
>>>
>>> Thanks!
>>> G
>>>
>>

Re: Usage metrics for Beam

Posted by Kenneth Knowles <ke...@apache.org>.
I found some info from 2010 [1] that it was available to anyone with deploy
permission. The instructions still work.

Kenn

[1]
https://blog.sonatype.com/2010/12/now-available-central-download-statistics-for-oss-projects/

On Thu, Apr 9, 2020 at 3:41 PM Robert Bradshaw <ro...@google.com> wrote:

> For Python, there's https://pypistats.org/packages/apache-beam . It's
> unclear how accurate these are, and how many of these downloads represent
> users vs. tools (e.g. setting up environments for continuous testing).
>
> On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org> wrote:
>
>> Hi folks - I'm interested in knowing more about Beam's adoption through
>> user downloads.
>>
>> Do you know what's the protocol to access Maven and check on Java
>> downloads?
>>
>> Also - do you have any other recos on how to measure the project's
>> adoption evolution?
>>
>> Thanks!
>> G
>>
>

Re: Usage metrics for Beam

Posted by Robert Bradshaw <ro...@google.com>.
For Python, there's https://pypistats.org/packages/apache-beam . It's
unclear how accurate these are, and how many of these downloads represent
users vs. tools (e.g. setting up environments for continuous testing).

On Thu, Apr 9, 2020 at 3:29 PM Griselda Cuevas <gr...@apache.org> wrote:

> Hi folks - I'm interested in knowing more about Beam's adoption through
> user downloads.
>
> Do you know what's the protocol to access Maven and check on Java
> downloads?
>
> Also - do you have any other recos on how to measure the project's
> adoption evolution?
>
> Thanks!
> G
>