Re: publishing data

[Reza <re...@yahoo.com.INVALID>]

So right now nothing planned for release that uses the test-data artifact. Also, this isn't a research project, this is a device classification project and people expect to get a product which runs accurately. So I don't see a need for users to want the test data. Test data should be maintained and used by the project internally to validate the clients are accurate.

The java client maintains its own test data with expected results here:

http://svn.apache.org/viewvc/incubator/devicemap/trunk/devicemap/java/classifier/src/test/resources/


Its better to keep that local to the client because trying to get multiple clients to pass a standard set of tests is treacherous. It leads to things like percentage accuracy across a fixed set, overfitting, over optimization, etc. Therefor its logical to keep the test data local to the client and strive for consistent and accurate results, release after release.


________________________________
 From: Werner Keil <we...@gmail.com>
To: "devicemap-dev@incubator.apache.org" <de...@incubator.apache.org>; Reza <re...@yahoo.com> 
Sent: Friday, July 25, 2014 2:12 PM
Subject: Re: Reza, you can tally the incubator PMC vote now
 


Not sure, how other projects do that, but the Apache Parent POM used by also the Data projects include such plugins.
I figured, while Test-Data was not officially released, since it serves mainly unit tests, its version may be quite different from "live" data, so those projects that use both should have 2 different "data" version properties


On Fri, Jul 25, 2014 at 8:05 PM, Reza <re...@yahoo.com.invalid> wrote:

k, so if we can find the process for publishing to the public maven and document that in DMAP-25, that would be a good first step :)
>
>
>
>________________________________
> From: Werner Keil <we...@gmail.com>
>To: "devicemap-dev@incubator.apache.org" <de...@incubator.apache.org>; Reza <re...@yahoo.com>
>Sent: Friday, July 25, 2014 1:43 PM
>
>Subject: Re: Reza, you can tally the incubator PMC vote now
>
>
>
>Data pretty much is. I saw at least one file changed in the trunk since the 1.0.0 release. Only NOTICE, but to be precise data's trunk now also should be 1.0.1-SNAPSHOT.
>Until there is a repository where stable releases can be grabbed from, the temporary workspace availability of them in a trunk-only Maven build means, all Maven-built clients should refer only to the trunk version of the data files.
>
>If we had a stable 1.0.0 available somewhere, that could differ for different APIs or more importantly examples, too.
>
>As my keys are also in the file I plan to get a W3C Simple DDR out, that probably will not need many more versions than 1.0.0 as the underlying standard is unlikely to change, so as we saw W3C missed putting the standard itself out in a proper Maven repository, doing so with a DeviceMap implementation also makes the W3C library available at least indirectly. Not via Maven, that's not up to us, but e.g. a Web Servlet example shall contain the JAR in a lib folder and together with the DeviceMap JARs from Maven it builds without any annoying "Maven install"
>
>Werner
>
>
>________________________________
>> From: Werner Keil <we...@gmail.com>
>>To: Bertrand Delacretaz <bd...@apache.org>
>>Cc: "devicemap-dev@incubator.apache.org" <de...@incubator.apache.org>
>>Sent: Friday, July 25, 2014 1:22 PM
>>
>>Subject: Re: Reza, you can tally the incubator PMC vote now
>>
>>
>>
>>Btw., seems none of the artifacts already released as 1.0.0 are in a Maven
>>repo yet.
>>Especially not here: http://repo.maven.apache.org/maven2/org/apache/ And I
>>doubt even the Snapshot equivalent gets a deployment yet.
>>
>>For those artifacts that are officially released and approved, could they
>>go into a maven repository, too?
>>
>>Werner
>>
>>
>>On Fri, Jul 25, 2014 at 5:21 PM, Bertrand Delacretaz <bdelacretaz@apache.org
>>> wrote:
>>
>>> On Fri, Jul 25, 2014 at 3:53 PM, Reza <re...@yahoo.com.invalid>
>>> wrote:
>>> > ...moving forward the Java client will likely see less releases and
>>> activity and the data will constantly evolve. That's why
>>> > I'm thinking version in wise they will diverge greatly....
>>>
>>> IMO having (even very) different version numbers between different
>>> modules is not a problem.
>>>
>>> -Bertrand
>>>

Re: publishing data

[Werner Keil <we...@gmail.com>]

It was not officially part of the 1.0.0 tag in /releases, so we could leave
test-data. At the moment there are tests in the Simple DDR library using
them, so if it's a dependency, I could also publish those together like you
did with the "new" client.

It seems good that each component or application that needs either
data,test-data or both can chose from the version they find most
appropriate.


On Fri, Jul 25, 2014 at 8:33 PM, Reza <re...@yahoo.com.invalid>
wrote:

> So right now nothing planned for release that uses the test-data artifact.
> Also, this isn't a research project, this is a device classification
> project and people expect to get a product which runs accurately. So I
> don't see a need for users to want the test data. Test data should be
> maintained and used by the project internally to validate the clients are
> accurate.
>
> The java client maintains its own test data with expected results here:
>
>
> http://svn.apache.org/viewvc/incubator/devicemap/trunk/devicemap/java/classifier/src/test/resources/
>
> Its better to keep that local to the client because trying to get multiple
> clients to pass a standard set of tests is treacherous. It leads to things
> like percentage accuracy across a fixed set, overfitting, over
> optimization, etc. Therefor its logical to keep the test data local to the
> client and strive for consistent and accurate results, release after
> release.
>
>   ------------------------------
>  *From:* Werner Keil <we...@gmail.com>
> *To:* "devicemap-dev@incubator.apache.org" <
> devicemap-dev@incubator.apache.org>; Reza <re...@yahoo.com>
> *Sent:* Friday, July 25, 2014 2:12 PM
> *Subject:* Re: Reza, you can tally the incubator PMC vote now
>
> Not sure, how other projects do that, but the Apache Parent POM used by
> also the Data projects include such plugins.
> I figured, while Test-Data was not officially released, since it serves
> mainly unit tests, its version may be quite different from "live" data, so
> those projects that use both should have 2 different "data" version
> properties
>
> On Fri, Jul 25, 2014 at 8:05 PM, Reza <re...@yahoo.com.invalid>
> wrote:
>
> k, so if we can find the process for publishing to the public maven and
> document that in DMAP-25, that would be a good first step :)
>
>
> ________________________________
>  From: Werner Keil <we...@gmail.com>
> To: "devicemap-dev@incubator.apache.org" <
> devicemap-dev@incubator.apache.org>; Reza <re...@yahoo.com>
> Sent: Friday, July 25, 2014 1:43 PM
> Subject: Re: Reza, you can tally the incubator PMC vote now
>
>
>
> Data pretty much is. I saw at least one file changed in the trunk since
> the 1.0.0 release. Only NOTICE, but to be precise data's trunk now also
> should be 1.0.1-SNAPSHOT.
> Until there is a repository where stable releases can be grabbed from, the
> temporary workspace availability of them in a trunk-only Maven build means,
> all Maven-built clients should refer only to the trunk version of the data
> files.
>
> If we had a stable 1.0.0 available somewhere, that could differ for
> different APIs or more importantly examples, too.
>
> As my keys are also in the file I plan to get a W3C Simple DDR out, that
> probably will not need many more versions than 1.0.0 as the underlying
> standard is unlikely to change, so as we saw W3C missed putting the
> standard itself out in a proper Maven repository, doing so with a DeviceMap
> implementation also makes the W3C library available at least indirectly.
> Not via Maven, that's not up to us, but e.g. a Web Servlet example shall
> contain the JAR in a lib folder and together with the DeviceMap JARs from
> Maven it builds without any annoying "Maven install"
>
> Werner
>
>
> ________________________________
> > From: Werner Keil <we...@gmail.com>
> >To: Bertrand Delacretaz <bd...@apache.org>
> >Cc: "devicemap-dev@incubator.apache.org" <
> devicemap-dev@incubator.apache.org>
> >Sent: Friday, July 25, 2014 1:22 PM
> >
> >Subject: Re: Reza, you can tally the incubator PMC vote now
> >
> >
> >
> >Btw., seems none of the artifacts already released as 1.0.0 are in a Maven
> >repo yet.
> >Especially not here: http://repo.maven.apache.org/maven2/org/apache/ And
> I
> >doubt even the Snapshot equivalent gets a deployment yet.
> >
> >For those artifacts that are officially released and approved, could they
> >go into a maven repository, too?
> >
> >Werner
> >
> >
> >On Fri, Jul 25, 2014 at 5:21 PM, Bertrand Delacretaz <
> bdelacretaz@apache.org
> >> wrote:
> >
> >> On Fri, Jul 25, 2014 at 3:53 PM, Reza <re...@yahoo.com.invalid>
> >> wrote:
> >> > ...moving forward the Java client will likely see less releases and
> >> activity and the data will constantly evolve. That's why
> >> > I'm thinking version in wise they will diverge greatly....
> >>
> >> IMO having (even very) different version numbers between different
> >> modules is not a problem.
> >>
> >> -Bertrand
> >>
>
>
>
>
>