You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Surendranauth Hiraman <su...@velos.io> on 2014/05/28 00:01:20 UTC
Clearspring Analytics Version
Hi,
It looks like the version of Clearspring's stream analytics class in 1.0
branch and master is 2.5
There were some significant bug fixes in 2.6 and version 2.7 is just out
now as well.
Are there any plans to upgrade?
The QDigest deserialization code in 2.5 seems to have bugs that are fixed
in 2.6 and higher.
<dependency>
<groupId>com.clearspring.analytics</groupId>
<artifactId>stream</artifactId>
<version>2.5.1</version>-
</dependency>
SUREN HIRAMAN, VP TECHNOLOGY
Velos
Accelerating Machine Learning
440 NINTH AVENUE, 11TH FLOOR
NEW YORK, NY 10001
O: (917) 525-2466 ext. 105
F: 646.349.4063
E: suren.hiraman@v <su...@sociocast.com>elos.io
W: www.velos.io
Re: Clearspring Analytics Version
Posted by Reynold Xin <rx...@databricks.com>.
Posted a question on streamlib user group about API compatibility:
https://groups.google.com/forum/#!topic/stream-lib-user/4VDeKcPiTJU
On Tue, May 27, 2014 at 3:36 PM, Surendranauth Hiraman <
suren.hiraman@velos.io> wrote:
> Reynold,
>
> My environment is not quite set up to build Spark core properly and I'm
> having various dependency issues running sbt/sbt assembly.
>
> Any change you could go ahead and submit a pull request for this if it's
> easy for you? :-)
>
> -Suren
>
>
>
> On Tue, May 27, 2014 at 6:13 PM, Reynold Xin <rx...@databricks.com> wrote:
>
> > 2.7 sounds good. I was actually waiting for 2.7 to come out to post a
> JIRA
> > (mainly for the serializable HyperLogLogPlus class).
> >
> >
> > On Tue, May 27, 2014 at 3:11 PM, Surendranauth Hiraman <
> > suren.hiraman@velos.io> wrote:
> >
> > > Great, I will submit the pull request.
> > >
> > > Any objection to version 2.7?
> > >
> > > -Suren
> > >
> > >
> > >
> > > On Tue, May 27, 2014 at 6:02 PM, Reynold Xin <rx...@databricks.com>
> > wrote:
> > >
> > > > Would you like to submit a pull request to update it?
> > > >
> > > > Also in the latest version HyperLogLog is serializable. That means we
> > can
> > > > get rid of the SerializableHyperLogLog class. (and move to use
> > > > HyperLogLogPlus).
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Tue, May 27, 2014 at 3:01 PM, Surendranauth Hiraman <
> > > > suren.hiraman@velos.io> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > It looks like the version of Clearspring's stream analytics class
> in
> > > 1.0
> > > > > branch and master is 2.5
> > > > >
> > > > > There were some significant bug fixes in 2.6 and version 2.7 is
> just
> > > out
> > > > > now as well.
> > > > >
> > > > > Are there any plans to upgrade?
> > > > >
> > > > > The QDigest deserialization code in 2.5 seems to have bugs that are
> > > fixed
> > > > > in 2.6 and higher.
> > > > >
> > > > >
> > > > > <dependency>
> > > > > <groupId>com.clearspring.analytics</groupId>
> > > > > <artifactId>stream</artifactId>
> > > > > <version>2.5.1</version>-
> > > > > </dependency>
> > > > >
> > > > >
> > > > >
> > > > > SUREN HIRAMAN, VP TECHNOLOGY
> > > > > Velos
> > > > > Accelerating Machine Learning
> > > > >
> > > > > 440 NINTH AVENUE, 11TH FLOOR
> > > > > NEW YORK, NY 10001
> > > > > O: (917) 525-2466 ext. 105
> > > > > F: 646.349.4063
> > > > > E: suren.hiraman@v <su...@sociocast.com>elos.io
> > > > > W: www.velos.io
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > >
> > > SUREN HIRAMAN, VP TECHNOLOGY
> > > Velos
> > > Accelerating Machine Learning
> > >
> > > 440 NINTH AVENUE, 11TH FLOOR
> > > NEW YORK, NY 10001
> > > O: (917) 525-2466 ext. 105
> > > F: 646.349.4063
> > > E: suren.hiraman@v <su...@sociocast.com>elos.io
> > > W: www.velos.io
> > >
> >
>
>
>
> --
>
> SUREN HIRAMAN, VP TECHNOLOGY
> Velos
> Accelerating Machine Learning
>
> 440 NINTH AVENUE, 11TH FLOOR
> NEW YORK, NY 10001
> O: (917) 525-2466 ext. 105
> F: 646.349.4063
> E: suren.hiraman@v <su...@sociocast.com>elos.io
> W: www.velos.io
>
Re: Clearspring Analytics Version
Posted by Surendranauth Hiraman <su...@velos.io>.
Reynold,
My environment is not quite set up to build Spark core properly and I'm
having various dependency issues running sbt/sbt assembly.
Any change you could go ahead and submit a pull request for this if it's
easy for you? :-)
-Suren
On Tue, May 27, 2014 at 6:13 PM, Reynold Xin <rx...@databricks.com> wrote:
> 2.7 sounds good. I was actually waiting for 2.7 to come out to post a JIRA
> (mainly for the serializable HyperLogLogPlus class).
>
>
> On Tue, May 27, 2014 at 3:11 PM, Surendranauth Hiraman <
> suren.hiraman@velos.io> wrote:
>
> > Great, I will submit the pull request.
> >
> > Any objection to version 2.7?
> >
> > -Suren
> >
> >
> >
> > On Tue, May 27, 2014 at 6:02 PM, Reynold Xin <rx...@databricks.com>
> wrote:
> >
> > > Would you like to submit a pull request to update it?
> > >
> > > Also in the latest version HyperLogLog is serializable. That means we
> can
> > > get rid of the SerializableHyperLogLog class. (and move to use
> > > HyperLogLogPlus).
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Tue, May 27, 2014 at 3:01 PM, Surendranauth Hiraman <
> > > suren.hiraman@velos.io> wrote:
> > >
> > > > Hi,
> > > >
> > > > It looks like the version of Clearspring's stream analytics class in
> > 1.0
> > > > branch and master is 2.5
> > > >
> > > > There were some significant bug fixes in 2.6 and version 2.7 is just
> > out
> > > > now as well.
> > > >
> > > > Are there any plans to upgrade?
> > > >
> > > > The QDigest deserialization code in 2.5 seems to have bugs that are
> > fixed
> > > > in 2.6 and higher.
> > > >
> > > >
> > > > <dependency>
> > > > <groupId>com.clearspring.analytics</groupId>
> > > > <artifactId>stream</artifactId>
> > > > <version>2.5.1</version>-
> > > > </dependency>
> > > >
> > > >
> > > >
> > > > SUREN HIRAMAN, VP TECHNOLOGY
> > > > Velos
> > > > Accelerating Machine Learning
> > > >
> > > > 440 NINTH AVENUE, 11TH FLOOR
> > > > NEW YORK, NY 10001
> > > > O: (917) 525-2466 ext. 105
> > > > F: 646.349.4063
> > > > E: suren.hiraman@v <su...@sociocast.com>elos.io
> > > > W: www.velos.io
> > > >
> > >
> >
> >
> >
> > --
> >
> > SUREN HIRAMAN, VP TECHNOLOGY
> > Velos
> > Accelerating Machine Learning
> >
> > 440 NINTH AVENUE, 11TH FLOOR
> > NEW YORK, NY 10001
> > O: (917) 525-2466 ext. 105
> > F: 646.349.4063
> > E: suren.hiraman@v <su...@sociocast.com>elos.io
> > W: www.velos.io
> >
>
--
SUREN HIRAMAN, VP TECHNOLOGY
Velos
Accelerating Machine Learning
440 NINTH AVENUE, 11TH FLOOR
NEW YORK, NY 10001
O: (917) 525-2466 ext. 105
F: 646.349.4063
E: suren.hiraman@v <su...@sociocast.com>elos.io
W: www.velos.io
Re: Clearspring Analytics Version
Posted by Reynold Xin <rx...@databricks.com>.
2.7 sounds good. I was actually waiting for 2.7 to come out to post a JIRA
(mainly for the serializable HyperLogLogPlus class).
On Tue, May 27, 2014 at 3:11 PM, Surendranauth Hiraman <
suren.hiraman@velos.io> wrote:
> Great, I will submit the pull request.
>
> Any objection to version 2.7?
>
> -Suren
>
>
>
> On Tue, May 27, 2014 at 6:02 PM, Reynold Xin <rx...@databricks.com> wrote:
>
> > Would you like to submit a pull request to update it?
> >
> > Also in the latest version HyperLogLog is serializable. That means we can
> > get rid of the SerializableHyperLogLog class. (and move to use
> > HyperLogLogPlus).
> >
> >
> >
> >
> >
> >
> > On Tue, May 27, 2014 at 3:01 PM, Surendranauth Hiraman <
> > suren.hiraman@velos.io> wrote:
> >
> > > Hi,
> > >
> > > It looks like the version of Clearspring's stream analytics class in
> 1.0
> > > branch and master is 2.5
> > >
> > > There were some significant bug fixes in 2.6 and version 2.7 is just
> out
> > > now as well.
> > >
> > > Are there any plans to upgrade?
> > >
> > > The QDigest deserialization code in 2.5 seems to have bugs that are
> fixed
> > > in 2.6 and higher.
> > >
> > >
> > > <dependency>
> > > <groupId>com.clearspring.analytics</groupId>
> > > <artifactId>stream</artifactId>
> > > <version>2.5.1</version>-
> > > </dependency>
> > >
> > >
> > >
> > > SUREN HIRAMAN, VP TECHNOLOGY
> > > Velos
> > > Accelerating Machine Learning
> > >
> > > 440 NINTH AVENUE, 11TH FLOOR
> > > NEW YORK, NY 10001
> > > O: (917) 525-2466 ext. 105
> > > F: 646.349.4063
> > > E: suren.hiraman@v <su...@sociocast.com>elos.io
> > > W: www.velos.io
> > >
> >
>
>
>
> --
>
> SUREN HIRAMAN, VP TECHNOLOGY
> Velos
> Accelerating Machine Learning
>
> 440 NINTH AVENUE, 11TH FLOOR
> NEW YORK, NY 10001
> O: (917) 525-2466 ext. 105
> F: 646.349.4063
> E: suren.hiraman@v <su...@sociocast.com>elos.io
> W: www.velos.io
>
Re: Clearspring Analytics Version
Posted by Surendranauth Hiraman <su...@velos.io>.
Great, I will submit the pull request.
Any objection to version 2.7?
-Suren
On Tue, May 27, 2014 at 6:02 PM, Reynold Xin <rx...@databricks.com> wrote:
> Would you like to submit a pull request to update it?
>
> Also in the latest version HyperLogLog is serializable. That means we can
> get rid of the SerializableHyperLogLog class. (and move to use
> HyperLogLogPlus).
>
>
>
>
>
>
> On Tue, May 27, 2014 at 3:01 PM, Surendranauth Hiraman <
> suren.hiraman@velos.io> wrote:
>
> > Hi,
> >
> > It looks like the version of Clearspring's stream analytics class in 1.0
> > branch and master is 2.5
> >
> > There were some significant bug fixes in 2.6 and version 2.7 is just out
> > now as well.
> >
> > Are there any plans to upgrade?
> >
> > The QDigest deserialization code in 2.5 seems to have bugs that are fixed
> > in 2.6 and higher.
> >
> >
> > <dependency>
> > <groupId>com.clearspring.analytics</groupId>
> > <artifactId>stream</artifactId>
> > <version>2.5.1</version>-
> > </dependency>
> >
> >
> >
> > SUREN HIRAMAN, VP TECHNOLOGY
> > Velos
> > Accelerating Machine Learning
> >
> > 440 NINTH AVENUE, 11TH FLOOR
> > NEW YORK, NY 10001
> > O: (917) 525-2466 ext. 105
> > F: 646.349.4063
> > E: suren.hiraman@v <su...@sociocast.com>elos.io
> > W: www.velos.io
> >
>
--
SUREN HIRAMAN, VP TECHNOLOGY
Velos
Accelerating Machine Learning
440 NINTH AVENUE, 11TH FLOOR
NEW YORK, NY 10001
O: (917) 525-2466 ext. 105
F: 646.349.4063
E: suren.hiraman@v <su...@sociocast.com>elos.io
W: www.velos.io
Re: Clearspring Analytics Version
Posted by Reynold Xin <rx...@databricks.com>.
Would you like to submit a pull request to update it?
Also in the latest version HyperLogLog is serializable. That means we can
get rid of the SerializableHyperLogLog class. (and move to use
HyperLogLogPlus).
On Tue, May 27, 2014 at 3:01 PM, Surendranauth Hiraman <
suren.hiraman@velos.io> wrote:
> Hi,
>
> It looks like the version of Clearspring's stream analytics class in 1.0
> branch and master is 2.5
>
> There were some significant bug fixes in 2.6 and version 2.7 is just out
> now as well.
>
> Are there any plans to upgrade?
>
> The QDigest deserialization code in 2.5 seems to have bugs that are fixed
> in 2.6 and higher.
>
>
> <dependency>
> <groupId>com.clearspring.analytics</groupId>
> <artifactId>stream</artifactId>
> <version>2.5.1</version>-
> </dependency>
>
>
>
> SUREN HIRAMAN, VP TECHNOLOGY
> Velos
> Accelerating Machine Learning
>
> 440 NINTH AVENUE, 11TH FLOOR
> NEW YORK, NY 10001
> O: (917) 525-2466 ext. 105
> F: 646.349.4063
> E: suren.hiraman@v <su...@sociocast.com>elos.io
> W: www.velos.io
>