Collections again

[Benson Margulies <bi...@gmail.com>]

I have misplaced Dawid's thread.

There's an interesting thing about our current situation. I forgot to
rationalize the package names on the collections when I last worked on
them. So they are all .math.

This could be viewed as an opportunity. If HPPC or fastwhatever is a
superior device, we could *add* it under org.apache.mahout.coll,
leaving the colt stuff under math. Then we, over the long term,
improve the naming, and avoid and abrupt incompatibility.

Can someone suggest a way to get from Dawid's ascii graphics to a plan?

Re: Collections again

[Dawid Weiss <da...@cs.put.poznan.pl>]

>
>
> depend on it and deprecate the Colt-derived collections lib. That
> seems like a fine plan for me. Who needs to be maintaining 'yet
> another collections lib'?
>

I'd say it really make little sense. We will probably keep HPPC because we
have it tightly integrated in our commercial software, but now that fastutil
is ASL-ed I think it becomes very attractive as the primary choice for
primitive collections.


> You know, I assumed (apropos of nothing) that your name was Arabic,
> but now I see your email domain ...
>

Arabic? Nah... I was born, raised and live in Poland. But then, we've been
invaded by so many countries over the centuries that what flows in my veins
is probably a little bit of everything, so you weren't so far off :)

D.

Re: Collections again

[Benson Margulies <bi...@gmail.com>]

Dawid,

It's not that can't read it, it's that I don't know what to do about
it. Due to my slight snow-blindness, it hadn't occurred to me to just
depend on it and deprecate the Colt-derived collections lib. That
seems like a fine plan for me. Who needs to be maintaining 'yet
another collections lib'?

You know, I assumed (apropos of nothing) that your name was Arabic,
but now I see your email domain ...

--benson


On Mon, Mar 7, 2011 at 8:01 AM, Dawid Weiss
<da...@cs.put.poznan.pl> wrote:
>> This could be viewed as an opportunity. If HPPC or fastwhatever is a
>> superior device, we could *add* it under org.apache.mahout.coll,
>> leaving the colt stuff under math. Then we, over the long term,
>> improve the naming, and avoid and abrupt incompatibility.
>>
>
> You could. Or you could add a maven dependency on fastutil (it is in maven
> central now) and just drop the development of independent collections
> package... Don't know which will appeal to the community more. We have been
> exchanging ideas with Sebastiano recently and after you get the same fast
> algorithms in place the difference in implementations don't seem to account
> for that much. I assume HPPC vs. fastutil will be a matter of taste more
> than speed in the near future (HPPC has open internals and a different
> architecture for containers/ iterators compared to the familiar j.u.c.).
>
>
>> Can someone suggest a way to get from Dawid's ascii graphics to a plan?
>>
>
> Copy-paste to an editor with fixed-width font? :) You can also click on
> those links I've sent, they should take you to an on-line Caliber benchmark
> page. Or run the benchmarks yourself. Sebastiano has made some speed
> improvements driven by this collaboration and fastutil maps are faster than
> when I compared them.
>
> Dawid
>

Re: Collections again

[Dawid Weiss <da...@cs.put.poznan.pl>]

> This could be viewed as an opportunity. If HPPC or fastwhatever is a
> superior device, we could *add* it under org.apache.mahout.coll,
> leaving the colt stuff under math. Then we, over the long term,
> improve the naming, and avoid and abrupt incompatibility.
>

You could. Or you could add a maven dependency on fastutil (it is in maven
central now) and just drop the development of independent collections
package... Don't know which will appeal to the community more. We have been
exchanging ideas with Sebastiano recently and after you get the same fast
algorithms in place the difference in implementations don't seem to account
for that much. I assume HPPC vs. fastutil will be a matter of taste more
than speed in the near future (HPPC has open internals and a different
architecture for containers/ iterators compared to the familiar j.u.c.).


> Can someone suggest a way to get from Dawid's ascii graphics to a plan?
>

Copy-paste to an editor with fixed-width font? :) You can also click on
those links I've sent, they should take you to an on-line Caliber benchmark
page. Or run the benchmarks yourself. Sebastiano has made some speed
improvements driven by this collaboration and fastutil maps are faster than
when I compared them.

Dawid