You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Grant Ingersoll <gs...@apache.org> on 2008/07/30 17:26:29 UTC
FYI Cloud Computing Resources
http://research.yahoo.com/node/2328
It _MAY_ (stressed, emphasized, etc.) be possible for Mahouters (or
are we just Mahouts?) to get some access to these resources. One big
question is where can we get some fairly large data sets (large, but
not super large, I think, but am not sure)
If you have ideas, etc. please let us know.
-Grant
Re: FYI Cloud Computing Resources
Posted by Josh Myer <jo...@joshisanerd.com>.
On Wed, Jul 30, 2008 at 11:26:29AM -0400, Grant Ingersoll wrote:
> http://research.yahoo.com/node/2328
>
> It _MAY_ (stressed, emphasized, etc.) be possible for Mahouters (or
> are we just Mahouts?) to get some access to these resources. One big
> question is where can we get some fairly large data sets (large, but
> not super large, I think, but am not sure)
>
> If you have ideas, etc. please let us know.
>
It's worth plugging (theinfo), http://theinfo.org/. It's a project to
collect references to datasets, and may help here. Unfortunately, it
seems to be laggy at the moment. I'll poke Aaron about that =)
HtH,
--
Josh Myer
josh@joshisanerd.com
Re: FYI Cloud Computing Resources
Posted by Andrew Purtell <ap...@yahoo.com>.
Hello from a lurker.
Powerset was able to get a dump of all content from en.wikipedia.org.
Maybe the Wikimedia Foundation can help you as well.
Alternatively I know that the Heritrix crawler has been modified to
store content into HDFS. See http://corporate.zvents.com/developers/thelab.html , at the bottom. Let that run long enough as an
initialization step of your experiment(s) and you could build up an
enormous corpus.
Of course the results of the above would be noisy and unlabeled.
Another option, if labeled and preprocessed data is desired, is the
KDD archive of course. http://kdd.ics.uci.edu/
- Andy
> From: Grant Ingersoll <gs...@apache.org>
> Subject: FYI Cloud Computing Resources
> To: mahout-dev@lucene.apache.org
> Date: Wednesday, July 30, 2008, 8:26 AM
> http://research.yahoo.com/node/2328
>
> It _MAY_ (stressed, emphasized, etc.) be possible for Mahouters
> (or are we just Mahouts?) to get some access to these resources.
> One big question is where can we get some fairly large data sets
> (large, but not super large, I think, but am not sure)
>
> If you have ideas, etc. please let us know.
>
> -Grant