You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@crunch.apache.org by Som Satpathy <so...@gmail.com> on 2013/12/16 20:14:08 UTC
Crunch user guide
Hi Josh/all,
It's been a couple of months since my team started using Crunch for our
mapreduce. It has been a great tool, simplifying may problems and
increasing productivity. I personally found it quicker to pick up than
cascading, which I think has a steeper learning curve. My main sources of
learning crunch so far have been the javadocs, crunch user-list, crunch
source code, crunch-examples and some online articles explaining how crunch
works. One place where I found crunch lagging is the need for a user guide
or how-to documentations, something on the lines of cascading user-guides,
which I would say has been really useful for its user-base. Is such a
user-guide coming up soon? That will be of great help for the crunch user
community.
Thanks,
Som
Re: Crunch user guide
Posted by Jeremy Lewi <je...@lewi.us>.
This is a huge help thanks.
J
On Tue, Jan 14, 2014 at 11:07 AM, Jay Vyas <ja...@gmail.com> wrote:
> Thanks josh. just breifly : is it sifgnificantly different than the
> crunch tutorials on the main website?
>
Re: Crunch user guide
Posted by Josh Wills <jw...@cloudera.com>.
On Tue, Jan 14, 2014 at 11:07 AM, Jay Vyas <ja...@gmail.com> wrote:
> Thanks josh. just breifly : is it sifgnificantly different than the
> crunch tutorials on the main website?
>
Yes, it largely replaces them.
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: Crunch user guide
Posted by Jay Vyas <ja...@gmail.com>.
Thanks josh. just breifly : is it sifgnificantly different than the crunch
tutorials on the main website?
Re: Crunch user guide
Posted by Josh Wills <jw...@cloudera.com>.
Thanks guys! Just pushed a few more formatting and content fixes.
On Tue, Jan 14, 2014 at 10:19 AM, Som Satpathy <so...@gmail.com>wrote:
> Excellent read! Thank you Josh!
>
>
> On Tue, Jan 14, 2014 at 10:02 AM, Gabriel Reid <ga...@gmail.com>wrote:
>
>> Looks awesome Josh! I'll definitely go through it in the coming days.
>>
>> - Gabriel
>>
>>
>>
>> On Tue, Jan 14, 2014 at 2:01 AM, Josh Wills <jw...@cloudera.com> wrote:
>> > Closing the loop on this; I just published my holiday project, a new
>> Crunch
>> > user guide:
>> >
>> > http://crunch.apache.org/user-guide.html
>> >
>> > Feedback (and fixes!) gratefully received.
>> >
>> > J
>> >
>> >
>> > On Mon, Dec 16, 2013 at 7:30 PM, Som Satpathy <so...@gmail.com>
>> wrote:
>> >>
>> >> Thanks Josh!
>> >>
>> >>
>> >> On Mon, Dec 16, 2013 at 3:48 PM, Josh Wills <jw...@cloudera.com>
>> wrote:
>> >>>
>> >>> Hey Som,
>> >>>
>> >>> Thanks for the great feedback; I am also an admirer of Cascading's
>> user
>> >>> guide and feel that having one for Crunch would be a great addition.
>> My
>> >>> reason for not writing one yet is largely selfish, i.e., I write and
>> talk a
>> >>> lot as part of my day job, and working on Crunch is how I relax.
>> >>>
>> >>> That said, the holiday season is upon us in the US, and so I have some
>> >>> downtime to devote to writing docs. If anyone has any good brain
>> hacks for
>> >>> forcing oneself into writing, I would be grateful. :)
>> >>>
>> >>> Best,
>> >>> Josh
>> >>>
>> >>>
>> >>>
>> >>> On Mon, Dec 16, 2013 at 11:14 AM, Som Satpathy <somsatpathy@gmail.com
>> >
>> >>> wrote:
>> >>>>
>> >>>> Hi Josh/all,
>> >>>>
>> >>>> It's been a couple of months since my team started using Crunch for
>> our
>> >>>> mapreduce. It has been a great tool, simplifying may problems and
>> increasing
>> >>>> productivity. I personally found it quicker to pick up than
>> cascading, which
>> >>>> I think has a steeper learning curve. My main sources of learning
>> crunch so
>> >>>> far have been the javadocs, crunch user-list, crunch source code,
>> >>>> crunch-examples and some online articles explaining how crunch
>> works. One
>> >>>> place where I found crunch lagging is the need for a user guide or
>> how-to
>> >>>> documentations, something on the lines of cascading user-guides,
>> which I
>> >>>> would say has been really useful for its user-base. Is such a
>> user-guide
>> >>>> coming up soon? That will be of great help for the crunch user
>> community.
>> >>>>
>> >>>> Thanks,
>> >>>> Som
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Director of Data Science
>> >>> Cloudera
>> >>> Twitter: @josh_wills
>> >>
>> >>
>> >
>> >
>> >
>> > --
>> > Director of Data Science
>> > Cloudera
>> > Twitter: @josh_wills
>>
>
>
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: Crunch user guide
Posted by Som Satpathy <so...@gmail.com>.
Excellent read! Thank you Josh!
On Tue, Jan 14, 2014 at 10:02 AM, Gabriel Reid <ga...@gmail.com>wrote:
> Looks awesome Josh! I'll definitely go through it in the coming days.
>
> - Gabriel
>
>
>
> On Tue, Jan 14, 2014 at 2:01 AM, Josh Wills <jw...@cloudera.com> wrote:
> > Closing the loop on this; I just published my holiday project, a new
> Crunch
> > user guide:
> >
> > http://crunch.apache.org/user-guide.html
> >
> > Feedback (and fixes!) gratefully received.
> >
> > J
> >
> >
> > On Mon, Dec 16, 2013 at 7:30 PM, Som Satpathy <so...@gmail.com>
> wrote:
> >>
> >> Thanks Josh!
> >>
> >>
> >> On Mon, Dec 16, 2013 at 3:48 PM, Josh Wills <jw...@cloudera.com>
> wrote:
> >>>
> >>> Hey Som,
> >>>
> >>> Thanks for the great feedback; I am also an admirer of Cascading's user
> >>> guide and feel that having one for Crunch would be a great addition. My
> >>> reason for not writing one yet is largely selfish, i.e., I write and
> talk a
> >>> lot as part of my day job, and working on Crunch is how I relax.
> >>>
> >>> That said, the holiday season is upon us in the US, and so I have some
> >>> downtime to devote to writing docs. If anyone has any good brain hacks
> for
> >>> forcing oneself into writing, I would be grateful. :)
> >>>
> >>> Best,
> >>> Josh
> >>>
> >>>
> >>>
> >>> On Mon, Dec 16, 2013 at 11:14 AM, Som Satpathy <so...@gmail.com>
> >>> wrote:
> >>>>
> >>>> Hi Josh/all,
> >>>>
> >>>> It's been a couple of months since my team started using Crunch for
> our
> >>>> mapreduce. It has been a great tool, simplifying may problems and
> increasing
> >>>> productivity. I personally found it quicker to pick up than
> cascading, which
> >>>> I think has a steeper learning curve. My main sources of learning
> crunch so
> >>>> far have been the javadocs, crunch user-list, crunch source code,
> >>>> crunch-examples and some online articles explaining how crunch works.
> One
> >>>> place where I found crunch lagging is the need for a user guide or
> how-to
> >>>> documentations, something on the lines of cascading user-guides,
> which I
> >>>> would say has been really useful for its user-base. Is such a
> user-guide
> >>>> coming up soon? That will be of great help for the crunch user
> community.
> >>>>
> >>>> Thanks,
> >>>> Som
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> Director of Data Science
> >>> Cloudera
> >>> Twitter: @josh_wills
> >>
> >>
> >
> >
> >
> > --
> > Director of Data Science
> > Cloudera
> > Twitter: @josh_wills
>
Re: Crunch user guide
Posted by Gabriel Reid <ga...@gmail.com>.
Looks awesome Josh! I'll definitely go through it in the coming days.
- Gabriel
On Tue, Jan 14, 2014 at 2:01 AM, Josh Wills <jw...@cloudera.com> wrote:
> Closing the loop on this; I just published my holiday project, a new Crunch
> user guide:
>
> http://crunch.apache.org/user-guide.html
>
> Feedback (and fixes!) gratefully received.
>
> J
>
>
> On Mon, Dec 16, 2013 at 7:30 PM, Som Satpathy <so...@gmail.com> wrote:
>>
>> Thanks Josh!
>>
>>
>> On Mon, Dec 16, 2013 at 3:48 PM, Josh Wills <jw...@cloudera.com> wrote:
>>>
>>> Hey Som,
>>>
>>> Thanks for the great feedback; I am also an admirer of Cascading's user
>>> guide and feel that having one for Crunch would be a great addition. My
>>> reason for not writing one yet is largely selfish, i.e., I write and talk a
>>> lot as part of my day job, and working on Crunch is how I relax.
>>>
>>> That said, the holiday season is upon us in the US, and so I have some
>>> downtime to devote to writing docs. If anyone has any good brain hacks for
>>> forcing oneself into writing, I would be grateful. :)
>>>
>>> Best,
>>> Josh
>>>
>>>
>>>
>>> On Mon, Dec 16, 2013 at 11:14 AM, Som Satpathy <so...@gmail.com>
>>> wrote:
>>>>
>>>> Hi Josh/all,
>>>>
>>>> It's been a couple of months since my team started using Crunch for our
>>>> mapreduce. It has been a great tool, simplifying may problems and increasing
>>>> productivity. I personally found it quicker to pick up than cascading, which
>>>> I think has a steeper learning curve. My main sources of learning crunch so
>>>> far have been the javadocs, crunch user-list, crunch source code,
>>>> crunch-examples and some online articles explaining how crunch works. One
>>>> place where I found crunch lagging is the need for a user guide or how-to
>>>> documentations, something on the lines of cascading user-guides, which I
>>>> would say has been really useful for its user-base. Is such a user-guide
>>>> coming up soon? That will be of great help for the crunch user community.
>>>>
>>>> Thanks,
>>>> Som
>>>
>>>
>>>
>>>
>>> --
>>> Director of Data Science
>>> Cloudera
>>> Twitter: @josh_wills
>>
>>
>
>
>
> --
> Director of Data Science
> Cloudera
> Twitter: @josh_wills
Re: Crunch user guide
Posted by Josh Wills <jw...@cloudera.com>.
Closing the loop on this; I just published my holiday project, a new Crunch
user guide:
http://crunch.apache.org/user-guide.html
Feedback (and fixes!) gratefully received.
J
On Mon, Dec 16, 2013 at 7:30 PM, Som Satpathy <so...@gmail.com> wrote:
> Thanks Josh!
>
>
> On Mon, Dec 16, 2013 at 3:48 PM, Josh Wills <jw...@cloudera.com> wrote:
>
>> Hey Som,
>>
>> Thanks for the great feedback; I am also an admirer of Cascading's user
>> guide and feel that having one for Crunch would be a great addition. My
>> reason for not writing one yet is largely selfish, i.e., I write and talk a
>> lot as part of my day job, and working on Crunch is how I relax.
>>
>> That said, the holiday season is upon us in the US, and so I have some
>> downtime to devote to writing docs. If anyone has any good brain hacks for
>> forcing oneself into writing, I would be grateful. :)
>>
>> Best,
>> Josh
>>
>>
>>
>> On Mon, Dec 16, 2013 at 11:14 AM, Som Satpathy <so...@gmail.com>wrote:
>>
>>> Hi Josh/all,
>>>
>>> It's been a couple of months since my team started using Crunch for our
>>> mapreduce. It has been a great tool, simplifying may problems and
>>> increasing productivity. I personally found it quicker to pick up than
>>> cascading, which I think has a steeper learning curve. My main sources of
>>> learning crunch so far have been the javadocs, crunch user-list, crunch
>>> source code, crunch-examples and some online articles explaining how crunch
>>> works. One place where I found crunch lagging is the need for a user guide
>>> or how-to documentations, something on the lines of cascading user-guides,
>>> which I would say has been really useful for its user-base. Is such a
>>> user-guide coming up soon? That will be of great help for the crunch user
>>> community.
>>>
>>> Thanks,
>>> Som
>>>
>>
>>
>>
>> --
>> Director of Data Science
>> Cloudera <http://www.cloudera.com>
>> Twitter: @josh_wills <http://twitter.com/josh_wills>
>>
>
>
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: Crunch user guide
Posted by Som Satpathy <so...@gmail.com>.
Thanks Josh!
On Mon, Dec 16, 2013 at 3:48 PM, Josh Wills <jw...@cloudera.com> wrote:
> Hey Som,
>
> Thanks for the great feedback; I am also an admirer of Cascading's user
> guide and feel that having one for Crunch would be a great addition. My
> reason for not writing one yet is largely selfish, i.e., I write and talk a
> lot as part of my day job, and working on Crunch is how I relax.
>
> That said, the holiday season is upon us in the US, and so I have some
> downtime to devote to writing docs. If anyone has any good brain hacks for
> forcing oneself into writing, I would be grateful. :)
>
> Best,
> Josh
>
>
>
> On Mon, Dec 16, 2013 at 11:14 AM, Som Satpathy <so...@gmail.com>wrote:
>
>> Hi Josh/all,
>>
>> It's been a couple of months since my team started using Crunch for our
>> mapreduce. It has been a great tool, simplifying may problems and
>> increasing productivity. I personally found it quicker to pick up than
>> cascading, which I think has a steeper learning curve. My main sources of
>> learning crunch so far have been the javadocs, crunch user-list, crunch
>> source code, crunch-examples and some online articles explaining how crunch
>> works. One place where I found crunch lagging is the need for a user guide
>> or how-to documentations, something on the lines of cascading user-guides,
>> which I would say has been really useful for its user-base. Is such a
>> user-guide coming up soon? That will be of great help for the crunch user
>> community.
>>
>> Thanks,
>> Som
>>
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>
Re: Crunch user guide
Posted by Josh Wills <jw...@cloudera.com>.
Hey Som,
Thanks for the great feedback; I am also an admirer of Cascading's user
guide and feel that having one for Crunch would be a great addition. My
reason for not writing one yet is largely selfish, i.e., I write and talk a
lot as part of my day job, and working on Crunch is how I relax.
That said, the holiday season is upon us in the US, and so I have some
downtime to devote to writing docs. If anyone has any good brain hacks for
forcing oneself into writing, I would be grateful. :)
Best,
Josh
On Mon, Dec 16, 2013 at 11:14 AM, Som Satpathy <so...@gmail.com>wrote:
> Hi Josh/all,
>
> It's been a couple of months since my team started using Crunch for our
> mapreduce. It has been a great tool, simplifying may problems and
> increasing productivity. I personally found it quicker to pick up than
> cascading, which I think has a steeper learning curve. My main sources of
> learning crunch so far have been the javadocs, crunch user-list, crunch
> source code, crunch-examples and some online articles explaining how crunch
> works. One place where I found crunch lagging is the need for a user guide
> or how-to documentations, something on the lines of cascading user-guides,
> which I would say has been really useful for its user-base. Is such a
> user-guide coming up soon? That will be of great help for the crunch user
> community.
>
> Thanks,
> Som
>
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>