You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@crunch.apache.org by Aviv Cohn <av...@yahoo.com> on 2015/07/11 18:38:11 UTC
What Hadoop dependencies do I need?
Hello all,
I downloaded Crunch and it's dependencies using Maven (by including the crunch-core dependency in the pom.xml file). However turns out the Hadoop dependencies aren't included as Crunch's dependencies, so they weren't downloaded.
Can you tell me exactly which Maven Hadoop dependencies I need? I assume hadoop-core and hadoop-common. Anything else?
Thank you
Re: What Hadoop dependencies do I need?
Posted by David Ortiz <dp...@gmail.com>.
Did you generate your pom using the crunch archetype on the getting started
page? Hadoop dependencies should be available from the cluster.
On Sat, Jul 11, 2015, 12:45 PM Aviv Cohn <av...@yahoo.com> wrote:
> Allow me to add: also, are there any more dependencies I need to
> successfully run Crunch, which aren't included automatically when using
> Maven?
>
> ------------------------------
> *From:* Aviv Cohn <av...@yahoo.com>
> *To:* "user@crunch.apache.org" <us...@crunch.apache.org>
> *Sent:* Saturday, July 11, 2015 7:38 PM
> *Subject:* What Hadoop dependencies do I need?
>
> Hello all,
>
> I downloaded Crunch and it's dependencies using Maven (by including the
> crunch-core dependency in the pom.xml file). However turns out the Hadoop
> dependencies aren't included as Crunch's dependencies, so they weren't
> downloaded.
>
> Can you tell me exactly which Maven Hadoop dependencies I need? I assume
> hadoop-core and hadoop-common. Anything else?
>
> Thank you
>
>
>
Re: What Hadoop dependencies do I need?
Posted by Aviv Cohn <av...@yahoo.com>.
Allow me to add: also, are there any more dependencies I need to successfully run Crunch, which aren't included automatically when using Maven?
From: Aviv Cohn <av...@yahoo.com>
To: "user@crunch.apache.org" <us...@crunch.apache.org>
Sent: Saturday, July 11, 2015 7:38 PM
Subject: What Hadoop dependencies do I need?
Hello all,
I downloaded Crunch and it's dependencies using Maven (by including the crunch-core dependency in the pom.xml file). However turns out the Hadoop dependencies aren't included as Crunch's dependencies, so they weren't downloaded.
Can you tell me exactly which Maven Hadoop dependencies I need? I assume hadoop-core and hadoop-common. Anything else?
Thank you