You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Brock Noland <br...@cloudera.com> on 2013/11/27 20:57:12 UTC
Hadoop profile will be required
In maven, we use "profiles" to allow developers to use either the
hadoop-1 or hadoop-2 dependencies when building. When implementing
mavenization I used a feature called "active by default" so that
hadoop-1 would be active in the case no profiles were activated.
Long story short, it looks like the "active by default" feature is
broken or doesn't work the way I expected. When we commit HIVE-5755
("Fix hadoop2 execution environment Milestone 1") a hadoop profile
will be required for all commands.
You will have to add either:
-Phadoop-1
or
-Phadoop-2
to all maven commands. When commit the change I will update this email
in addition to the wiki.
Thank you,
Brock
Re: Hadoop profile will be required
Posted by Brock Noland <br...@cloudera.com>.
Thank you Lefty!
I have updated the HIve ODBC page.
Thanks!
On Thu, Nov 28, 2013 at 3:33 PM, Lefty Leverenz <le...@gmail.com> wrote:
> Grepping an html download of the wiki turned up a few more cases where
> -Phadoop-1 might be needed (color-coding: brown might need -P, gray
> doesn't need it):
>
>> *grep -n 'mvn' * | wc*
> 38 239 3499
>> *grep -n 'mvn' * | grep -v 'Phadoop-1' | wc*
> 10 50 859
>> *grep -n 'mvn' * | grep -v 'Phadoop-1'*
> *HiveDeveloperFAQ.html:*109:$ mvn eclipse:clean
> *HiveDeveloperFAQ.html:*113:$ mvn eclipse:clean
> *HiveDeveloperFAQ.html:*192:ant -Dmvn.publish.repo=local maven-build
> *HiveDeveloperFAQ.html:*193:ant -Dmvn.publish.repo=local maven-publish
> *HiveODBC.html:*108:$ mvn compile -Podbc -Dthrift.home=/usr/local
> -Dboost.home=/usr/local
> *HiveODBC.html:*131:$ mvn test -Podbc -Dthrift.home=/usr/local
> -Dboost.home=/usr/local
> *HowToContribute.html:*136: <li><a href="
> http://books.sonatype.com/mvnex-book/reference/multimodule.html">Maven by
> example - a multi-module project</a></li>
> *HowToRelease.html:*137:<pre>% ant -Dversion=X.Y.Z
> -Dmvn.publish.repo=staging maven-build
> *HowToRelease.html:*138:% ant -Dversion=X.Y.Z -Dmvn.publish.repo=staging
> maven-publish
> *Jenkins Script.html:*116:mvn clean package -DskipTests
> -Drat.numUnapprovedLicenses=1000 -Dmaven.repo.local=$WORKSPACE/.m2
>
>
> Happy Thanksgiving, everyone!
>
> -- Lefty
>
>
> On Thu, Nov 28, 2013 at 10:37 AM, Brock Noland <br...@cloudera.com> wrote:
>
>> I have committed HIVE-5755 and updated the wiki.
>>
>> TLDR: Add -Phadoop-1 to all maven commands going forward.
>>
>> On Wed, Nov 27, 2013 at 1:57 PM, Brock Noland <br...@cloudera.com> wrote:
>> > In maven, we use "profiles" to allow developers to use either the
>> > hadoop-1 or hadoop-2 dependencies when building. When implementing
>> > mavenization I used a feature called "active by default" so that
>> > hadoop-1 would be active in the case no profiles were activated.
>> >
>> > Long story short, it looks like the "active by default" feature is
>> > broken or doesn't work the way I expected. When we commit HIVE-5755
>> > ("Fix hadoop2 execution environment Milestone 1") a hadoop profile
>> > will be required for all commands.
>> >
>> > You will have to add either:
>> >
>> > -Phadoop-1
>> >
>> > or
>> >
>> > -Phadoop-2
>> >
>> > to all maven commands. When commit the change I will update this email
>> > in addition to the wiki.
>> >
>> > Thank you,
>> > Brock
>>
>>
>>
>> --
>> Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
>>
--
Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
Re: Hadoop profile will be required
Posted by Lefty Leverenz <le...@gmail.com>.
Grepping an html download of the wiki turned up a few more cases where
-Phadoop-1 might be needed (color-coding: brown might need -P, gray
doesn't need it):
> *grep -n 'mvn' * | wc*
38 239 3499
> *grep -n 'mvn' * | grep -v 'Phadoop-1' | wc*
10 50 859
> *grep -n 'mvn' * | grep -v 'Phadoop-1'*
*HiveDeveloperFAQ.html:*109:$ mvn eclipse:clean
*HiveDeveloperFAQ.html:*113:$ mvn eclipse:clean
*HiveDeveloperFAQ.html:*192:ant -Dmvn.publish.repo=local maven-build
*HiveDeveloperFAQ.html:*193:ant -Dmvn.publish.repo=local maven-publish
*HiveODBC.html:*108:$ mvn compile -Podbc -Dthrift.home=/usr/local
-Dboost.home=/usr/local
*HiveODBC.html:*131:$ mvn test -Podbc -Dthrift.home=/usr/local
-Dboost.home=/usr/local
*HowToContribute.html:*136: <li><a href="
http://books.sonatype.com/mvnex-book/reference/multimodule.html">Maven by
example - a multi-module project</a></li>
*HowToRelease.html:*137:<pre>% ant -Dversion=X.Y.Z
-Dmvn.publish.repo=staging maven-build
*HowToRelease.html:*138:% ant -Dversion=X.Y.Z -Dmvn.publish.repo=staging
maven-publish
*Jenkins Script.html:*116:mvn clean package -DskipTests
-Drat.numUnapprovedLicenses=1000 -Dmaven.repo.local=$WORKSPACE/.m2
Happy Thanksgiving, everyone!
-- Lefty
On Thu, Nov 28, 2013 at 10:37 AM, Brock Noland <br...@cloudera.com> wrote:
> I have committed HIVE-5755 and updated the wiki.
>
> TLDR: Add -Phadoop-1 to all maven commands going forward.
>
> On Wed, Nov 27, 2013 at 1:57 PM, Brock Noland <br...@cloudera.com> wrote:
> > In maven, we use "profiles" to allow developers to use either the
> > hadoop-1 or hadoop-2 dependencies when building. When implementing
> > mavenization I used a feature called "active by default" so that
> > hadoop-1 would be active in the case no profiles were activated.
> >
> > Long story short, it looks like the "active by default" feature is
> > broken or doesn't work the way I expected. When we commit HIVE-5755
> > ("Fix hadoop2 execution environment Milestone 1") a hadoop profile
> > will be required for all commands.
> >
> > You will have to add either:
> >
> > -Phadoop-1
> >
> > or
> >
> > -Phadoop-2
> >
> > to all maven commands. When commit the change I will update this email
> > in addition to the wiki.
> >
> > Thank you,
> > Brock
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
>
Re: Hadoop profile will be required
Posted by Brock Noland <br...@cloudera.com>.
I have committed HIVE-5755 and updated the wiki.
TLDR: Add -Phadoop-1 to all maven commands going forward.
On Wed, Nov 27, 2013 at 1:57 PM, Brock Noland <br...@cloudera.com> wrote:
> In maven, we use "profiles" to allow developers to use either the
> hadoop-1 or hadoop-2 dependencies when building. When implementing
> mavenization I used a feature called "active by default" so that
> hadoop-1 would be active in the case no profiles were activated.
>
> Long story short, it looks like the "active by default" feature is
> broken or doesn't work the way I expected. When we commit HIVE-5755
> ("Fix hadoop2 execution environment Milestone 1") a hadoop profile
> will be required for all commands.
>
> You will have to add either:
>
> -Phadoop-1
>
> or
>
> -Phadoop-2
>
> to all maven commands. When commit the change I will update this email
> in addition to the wiki.
>
> Thank you,
> Brock
--
Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org