You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Praveen Sripati <pr...@gmail.com> on 2011/11/22 07:13:10 UTC

Incremental builds in 0.23 using Maven

Hi,

Does Maven support incremental builds? After `svn up', the build is taking
time even without any updates from svn.

Thanks,
Praveen

Re: Incremental builds in 0.23 using Maven

Posted by Robert Evans <ev...@yahoo-inc.com>.
Praveen,

One thing to be aware of with removing the clean is that I have run into situations, in both hadoop and in other projects, where an API changed as part of the update or something and maven did not realize it and did not rebuild something that depended on it.  I then got a runtime error and after doing a clean I got a compile error.  I have also seen situations where the tar.gz package for hadoop was not properly updated and after deploying, it did not have my fix in it.  It took me a long time to figure out why my fix did not work.  After doing a clean and rebuilding/redeploying everything worked just fine.  I have not had the time to dig though why that is happening or file any JIRAs on them.  Also it is rather rare, but if I want to be sure something has my changes in it I always do a clean first.

--Bobby Evans

On 12/7/11 7:42 AM, "Harsh J" <ha...@cloudera.com> wrote:

Praveen,

Obviously, a "clean" target will wipe out all your existing build directories, and hence the other things start from scratch. That is your slowdown-causer.

Just remove the clean from that command and you're good to go.

On 07-Dec-2011, at 6:37 PM, Praveen Sripati wrote:

> Alejandro,
>
> Here is the command I use for branch-0.23
>
> mvn clean install package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true
>
> Regards,
> Praveen
>
> On Wed, Dec 7, 2011 at 11:24 AM, Alejandro Abdelnur <tu...@cloudera.com>wrote:
>
>> what is your 'do a build' command in both cases?
>>
>> On Tue, Dec 6, 2011 at 6:06 PM, Praveen Sripati <praveensripati@gmail.com
>>> wrote:
>>
>>> Alejandro,
>>>
>>> Here is the sequence
>>>
>>> 1. 'svn get ....'
>>> 2. do a build
>>> 3. 'svn up' with no changes
>>> 4. do a build
>>>
>>> Tasks (2) and (4) are taking almost equal time. I expected task (4) to be
>>> much faster.
>>>
>>> Regards,
>>> Praveen
>>>
>>> On Tue, Dec 6, 2011 at 11:08 PM, Alejandro Abdelnur <tucu@cloudera.com
>>>> wrote:
>>>
>>>> Maven does incremental builds.
>>>>
>>>> taking time as in?
>>>>
>>>> Thanks.
>>>>
>>>> Alejandro
>>>>
>>>> On Tue, Dec 6, 2011 at 6:31 AM, Praveen Sripati <
>>> praveensripati@gmail.com
>>>>> wrote:
>>>>
>>>>> Could someone please respond to the below query?
>>>>>
>>>>> Regards,
>>>>> Praveen
>>>>>
>>>>> On Tue, Nov 22, 2011 at 11:43 AM, Praveen Sripati
>>>>> <pr...@gmail.com>wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Does Maven support incremental builds? After `svn up', the build is
>>>>> taking
>>>>>> time even without any updates from svn.
>>>>>>
>>>>>> Thanks,
>>>>>> Praveen
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>



Re: Incremental builds in 0.23 using Maven

Posted by Harsh J <ha...@cloudera.com>.
Praveen,

Obviously, a "clean" target will wipe out all your existing build directories, and hence the other things start from scratch. That is your slowdown-causer.

Just remove the clean from that command and you're good to go.

On 07-Dec-2011, at 6:37 PM, Praveen Sripati wrote:

> Alejandro,
> 
> Here is the command I use for branch-0.23
> 
> mvn clean install package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true
> 
> Regards,
> Praveen
> 
> On Wed, Dec 7, 2011 at 11:24 AM, Alejandro Abdelnur <tu...@cloudera.com>wrote:
> 
>> what is your 'do a build' command in both cases?
>> 
>> On Tue, Dec 6, 2011 at 6:06 PM, Praveen Sripati <praveensripati@gmail.com
>>> wrote:
>> 
>>> Alejandro,
>>> 
>>> Here is the sequence
>>> 
>>> 1. 'svn get ....'
>>> 2. do a build
>>> 3. 'svn up' with no changes
>>> 4. do a build
>>> 
>>> Tasks (2) and (4) are taking almost equal time. I expected task (4) to be
>>> much faster.
>>> 
>>> Regards,
>>> Praveen
>>> 
>>> On Tue, Dec 6, 2011 at 11:08 PM, Alejandro Abdelnur <tucu@cloudera.com
>>>> wrote:
>>> 
>>>> Maven does incremental builds.
>>>> 
>>>> taking time as in?
>>>> 
>>>> Thanks.
>>>> 
>>>> Alejandro
>>>> 
>>>> On Tue, Dec 6, 2011 at 6:31 AM, Praveen Sripati <
>>> praveensripati@gmail.com
>>>>> wrote:
>>>> 
>>>>> Could someone please respond to the below query?
>>>>> 
>>>>> Regards,
>>>>> Praveen
>>>>> 
>>>>> On Tue, Nov 22, 2011 at 11:43 AM, Praveen Sripati
>>>>> <pr...@gmail.com>wrote:
>>>>> 
>>>>>> Hi,
>>>>>> 
>>>>>> Does Maven support incremental builds? After `svn up', the build is
>>>>> taking
>>>>>> time even without any updates from svn.
>>>>>> 
>>>>>> Thanks,
>>>>>> Praveen
>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 
>> 


Re: Incremental builds in 0.23 using Maven

Posted by Praveen Sripati <pr...@gmail.com>.
Alejandro,

Here is the command I use for branch-0.23

mvn clean install package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true

Regards,
Praveen

On Wed, Dec 7, 2011 at 11:24 AM, Alejandro Abdelnur <tu...@cloudera.com>wrote:

> what is your 'do a build' command in both cases?
>
> On Tue, Dec 6, 2011 at 6:06 PM, Praveen Sripati <praveensripati@gmail.com
> >wrote:
>
> > Alejandro,
> >
> > Here is the sequence
> >
> > 1. 'svn get ....'
> > 2. do a build
> > 3. 'svn up' with no changes
> > 4. do a build
> >
> > Tasks (2) and (4) are taking almost equal time. I expected task (4) to be
> > much faster.
> >
> > Regards,
> > Praveen
> >
> > On Tue, Dec 6, 2011 at 11:08 PM, Alejandro Abdelnur <tucu@cloudera.com
> > >wrote:
> >
> > > Maven does incremental builds.
> > >
> > > taking time as in?
> > >
> > > Thanks.
> > >
> > > Alejandro
> > >
> > > On Tue, Dec 6, 2011 at 6:31 AM, Praveen Sripati <
> > praveensripati@gmail.com
> > > >wrote:
> > >
> > > > Could someone please respond to the below query?
> > > >
> > > > Regards,
> > > > Praveen
> > > >
> > > > On Tue, Nov 22, 2011 at 11:43 AM, Praveen Sripati
> > > > <pr...@gmail.com>wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > Does Maven support incremental builds? After `svn up', the build is
> > > > taking
> > > > > time even without any updates from svn.
> > > > >
> > > > > Thanks,
> > > > > Praveen
> > > > >
> > > > >
> > > >
> > >
> >
>

Re: Incremental builds in 0.23 using Maven

Posted by Alejandro Abdelnur <tu...@cloudera.com>.
what is your 'do a build' command in both cases?

On Tue, Dec 6, 2011 at 6:06 PM, Praveen Sripati <pr...@gmail.com>wrote:

> Alejandro,
>
> Here is the sequence
>
> 1. 'svn get ....'
> 2. do a build
> 3. 'svn up' with no changes
> 4. do a build
>
> Tasks (2) and (4) are taking almost equal time. I expected task (4) to be
> much faster.
>
> Regards,
> Praveen
>
> On Tue, Dec 6, 2011 at 11:08 PM, Alejandro Abdelnur <tucu@cloudera.com
> >wrote:
>
> > Maven does incremental builds.
> >
> > taking time as in?
> >
> > Thanks.
> >
> > Alejandro
> >
> > On Tue, Dec 6, 2011 at 6:31 AM, Praveen Sripati <
> praveensripati@gmail.com
> > >wrote:
> >
> > > Could someone please respond to the below query?
> > >
> > > Regards,
> > > Praveen
> > >
> > > On Tue, Nov 22, 2011 at 11:43 AM, Praveen Sripati
> > > <pr...@gmail.com>wrote:
> > >
> > > > Hi,
> > > >
> > > > Does Maven support incremental builds? After `svn up', the build is
> > > taking
> > > > time even without any updates from svn.
> > > >
> > > > Thanks,
> > > > Praveen
> > > >
> > > >
> > >
> >
>

Re: Incremental builds in 0.23 using Maven

Posted by Praveen Sripati <pr...@gmail.com>.
Alejandro,

Here is the sequence

1. 'svn get ....'
2. do a build
3. 'svn up' with no changes
4. do a build

Tasks (2) and (4) are taking almost equal time. I expected task (4) to be
much faster.

Regards,
Praveen

On Tue, Dec 6, 2011 at 11:08 PM, Alejandro Abdelnur <tu...@cloudera.com>wrote:

> Maven does incremental builds.
>
> taking time as in?
>
> Thanks.
>
> Alejandro
>
> On Tue, Dec 6, 2011 at 6:31 AM, Praveen Sripati <praveensripati@gmail.com
> >wrote:
>
> > Could someone please respond to the below query?
> >
> > Regards,
> > Praveen
> >
> > On Tue, Nov 22, 2011 at 11:43 AM, Praveen Sripati
> > <pr...@gmail.com>wrote:
> >
> > > Hi,
> > >
> > > Does Maven support incremental builds? After `svn up', the build is
> > taking
> > > time even without any updates from svn.
> > >
> > > Thanks,
> > > Praveen
> > >
> > >
> >
>

Re: Incremental builds in 0.23 using Maven

Posted by Alejandro Abdelnur <tu...@cloudera.com>.
Maven does incremental builds.

taking time as in?

Thanks.

Alejandro

On Tue, Dec 6, 2011 at 6:31 AM, Praveen Sripati <pr...@gmail.com>wrote:

> Could someone please respond to the below query?
>
> Regards,
> Praveen
>
> On Tue, Nov 22, 2011 at 11:43 AM, Praveen Sripati
> <pr...@gmail.com>wrote:
>
> > Hi,
> >
> > Does Maven support incremental builds? After `svn up', the build is
> taking
> > time even without any updates from svn.
> >
> > Thanks,
> > Praveen
> >
> >
>

Re: Incremental builds in 0.23 using Maven

Posted by Praveen Sripati <pr...@gmail.com>.
Could someone please respond to the below query?

Regards,
Praveen

On Tue, Nov 22, 2011 at 11:43 AM, Praveen Sripati
<pr...@gmail.com>wrote:

> Hi,
>
> Does Maven support incremental builds? After `svn up', the build is taking
> time even without any updates from svn.
>
> Thanks,
> Praveen
>
>