You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Johan Oskarsson <jo...@oskarsson.nu> on 2009/02/12 12:38:56 UTC
Hudson nightly builds setup
I have setup three nightly Hive builds on the Apache hosted Hudson
install, thanks to Dhruba for all the help.
Builds, http://hudson.zones.apache.org/hudson/view/Hive/
Hive with hadoop 0.17
Hive with hadoop 0.18
Hive with hadoop 0.19
The builds are fairly simple right now, it only checks out the latest
trunk and builds + runs tests against the Hadoop versions mentioned above.
We could add Findbugs and Checkstyle checks. Especially findbugs is
quite useful, similar to this:
http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-trunk/violations/
It seems like testCliDriver_udf7 fails for all Hadoop versions and as we
know input_3limit.q fails on 0.17.
https://issues.apache.org/jira/browse/HIVE-286
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/
https://issues.apache.org/jira/browse/HIVE-276
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_input3_limit/
/Johan
Re: Hudson nightly builds setup
Posted by Dhruba Borthakur <dh...@gmail.com>.
Hi Johan,
Thanks for this info. It would be nice if you can send an email to
general@hadoop.apache.org saying that you are thinking of making Hudson-Hive
use Cobertura and if there are any licensing issues that we need to be
concerned about. It would be nice to check before we install Cobertura on
apache machine.
thanks again,
dhruba
On Fri, Feb 13, 2009 at 2:42 AM, Johan Oskarsson <jo...@oskarsson.nu> wrote:
> I have more experience with Cobertura and it seems Hadoop is having some
> issues with Clover:
>
> http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/750/testReport/org.apache.hadoop.hdfsproxy/TestHdfsProxy/_init_/
> https://issues.apache.org/jira/browse/HADOOP-3921
>
> Since Cobertura is free people can install and use it locally on their
> machines, could be good if someone wants to improve the test coverage.
>
> So my vote would go to Cobertura, but I don't feel very strongly either
> way.
>
> /Johan
>
> Ashish Thusoo wrote:
> > Cool... Thanks for setting this up.
> >
> > Will try to get the two failures fixed today so that we have a clean
> build for these.
> >
> > Regarding the coverage tool the Cobertura license seems very convoluted
> though from what is presented on their site it seems safe to use. We could
> get a free clover license and side step all these issues.
> >
> > Thoughts?
> >
> > Ashish
> >
> > -----Original Message-----
> > From: Johan Oskarsson [mailto:johan@oskarsson.nu]
> > Sent: Thursday, February 12, 2009 3:48 AM
> > To: hive-dev@hadoop.apache.org
> > Subject: Re: Hudson nightly builds setup
> >
> > Forgot to mention, a code coverage tool would also be handy to have. We
> use Cobertura at Last.fm, works fine, not sure if it would mean any
> licensing issues to use in Hive. Hadoop uses Clover, don't know much about
> it.
> >
> > /Johan
> >
> > Johan Oskarsson wrote:
> >> I have setup three nightly Hive builds on the Apache hosted Hudson
> >> install, thanks to Dhruba for all the help.
> >>
> >> Builds, http://hudson.zones.apache.org/hudson/view/Hive/
> >> Hive with hadoop 0.17
> >> Hive with hadoop 0.18
> >> Hive with hadoop 0.19
> >>
> >> The builds are fairly simple right now, it only checks out the latest
> >> trunk and builds + runs tests against the Hadoop versions mentioned
> above.
> >>
> >> We could add Findbugs and Checkstyle checks. Especially findbugs is
> >> quite useful, similar to this:
> >> http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-trunk/vio
> >> lations/
> >>
> >>
> >>
> >> It seems like testCliDriver_udf7 fails for all Hadoop versions and as
> >> we know input_3limit.q fails on 0.17.
> >>
> >> https://issues.apache.org/jira/browse/HIVE-286
> >> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/t
> >> estReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/
> >>
> >> https://issues.apache.org/jira/browse/HIVE-276
> >> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/lastBuild/t
> >> estReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_input
> >> 3_limit/
> >>
> >> /Johan
> >
>
>
Re: Hudson nightly builds setup
Posted by Johan Oskarsson <jo...@oskarsson.nu>.
I have more experience with Cobertura and it seems Hadoop is having some
issues with Clover:
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/750/testReport/org.apache.hadoop.hdfsproxy/TestHdfsProxy/_init_/
https://issues.apache.org/jira/browse/HADOOP-3921
Since Cobertura is free people can install and use it locally on their
machines, could be good if someone wants to improve the test coverage.
So my vote would go to Cobertura, but I don't feel very strongly either way.
/Johan
Ashish Thusoo wrote:
> Cool... Thanks for setting this up.
>
> Will try to get the two failures fixed today so that we have a clean build for these.
>
> Regarding the coverage tool the Cobertura license seems very convoluted though from what is presented on their site it seems safe to use. We could get a free clover license and side step all these issues.
>
> Thoughts?
>
> Ashish
>
> -----Original Message-----
> From: Johan Oskarsson [mailto:johan@oskarsson.nu]
> Sent: Thursday, February 12, 2009 3:48 AM
> To: hive-dev@hadoop.apache.org
> Subject: Re: Hudson nightly builds setup
>
> Forgot to mention, a code coverage tool would also be handy to have. We use Cobertura at Last.fm, works fine, not sure if it would mean any licensing issues to use in Hive. Hadoop uses Clover, don't know much about it.
>
> /Johan
>
> Johan Oskarsson wrote:
>> I have setup three nightly Hive builds on the Apache hosted Hudson
>> install, thanks to Dhruba for all the help.
>>
>> Builds, http://hudson.zones.apache.org/hudson/view/Hive/
>> Hive with hadoop 0.17
>> Hive with hadoop 0.18
>> Hive with hadoop 0.19
>>
>> The builds are fairly simple right now, it only checks out the latest
>> trunk and builds + runs tests against the Hadoop versions mentioned above.
>>
>> We could add Findbugs and Checkstyle checks. Especially findbugs is
>> quite useful, similar to this:
>> http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-trunk/vio
>> lations/
>>
>>
>>
>> It seems like testCliDriver_udf7 fails for all Hadoop versions and as
>> we know input_3limit.q fails on 0.17.
>>
>> https://issues.apache.org/jira/browse/HIVE-286
>> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/t
>> estReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/
>>
>> https://issues.apache.org/jira/browse/HIVE-276
>> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/lastBuild/t
>> estReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_input
>> 3_limit/
>>
>> /Johan
>
RE: Hudson nightly builds setup
Posted by Ashish Thusoo <at...@facebook.com>.
Cool... Thanks for setting this up.
Will try to get the two failures fixed today so that we have a clean build for these.
Regarding the coverage tool the Cobertura license seems very convoluted though from what is presented on their site it seems safe to use. We could get a free clover license and side step all these issues.
Thoughts?
Ashish
-----Original Message-----
From: Johan Oskarsson [mailto:johan@oskarsson.nu]
Sent: Thursday, February 12, 2009 3:48 AM
To: hive-dev@hadoop.apache.org
Subject: Re: Hudson nightly builds setup
Forgot to mention, a code coverage tool would also be handy to have. We use Cobertura at Last.fm, works fine, not sure if it would mean any licensing issues to use in Hive. Hadoop uses Clover, don't know much about it.
/Johan
Johan Oskarsson wrote:
> I have setup three nightly Hive builds on the Apache hosted Hudson
> install, thanks to Dhruba for all the help.
>
> Builds, http://hudson.zones.apache.org/hudson/view/Hive/
> Hive with hadoop 0.17
> Hive with hadoop 0.18
> Hive with hadoop 0.19
>
> The builds are fairly simple right now, it only checks out the latest
> trunk and builds + runs tests against the Hadoop versions mentioned above.
>
> We could add Findbugs and Checkstyle checks. Especially findbugs is
> quite useful, similar to this:
> http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-trunk/vio
> lations/
>
>
>
> It seems like testCliDriver_udf7 fails for all Hadoop versions and as
> we know input_3limit.q fails on 0.17.
>
> https://issues.apache.org/jira/browse/HIVE-286
> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/t
> estReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/
>
> https://issues.apache.org/jira/browse/HIVE-276
> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/lastBuild/t
> estReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_input
> 3_limit/
>
> /Johan
Re: Hudson nightly builds setup
Posted by Johan Oskarsson <jo...@oskarsson.nu>.
Forgot to mention, a code coverage tool would also be handy to have. We
use Cobertura at Last.fm, works fine, not sure if it would mean any
licensing issues to use in Hive. Hadoop uses Clover, don't know much
about it.
/Johan
Johan Oskarsson wrote:
> I have setup three nightly Hive builds on the Apache hosted Hudson
> install, thanks to Dhruba for all the help.
>
> Builds, http://hudson.zones.apache.org/hudson/view/Hive/
> Hive with hadoop 0.17
> Hive with hadoop 0.18
> Hive with hadoop 0.19
>
> The builds are fairly simple right now, it only checks out the latest
> trunk and builds + runs tests against the Hadoop versions mentioned above.
>
> We could add Findbugs and Checkstyle checks. Especially findbugs is
> quite useful, similar to this:
> http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-trunk/violations/
>
>
>
> It seems like testCliDriver_udf7 fails for all Hadoop versions and as we
> know input_3limit.q fails on 0.17.
>
> https://issues.apache.org/jira/browse/HIVE-286
> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/
>
> https://issues.apache.org/jira/browse/HIVE-276
> http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_input3_limit/
>
> /Johan