Speedup of test target

[Edward Capriolo <ed...@gmail.com>]

Since apache was granted a clover license I was looking to add a
clover target to hive. I know recently there was a jira issue on
running ant tests in parallel. I have a modest core II due laptop that
takes quite a while on the test target. Does the trunk currently by
default run test in parallel, if not how can I enable this? Also what
are people out there using to run the test target hardware wise, and
how long does ant test take?


Thanks,
Edward

Re: Speedup of test target

[Edward Capriolo <ed...@gmail.com>]

I was thinking to go really out of the box and write some target to
run the build/test on hadoop. I know i had set up distcc at one point
to speed up c++builds, hudson supposedly has some logic to distribute
some build/test tasks.

I am thinking out loud here because each patch comes with a positive
or negative test, and as the codebase grows build test is going to
take progressively longer. Also we are running a full test for each
major hadoop version for each patch that can hurt our dev time to.

Really all the tests should be and are unrelated so I am thinking
list test cases.txt
NLINE input format
hive + ant in distributed cache
m/r ant test

On Fri, Jan 8, 2010 at 6:09 AM, Zheng Shao <zs...@gmail.com> wrote:
> Unfortunately the trunk does not run tests in parallel yet.
> The majority of the time is spent in TestCliDriver which contains over
> 200 .q files.
> We will need to separate the working directories and metastore
> directories to make these .q files run in parallel.
>
> Zheng

> On Thu, Jan 7, 2010 at 11:46 AM, Edward Capriolo <ed...@gmail.com> wrote:
>> Since apache was granted a clover license I was looking to add a
>> clover target to hive. I know recently there was a jira issue on
>> running ant tests in parallel. I have a modest core II due laptop that
>> takes quite a while on the test target. Does the trunk currently by
>> default run test in parallel, if not how can I enable this? Also what
>> are people out there using to run the test target hardware wise, and
>> how long does ant test take?
>>
>>
>> Thanks,
>> Edward
>>
>
>
>
> --
> Yours,
> Zheng
>

Re: Speedup of test target

[Zheng Shao <zs...@gmail.com>]

Unfortunately the trunk does not run tests in parallel yet.
The majority of the time is spent in TestCliDriver which contains over
200 .q files.
We will need to separate the working directories and metastore
directories to make these .q files run in parallel.

Zheng

On Thu, Jan 7, 2010 at 11:46 AM, Edward Capriolo <ed...@gmail.com> wrote:
> Since apache was granted a clover license I was looking to add a
> clover target to hive. I know recently there was a jira issue on
> running ant tests in parallel. I have a modest core II due laptop that
> takes quite a while on the test target. Does the trunk currently by
> default run test in parallel, if not how can I enable this? Also what
> are people out there using to run the test target hardware wise, and
> how long does ant test take?
>
>
> Thanks,
> Edward
>



-- 
Yours,
Zheng