You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Edward Capriolo <ed...@gmail.com> on 2010/02/17 17:53:53 UTC
hive ant spead ups
I made an ant target quick-test, which differs from test in that it
has no dependencies.
<target name="quick-test">
<iterate target="test"/>
</target>
<target name="test" depends="clean-test,jar">
<iterate target="test"/>
<iterate-cpp target="test"/>
</target>
time ant -Dhadoop.version='0.18.3' -Doffline=true
-Dtestcase=TestCliDriver -Dqfile=alter1.q quick-test
BUILD SUCCESSFUL
Total time: 15 seconds
real 0m16.250s
user 0m20.965s
sys 0m1.579s
time ant -Dhadoop.version='0.18.3' -Doffline=true
-Dtestcase=TestCliDriver -Dqfile=alter1.q test
BUILD SUCCESSFUL
Total time: 26 seconds
real 0m26.564s
user 0m31.307s
sys 0m2.346s
It does without saying that Hive ant is very different then make file.
Most make files can set simple flags to say, 'make.ok ' , so that
running a target like 'make install' will not cause the dependent
tasks to be re-run.
Excuse my ignorance if this is some built in ant switch like
'--no-deps'. Should we set flags in hive so the build process can
intelligently skip work that is already done?
Re: hive ant spead ups
Posted by Zheng Shao <zs...@gmail.com>.
I think this is worth exploring. Unit test time is now longer and
longer given more code and more tests.
Do you want to start a JIRA issue and discuss more about it?
Zheng
On Wed, Feb 17, 2010 at 8:53 AM, Edward Capriolo <ed...@gmail.com> wrote:
> I made an ant target quick-test, which differs from test in that it
> has no dependencies.
> <target name="quick-test">
> <iterate target="test"/>
> </target>
>
> <target name="test" depends="clean-test,jar">
> <iterate target="test"/>
> <iterate-cpp target="test"/>
> </target>
>
> time ant -Dhadoop.version='0.18.3' -Doffline=true
> -Dtestcase=TestCliDriver -Dqfile=alter1.q quick-test
> BUILD SUCCESSFUL
> Total time: 15 seconds
>
> real 0m16.250s
> user 0m20.965s
> sys 0m1.579s
>
> time ant -Dhadoop.version='0.18.3' -Doffline=true
> -Dtestcase=TestCliDriver -Dqfile=alter1.q test
> BUILD SUCCESSFUL
> Total time: 26 seconds
>
> real 0m26.564s
> user 0m31.307s
> sys 0m2.346s
>
> It does without saying that Hive ant is very different then make file.
> Most make files can set simple flags to say, 'make.ok ' , so that
> running a target like 'make install' will not cause the dependent
> tasks to be re-run.
>
> Excuse my ignorance if this is some built in ant switch like
> '--no-deps'. Should we set flags in hive so the build process can
> intelligently skip work that is already done?
>
--
Yours,
Zheng