You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by cu...@apache.org on 2006/02/09 19:06:04 UTC
svn commit: r376366 - in /lucene/hadoop/trunk: build.xml
src/webapps/jobtracker/ src/webapps/mapred/
Author: cutting
Date: Thu Feb 9 10:06:02 2006
New Revision: 376366
URL: http://svn.apache.org/viewcvs?rev=376366&view=rev
Log:
Stop using deprecated 'jspc' ant task and instead call jasper directly. Also rename webapp files to align with package name.
Added:
lucene/hadoop/trunk/src/webapps/mapred/
- copied from r376085, lucene/hadoop/trunk/src/webapps/jobtracker/
Removed:
lucene/hadoop/trunk/src/webapps/jobtracker/
Modified:
lucene/hadoop/trunk/build.xml
Modified: lucene/hadoop/trunk/build.xml
URL: http://svn.apache.org/viewcvs/lucene/hadoop/trunk/build.xml?rev=376366&r1=376365&r2=376366&view=diff
==============================================================================
--- lucene/hadoop/trunk/build.xml (original)
+++ lucene/hadoop/trunk/build.xml Thu Feb 9 10:06:02 2006
@@ -96,16 +96,18 @@
<!-- ====================================================== -->
<!-- Compile the Java files -->
<!-- ====================================================== -->
+ <taskdef classname="org.apache.jasper.JspC" name="jsp-compile" >
+ <classpath refid="classpath"/>
+ </taskdef>
+
<target name="compile" depends="init">
- <jspc
- srcdir="${src.webapps}"
- includes="**/*.jsp"
- destdir="${build.src}"
+
+ <jsp-compile
+ uriroot="${src.webapps}/mapred"
+ outputdir="${build.src}"
package="org.apache.hadoop.mapred"
- uriroot="${src.webapps}/jobtracker"
webxml="${build.webapps}/WEB-INF/web.xml">
- <classpath refid="classpath"/>
- </jspc>
+ </jsp-compile>
<javac
encoding="${build.encoding}"
Re: svn commit: r376366 - in /lucene/hadoop/trunk: build.xml src/webapps/jobtracker/ src/webapps/mapred/
Posted by "Bryan A. Pendleton" <bp...@geekdom.net>.
>
> > Anyway, once I got JAVA_HOME fixed up and started a
> > single set of daemons, I still get the 404 error.
>
> Are there any errors in the jobtracker log file, when it starts Jetty?
I'm finding that it does run sometimes. I'm going to have to spend some more
time to see if I can figure out what's causing it to dump. As soon as I can
trace things out, I'll report more.
--
Bryan A. Pendleton
Ph: (877) geek-1-bp
Re: svn commit: r376366 - in /lucene/hadoop/trunk: build.xml src/webapps/jobtracker/
src/webapps/mapred/
Posted by Doug Cutting <cu...@apache.org>.
Bryan A. Pendleton wrote:
> I had to fix
> things up because there's not equivalent of hadoop-site.xml for environments
> and slaves - why use a directory-dependent set of configuration files, but
> ~/.slaves by default?
No good reason. The default slaves file should probably be something
like conf/hadoop-slaves.txt. Please file a bug and/or patch.
> Anyway, once I got JAVA_HOME fixed up and started a
> single set of daemons, I still get the 404 error.
Are there any errors in the jobtracker log file, when it starts Jetty?
> Actually, I think I'll go file a feature request to this effect, but it'd be
> nice if hadoop/nutch specific environment variables were stored in someplace
> in conf, as well.
I agree that this should be done. My plan is to add a hadoop-env.sh
file that is sourced by hadoop scripts. This is where folks can set JVM
and HADOOP-specific environment stuff. Note that, in a distributed
configuration, this file, like hadoop-site.xml and the hadoop code, has
to be copied to all nodes as a bootstrapping step.
Doug
Re: svn commit: r376366 - in /lucene/hadoop/trunk: build.xml src/webapps/jobtracker/ src/webapps/mapred/
Posted by "Bryan A. Pendleton" <bp...@geekdom.net>.
I had to wrangle a few other details out to make things really be
independent of my running environment, but, no, it didn't work.
I did the svn checkout into a fresh directory. I ran ant using the
freshly-downloaded ant from apache, the same version you show (and the same
version that debian installed, mangled or not). Then I ran ant. I had to fix
things up because there's not equivalent of hadoop-site.xml for environments
and slaves - why use a directory-dependent set of configuration files, but
~/.slaves by default? Anyway, once I got JAVA_HOME fixed up and started a
single set of daemons, I still get the 404 error.
Actually, I think I'll go file a feature request to this effect, but it'd be
nice if hadoop/nutch specific environment variables were stored in someplace
in conf, as well. Possibly have an easy way of having a different list of
datanodes and tasknodes, too, since there're different resource constraints
on those, and many minght have a similar situation to the one I'm
developing, where datanodes can be run far more widely than tasknodes.
On 2/10/06, Doug Cutting <cu...@apache.org> wrote:
>
> Bryan A. Pendleton wrote:
> > When I use the latest build.xml, the jasper task doesn't run.
> >
> > Is there a missing library that should be available to make this work
> for
> > ant? I'm using a debian-installed ant, with the ant-optional package
> also
> > installed. After a default "ant" build, there are no jsps in
> build/webapps.
> > The "compile:" ant job doesn't mention a jsp-compile task, either, all
> of
> > the lines of output are prefixed with "[javac]". Hitting
>
> I strongly recommend installing ant from Apache. I've seen strange
> problems before with the debian install. My ant shows:
>
> ant -version
> Apache Ant version 1.6.5 compiled on June 2 2005
>
> Try the following:
>
> svn co https://svn.apache.org/repos/asf/lucene/hadoop/trunk hadoop
> cd hadoop
> ant
> .... copy attached hadoop-site.xml to conf ...
> bin/start-all.sh
> wget -O - http://localhost:50030/
>
> Does that work for you?
>
> Doug
>
>
>
--
Bryan A. Pendleton
Ph: (877) geek-1-bp
Re: svn commit: r376366 - in /lucene/hadoop/trunk: build.xml src/webapps/jobtracker/
src/webapps/mapred/
Posted by Doug Cutting <cu...@apache.org>.
Bryan A. Pendleton wrote:
> When I use the latest build.xml, the jasper task doesn't run.
>
> Is there a missing library that should be available to make this work for
> ant? I'm using a debian-installed ant, with the ant-optional package also
> installed. After a default "ant" build, there are no jsps in build/webapps.
> The "compile:" ant job doesn't mention a jsp-compile task, either, all of
> the lines of output are prefixed with "[javac]". Hitting
I strongly recommend installing ant from Apache. I've seen strange
problems before with the debian install. My ant shows:
ant -version
Apache Ant version 1.6.5 compiled on June 2 2005
Try the following:
svn co https://svn.apache.org/repos/asf/lucene/hadoop/trunk hadoop
cd hadoop
ant
.... copy attached hadoop-site.xml to conf ...
bin/start-all.sh
wget -O - http://localhost:50030/
Does that work for you?
Doug
Re: svn commit: r376366 - in /lucene/hadoop/trunk: build.xml src/webapps/jobtracker/ src/webapps/mapred/
Posted by "Bryan A. Pendleton" <bp...@geekdom.net>.
When I use the latest build.xml, the jasper task doesn't run.
Is there a missing library that should be available to make this work for
ant? I'm using a debian-installed ant, with the ant-optional package also
installed. After a default "ant" build, there are no jsps in build/webapps.
The "compile:" ant job doesn't mention a jsp-compile task, either, all of
the lines of output are prefixed with "[javac]". Hitting
jobtrackerhost:port/ gives an index, hitting /jobtracker.jsp gives a 404.
Hitting /jobtracker/jobtracker.jsp gives a bunch of compile errors, unless I
make all of the Job* classes that are used public (ie, this is certainly not
running the precompiled jsps as servlets).
On 2/9/06, cutting@apache.org <cu...@apache.org> wrote:
>
> Author: cutting
> Date: Thu Feb 9 10:06:02 2006
> New Revision: 376366
>
> URL: http://svn.apache.org/viewcvs?rev=376366&view=rev
> Log:
> Stop using deprecated 'jspc' ant task and instead call jasper
> directly. Also rename webapp files to align with package name.
>
> Added:
> lucene/hadoop/trunk/src/webapps/mapred/
> - copied from r376085, lucene/hadoop/trunk/src/webapps/jobtracker/
> Removed:
> lucene/hadoop/trunk/src/webapps/jobtracker/
> Modified:
> lucene/hadoop/trunk/build.xml
>
> Modified: lucene/hadoop/trunk/build.xml
> URL:
> http://svn.apache.org/viewcvs/lucene/hadoop/trunk/build.xml?rev=376366&r1=376365&r2=376366&view=diff
>
> ==============================================================================
> --- lucene/hadoop/trunk/build.xml (original)
> +++ lucene/hadoop/trunk/build.xml Thu Feb 9 10:06:02 2006
> @@ -96,16 +96,18 @@
> <!-- ====================================================== -->
> <!-- Compile the Java files -->
> <!-- ====================================================== -->
> + <taskdef classname="org.apache.jasper.JspC" name="jsp-compile" >
> + <classpath refid="classpath"/>
> + </taskdef>
> +
> <target name="compile" depends="init">
> - <jspc
> - srcdir="${src.webapps}"
> - includes="**/*.jsp"
> - destdir="${build.src}"
> +
> + <jsp-compile
> + uriroot="${src.webapps}/mapred"
> + outputdir="${build.src}"
> package="org.apache.hadoop.mapred"
> - uriroot="${src.webapps}/jobtracker"
> webxml="${build.webapps}/WEB-INF/web.xml">
> - <classpath refid="classpath"/>
> - </jspc>
> + </jsp-compile>
>
> <javac
> encoding="${build.encoding}"
>
>
>
--
Bryan A. Pendleton
Ph: (877) geek-1-bp