Re: HttpClient NoClassDefFoundError For the url-downloader Script of the Apache OODT Crawler

["Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>]

Applied and committed, thanks Angela!

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW:  http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++






-----Original Message-----
From: MengYing Wang <me...@gmail.com>
Date: Saturday, October 4, 2014 at 8:22 PM
To: Lewis John Mcgibbney <le...@gmail.com>
Cc: Chris Mattmann <Ch...@jpl.nasa.gov>, "Ramirez, Paul M
(398J)" <pa...@jpl.nasa.gov>, "dev@oodt.apache.org"
<de...@oodt.apache.org>
Subject: Re: HttpClient NoClassDefFoundError For the url-downloader Script
of the Apache OODT Crawler

>Dear Lewis,
>
>
>Done. This is the jira url:
>https://issues.apache.org/jira/browse/OODT-756
><https://issues.apache.org/jira/browse/OODT-756>
>
>Best,
>Mengying Wang
>
>
>On Tue, Sep 30, 2014 at 6:59 PM, Lewis John Mcgibbney
><le...@gmail.com> wrote:
>
>Ok it sounds like we need to file an issue for this.
>Can you possibly of an issue in Jira?
>If someone else can reproduce then it is a bug which we need to fix.
>Thank you
>Lewis
>
>
>On Tuesday, September 30, 2014, MengYing Wang <me...@gmail.com>
>wrote:
>
>Dear Lewis,
>
>
>By the way, no need to change any code in the script url-downloader.
>
>
>Thank you.
>
>
>Best,
>Angela Wang
>
>
>On Tue, Sep 30, 2014 at 1:29 PM, MengYing Wang
><me...@gmail.com> wrote:
>
>Dear Lewis,
>
>
>The problem has been solved! *~*
>
>
>I just noticed that the class
>org.apache.oodt.cas.pushpull.protocol.http.HttpClient does exist in
>cas-pushpull-0.2.jar, but disappeared in cas-pushpull-0.6 (Why?). So I
>just downloaded the cas-pushpull-0.2.jar file from
>http://www.java2s.com/Code/Jar/c/Downloadcaspushpull02jar.htm,
> and threw it into my pushpull lib directory. Then I can start the
>url-downloader script normally. Thank you!
>
>
>Best,
>Angela Wang
>
>
>On Tue, Sep 30, 2014 at 8:28 AM, Lewis John Mcgibbney
><le...@gmail.com> wrote:
>
>Hi Angela,
>If this is a change against the code base and you think that is an
>improvement can you possibly log an issue in our issue tracking system?
>
>
>https://issues.apache.org/jira/browse/OODT/?selectedTab=com.atlassian.jira
>.jira-projects-plugin:summary-panel
>
>
>
>The usual process is to create a Jira account, log in, create an issue.
>We would encourage you to be as verbose as possible when logging issues.
>It really helps to describe what was wrong, how it can be reproduced and
>what your suggested fix is.
>
>
>If you are able to attach a patch for fixing the issue then this is the
>cherry on the cake.
>Thanks
>Lewis
>
>On Monday, September 29, 2014, MengYing Wang <me...@gmail.com>
>wrote:
>
>Dear Lewis,
>
>
>Thank you for your help. I have modified the url-downloader script to add
>all jar files into the classpath. Following is the new content.
>
>
>--------------------------------------------------------------------------
>----------------------------
>set LIB_DEPS
>foreach file (`find ../lib/*.jar`)
>     set LIB_DEPS = "${file}:${LIB_DEPS}"
>end
>
>
>set 
>JAVA_HOME="/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Hom
>e"
>
>
>${JAVA_HOME}/bin/java -cp ${LIB_DEPS} -Djava.ext.dirs=../lib \
>        -Djava.util.logging.config.file=../etc/logging.properties \
>        org.apache.oodt.cas.pushpull.protocol.http.HttpClient \
>        --url $1 \
>        --downloadToDir $2
>--------------------------------------------------------------------------
>----------------------------
>
>
>
>Thank you!
>
>
>Best,
>Angela Wang
>
>
>
>
>On Mon, Sep 29, 2014 at 12:52 AM, Lewis John Mcgibbney
><le...@gmail.com> wrote:
>
>Hi Angela,
>
>The problem is pretty straight forward to address.
>
>The offending classes are not present on your classpath at runtime...
>
>Can you maybe explain how you added all of the jar's in lib to your
>classpath?
>
>Thanks, we will get there eventually.
>
>Thank you
>Lewis
>
>
>On Sun, Sep 28, 2014 at 11:10 PM, AngelaWang
><me...@gmail.com> wrote:
>
>Dear Prof. Mattmann,
>
>
>Sorry for the late response, since I just join the mailing list.
>Following are the jar files that are in my $PUSHPULL_HOME/lib directory:
>
>
>--------------------------------------------------------------------------
>------------------------------------------------------------
>antlr-2.7.6.jar ehcache-1.2.3.jarsolr-commons-csv-1.3.0.jar
>aopalliance-1.0.jar fontbox-1.3.1.jarsolr-core-1.3.0.jar
>asm-3.1.jar 
>geronimo-activation_1.1_spec-1.1.jarsolr-lucene-analyzers-1.3.0.jar
>asm-attrs-1.5.3.jar
>geronimo-javamail_1.4_mail-1.8.1.jarsolr-lucene-highlighter-1.3.0.jar
>bcmail-jdk15-1.45.jar
>geronimo-stax-api_1.0_spec-1.0.1.jarsolr-lucene-queries-1.3.0.jar
>bcprov-jdk15-1.45.jar guava-10.0.1.jarsolr-lucene-snowball-1.3.0.jar
>boilerpipe-1.1.0.jar
>hibernate-3.2.5.ga.jarsolr-lucene-spellchecker-1.3.0.jar
>cas-cli-0.6.jar hsqldb-1.8.0.7.jarsolr-solrj-1.3.0.jar
>cas-filemgr-0.6.jar jdom-1.0.jarspring-aop-3.0.5.RELEASE.jar
>cas-metadata-0.6.jar jempbox-1.3.1.jarspring-asm-3.0.5.RELEASE.jar
>cas-protocol-api-0.6.jar jsch-0.1.42.jarspring-beans-3.0.5.RELEASE.jar
>cas-protocol-ftp-0.6.jar jsr305-1.3.9.jarspring-context-3.0.5.RELEASE.jar
>cas-protocol-http-0.6.jar jug-2.0.0-asl.jarspring-core-3.0.5.RELEASE.jar
>cas-protocol-imaps-0.6.jar junit-3.8.2.jarspring-dao-2.0.8.jar
>cas-protocol-sftp-0.6.jar
>jython-2.2-beta1.jarspring-expression-3.0.5.RELEASE.jar
>cas-pushpull-0.6.jar lucene-core-2.0.0.jarspring-hibernate3-2.0.8.jar
>cglib-2.1_3.jar metadata-extractor-2.4.0-beta-1.jarspring-jdbc-2.0.8.jar
>cog-jglobus-1.8.0.jar mina-core-2.0.4.jarstax-1.2.0.jar
>commons-cli-1.2.jar nekohtml-1.9.6.2.jarstax-api-1.0.1.jar
>commons-codec-1.3.jar netcdf-4.2.jarstax-utils-20040917.jar
>commons-collections-2.1.jar oodt-commons-0.6.jartagsoup-1.2.jar
>commons-compress-1.1.jar oro-2.0.8.jartika-core-0.8.jar
>commons-dbcp-1.2.1.jar pcs-input-0.6.jartika-parsers-0.8.jar
>commons-fileupload-1.2.jar pdfbox-1.3.1.jarxercesImpl-2.9.1.jar
>commons-httpclient-3.0.jarpoi-3.7.jar xml-apis-1.0.b2.jar
>commons-io-1.4.jar poi-ooxml-3.7.jarxmlbeans-2.3.0.jar
>commons-lang-2.3.jar poi-ooxml-schemas-3.7.jarxmlrpc-2.0.1.jar
>commons-logging-1.0.3.jar poi-scratchpad-3.7.jarxpp3_min-1.1.4c.jar
>commons-net-1.4.0.jar rome-0.9.jarxstream-1.3.1.jar
>commons-pool-1.2.jar slf4j-api-1.6.1.jar
>dom4j-1.6.1.jar solr-common-1.3.0.jar
>
>
>--------------------------------------------------------------------------
>------------------------------------------------------------
>
>
>@Lewis, the version of oodt is 0.6. I have added the the
>commons-httpclient library to the Pom.xml file (which is in the pushpull
>directory) and rebuild the pushpull module using maven. Still I get the
>same error.
>
>
>@Paul, I also tried to add all the jar files in the lib directory to the
>classpath, Still the same error. Also I am running the url-downloader
>script from the cas-pushpull/bin directory.
>
>
>Thank you for your help!
>
>
>Best,
>Angela Wang
>
>
> 
>
>
>
>
>
>
>
>
>
>-- 
>Lewis
>
>
>
>
>
>
>
>
>-- 
>Best,
>Mengying (Angela) Wang
>
>
>
>
>
>
>
>
>
>
>-- 
>Lewis
>
>
>
>
>
>
>
>
>-- 
>Best,
>Mengying (Angela) Wang
>
>
>
>
>
>
>
>
>
>
>
>-- 
>Best,
>Mengying (Angela) Wang
>
>
>
>
>
>
>
>
>
>-- 
>Lewis
>
>
>
>
>
>
>
>
>-- 
>Best,
>Mengying (Angela) Wang
>
>