You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Karl Wright (JIRA)" <ji...@apache.org> on 2015/01/14 08:02:34 UTC
[jira] [Commented] (CONNECTORS-1142) initialize.sh fails because
connector-common-lib dependencies not in classpath
[ https://issues.apache.org/jira/browse/CONNECTORS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276582#comment-14276582 ]
Karl Wright commented on CONNECTORS-1142:
-----------------------------------------
Hi Michael,
These dependencies are all ones that are found in connector-common-lib:
{code}
Directory of C:\wip\mcf\trunk\dist\connector-common-lib
01/11/2015 07:30 PM <DIR> .
01/11/2015 07:30 PM <DIR> ..
01/11/2015 07:30 PM 69,409 activation-1.1.1.jar
01/11/2015 07:30 PM 95,536 apache-mime4j-core-0.7.2.jar
01/11/2015 07:30 PM 304,810 apache-mime4j-dom-0.7.2.jar
01/11/2015 07:30 PM 47,359 asm-4.1.jar
01/11/2015 07:30 PM 19,812 asm-analysis-4.1.jar
01/11/2015 07:30 PM 38,090 asm-commons-4.1.jar
01/11/2015 07:30 PM 342,664 asm-debug-all-4.1.jar
01/11/2015 07:30 PM 22,162 asm-tree-4.1.jar
01/11/2015 07:30 PM 37,599 asm-util-4.1.jar
01/11/2015 07:30 PM 117,099 aspectjrt-1.8.0.jar
01/11/2015 07:30 PM 1,599,570 axis-1.4.jar
01/11/2015 07:30 PM 31,191 axis-jaxrpc-1.4.jar
01/11/2015 07:30 PM 229,116 bcmail-jdk15-1.45.jar
01/11/2015 07:30 PM 1,663,318 bcprov-jdk15-1.45.jar
01/11/2015 07:30 PM 92,027 boilerpipe-1.1.0.jar
01/11/2015 07:30 PM 2,095,141 castor-1.0.5.jar
01/11/2015 07:30 PM 365,552 commons-compress-1.8.1.jar
01/11/2015 07:30 PM 79,796 commons-discovery-0.5.jar
01/11/2015 07:30 PM 313,898 dom4j-1.6.1.jar
01/11/2015 07:30 PM 218,560 fontbox-1.8.6.jar
01/11/2015 07:30 PM 223,298 geronimo-javamail_1.4_spec-1.7.1.jar
01/11/2015 07:30 PM 689,486 isoparser-1.0.2.jar
01/11/2015 07:30 PM 34,474 jackson-annotations-2.1.2.jar
01/11/2015 07:30 PM 206,797 jackson-core-2.1.3.jar
01/11/2015 07:30 PM 925,482 jackson-databind-2.1.3.jar
01/11/2015 07:30 PM 85,452 java-libpst-0.8.1.jar
01/11/2015 07:30 PM 153,253 jdom-1.0.jar
01/11/2015 07:30 PM 50,982 jempbox-1.8.6.jar
01/11/2015 07:30 PM 93,310 jhighlight-1.0.jar
01/11/2015 07:30 PM 66,536 jmatio-1.0.jar
01/11/2015 07:30 PM 220,813 juniversalchardet-1.0.3.jar
01/11/2015 07:30 PM 114,804 mcf-connector-common.jar
01/11/2015 07:30 PM 211,185 metadata-extractor-2.6.2.jar
01/11/2015 07:30 PM 155,714 opensaml-1.1.jar
01/11/2015 07:30 PM 4,040,495 pdfbox-1.8.6.jar
01/11/2015 07:30 PM 2,054,958 poi-3.11-beta2.jar
01/11/2015 07:30 PM 1,111,398 poi-ooxml-3.11-beta2.jar
01/11/2015 07:30 PM 5,161,257 poi-ooxml-schemas-3.11-beta2.jar
01/11/2015 07:30 PM 1,288,743 poi-scratchpad-3.11-beta2.jar
01/11/2015 07:30 PM 219,683 rome-1.0.jar
01/11/2015 07:30 PM 18,817 saaj-api-1.3.jar
01/11/2015 07:30 PM 283,779 saaj-impl-1.3.3.jar
01/11/2015 07:30 PM 90,722 tagsoup-1.2.1.jar
01/11/2015 07:30 PM 507,965 tika-core-1.6.jar
01/11/2015 07:30 PM 557,502 tika-parsers-1.6.jar
01/11/2015 07:30 PM 76,323 vorbis-java-core-0.6.jar
01/11/2015 07:30 PM 22,962 vorbis-java-tika-0.6.jar
01/11/2015 07:30 PM 148,429 wsdl4j-1.6.2.jar
01/11/2015 07:30 PM 337,532 wss4j-1.5.12.jar
01/11/2015 07:30 PM 1,363,159 xercesImpl-2.10.0.jar
01/11/2015 07:30 PM 220,536 xml-apis-1.4.01.jar
01/11/2015 07:30 PM 2,730,866 xmlbeans-2.6.0.jar
01/11/2015 07:30 PM 413,902 xmlsec-1.4.0.jar
01/11/2015 07:30 PM 117,333 xmpcore-5.1.2.jar
01/11/2015 07:30 PM 99,555 xz-1.5.jar
55 File(s) 31,880,211 bytes
2 Dir(s) 34,200,256,512 bytes free
{code}
They must be loaded via the classloader, which is mentioned in properties.xml:
{code}
<!-- Tell MCF where to find the connector jars -->
<libdir path="../connector-lib"/>
<libdir path="../connector-common-lib"/>
<libdir path="../connector-lib-proprietary"/>
{code}
That's a change from previous releases of MCF, so if you are using an older properties.xml, that would explain the problem.
> initialize.sh fails because connector-common-lib dependencies not in classpath
> ------------------------------------------------------------------------------
>
> Key: CONNECTORS-1142
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1142
> Project: ManifoldCF
> Issue Type: Bug
> Affects Versions: ManifoldCF 2.0
> Reporter: Michael Wilken
> Priority: Minor
>
> Running initialize.sh from apache-manifoldcf-2.0/multiprocess-file-example in a fresh ManifoldCF 2.0 install fails because of missing libraries on the classpath:
> {code}
> [wilkenm@localhost:multiprocess-file-example ]$ ./initialize.sh
> Configuration file successfully read
> Successfully unregistered all domains
> Successfully unregistered all output connectors
> Successfully unregistered all transformation connectors
> Successfully unregistered all mapping connectors
> Successfully unregistered all authority connectors
> Successfully unregistered all repository connectors
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.solr.SolrConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.opensearchserver.OpenSearchServerConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.nullconnector.NullConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.hdfs.HDFSOutputConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.gts.GTSConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.filesystem.FileOutputConnector'
> Successfully registered output connector 'org.apache.manifoldcf.agents.output.elasticsearch.ElasticSearchConnector'
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/manifoldcf/connectorcommon/jsongen/JSONReader
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:270)
> at org.apache.manifoldcf.core.system.ManifoldCFResourceLoader.findClass(ManifoldCFResourceLoader.java:149)
> at org.apache.manifoldcf.core.system.ManifoldCF.findClass(ManifoldCF.java:1522)
> at org.apache.manifoldcf.core.interfaces.ConnectorFactory.getThisConnectorRaw(ConnectorFactory.java:144)
> at org.apache.manifoldcf.core.interfaces.ConnectorFactory.getThisConnectorNoCheck(ConnectorFactory.java:118)
> at org.apache.manifoldcf.core.interfaces.ConnectorFactory.installThis(ConnectorFactory.java:48)
> at org.apache.manifoldcf.agents.interfaces.OutputConnectorFactory.install(OutputConnectorFactory.java:70)
> at org.apache.manifoldcf.agents.outputconnmgr.OutputConnectorManager.registerConnector(OutputConnectorManager.java:180)
> at org.apache.manifoldcf.crawler.system.ManifoldCF.registerConnectors(ManifoldCF.java:492)
> at org.apache.manifoldcf.crawler.system.ManifoldCF.reregisterAllConnectors(ManifoldCF.java:151)
> at org.apache.manifoldcf.crawler.InitializeAndRegister.doExecute(InitializeAndRegister.java:43)
> at org.apache.manifoldcf.crawler.InitializeAndRegister.main(InitializeAndRegister.java:60)
> Caused by: java.lang.ClassNotFoundException: org.apache.manifoldcf.connectorcommon.jsongen.JSONReader
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:789)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 13 more
> {code}
> This is easily fixed by adding the following needed libs to the options.env.unix file:
> ../connector-common-lib/mcf-connector-common.jar
> ../connector-common-lib/tika-core-1.6.jar
> ../connector-common-lib/axis-1.4.jar
> options.env.unix (and .win) are create during the build process, and I'm not familiar enough with Ant to provide a patch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)