You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oodt.apache.org by DImuthu Upeksha <di...@gmail.com> on 2015/07/31 12:02:44 UTC
File Manager - Error in ingeting a file to server
Hi all,
I followed the tutorial [1] about OODT file server and managed to configure
and start on the port 9000. Then I sent following request to ingest a file
./filemgr-client --url http://localhost:9000 --operation --ingestProduct
--productName blah.txt --productStructure Flat --productTypeName
GenericFile --metadataFile file:///tmp/blah.txt.met --refs
file:///tmp/blah.txt
As response I get following error. What could be the reason for this error?
Jul 30, 2015 11:36:36 AM
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
INFO: Loading File Manager Configuration Properties from:
[../etc/filemgr.properties]
Jul 30, 2015 11:36:37 AM
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor:
[org.apache.oodt.cas.filemgr.metadata.extractors.CoreMetExtractor] for
product type: [GenericFile]
Jul 30, 2015 11:36:37 AM
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor:
[org.apache.oodt.cas.filemgr.metadata.extractors.examples.MimeTypeExtractor]
for product type: [GenericFile]
Jul 30, 2015 11:36:37 AM
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor:
[org.apache.oodt.cas.filemgr.metadata.extractors.examples.FinalFileLocationExtractor]
for product type: [GenericFile]
java.lang.IllegalArgumentException: URI is not absolute
at java.io.File.<init>(File.java:416)
at
org.apache.oodt.cas.filemgr.versioning.VersioningUtils.createBasicDataStoreRefsFlat(VersioningUtils.java:219)
at
org.apache.oodt.cas.filemgr.versioning.BasicVersioner.createDataStoreReferences(BasicVersioner.java:123)
at
org.apache.oodt.cas.filemgr.metadata.extractors.examples.FinalFileLocationExtractor.doExtract(FinalFileLocationExtractor.java:80)
at
org.apache.oodt.cas.filemgr.metadata.extractors.AbstractFilemgrMetExtractor.extractMetadata(AbstractFilemgrMetExtractor.java:57)
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.runExtractors(XmlRpcFileManager.java:1111)
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.addMetadata(XmlRpcFileManager.java:1065)
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.ingestProduct(XmlRpcFileManager.java:722)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.xmlrpc.Invoker.execute(Invoker.java:130)
at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84)
at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125)
at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761)
at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642)
at java.lang.Thread.run(Thread.java:745)
org.apache.xmlrpc.XmlRpcException: java.lang.Exception:
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd] :
URI is not absolute
at
org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcClientResponseProcessor.java:104)
at
org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClientResponseProcessor.java:71)
at org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178)
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.ingestProduct(XmlRpcFileManagerClient.java:1198)
at
org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction.execute(IngestProductCliAction.java:113)
at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:331)
at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFileManagerClient.java:1350)
Jul 30, 2015 11:36:37 AM
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient ingestProduct
SEVERE: Failed to ingest product
[org.apache.oodt.cas.filemgr.structs.Product@a2431d0] :
java.lang.Exception:
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd] :
URI is not absolute -- rolling back ingest
Jul 30, 2015 11:36:37 AM org.apache.oodt.cas.filemgr.catalog.LuceneCatalog
removeProductDocument
FINE: LuceneCatalog: remove document from index for product: [null]
java.lang.Exception: Failed to ingest product
[org.apache.oodt.cas.filemgr.structs.Product@a2431d0] :
java.lang.Exception:
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd] :
URI is not absolute
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.ingestProduct(XmlRpcFileManagerClient.java:1304)
at
org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction.execute(IngestProductCliAction.java:113)
at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:331)
at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFileManagerClient.java:1350)
ERROR: Failed to ingest product 'blah.txt' : Failed to ingest product
[org.apache.oodt.cas.filemgr.structs.Product@a2431d0] :
java.lang.Exception:
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd] :
URI is not absolute
[1] https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide
--
Regards
W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering
University of Moratuwa, Sri Lanka
Re: File Manager - Error in ingeting a file to server
Posted by DImuthu Upeksha <di...@gmail.com>.
Fixed.
In product-types.xml I have put repository path as <repository path=
"/var/archive/data"/>. It should be <repository path=
"file:///var/archive/data"/>
On Fri, Jul 31, 2015 at 3:32 PM, DImuthu Upeksha <dimuthu.upeksha2@gmail.com
> wrote:
> Hi all,
>
> I followed the tutorial [1] about OODT file server and managed to
> configure and start on the port 9000. Then I sent following request to
> ingest a file
>
> ./filemgr-client --url http://localhost:9000 --operation --ingestProduct
> --productName blah.txt --productStructure Flat --productTypeName
> GenericFile --metadataFile file:///tmp/blah.txt.met --refs
> file:///tmp/blah.txt
>
> As response I get following error. What could be the reason for this error?
>
> Jul 30, 2015 11:36:36 AM
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
>
> INFO: Loading File Manager Configuration Properties from:
> [../etc/filemgr.properties]
>
> Jul 30, 2015 11:36:37 AM
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
>
> INFO: Running Met Extractor:
> [org.apache.oodt.cas.filemgr.metadata.extractors.CoreMetExtractor] for
> product type: [GenericFile]
>
> Jul 30, 2015 11:36:37 AM
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
>
> INFO: Running Met Extractor:
> [org.apache.oodt.cas.filemgr.metadata.extractors.examples.MimeTypeExtractor]
> for product type: [GenericFile]
>
> Jul 30, 2015 11:36:37 AM
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
>
> INFO: Running Met Extractor:
> [org.apache.oodt.cas.filemgr.metadata.extractors.examples.FinalFileLocationExtractor]
> for product type: [GenericFile]
>
> java.lang.IllegalArgumentException: URI is not absolute
>
> at java.io.File.<init>(File.java:416)
>
> at
> org.apache.oodt.cas.filemgr.versioning.VersioningUtils.createBasicDataStoreRefsFlat(VersioningUtils.java:219)
>
> at
> org.apache.oodt.cas.filemgr.versioning.BasicVersioner.createDataStoreReferences(BasicVersioner.java:123)
>
> at
> org.apache.oodt.cas.filemgr.metadata.extractors.examples.FinalFileLocationExtractor.doExtract(FinalFileLocationExtractor.java:80)
>
> at
> org.apache.oodt.cas.filemgr.metadata.extractors.AbstractFilemgrMetExtractor.extractMetadata(AbstractFilemgrMetExtractor.java:57)
>
> at
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.runExtractors(XmlRpcFileManager.java:1111)
>
> at
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.addMetadata(XmlRpcFileManager.java:1065)
>
> at
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.ingestProduct(XmlRpcFileManager.java:722)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:497)
>
> at org.apache.xmlrpc.Invoker.execute(Invoker.java:130)
>
> at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84)
>
> at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146)
>
> at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139)
>
> at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125)
>
> at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761)
>
> at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642)
>
> at java.lang.Thread.run(Thread.java:745)
>
> org.apache.xmlrpc.XmlRpcException: java.lang.Exception:
> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
> ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd]
> : URI is not absolute
>
> at
> org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcClientResponseProcessor.java:104)
>
> at
> org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClientResponseProcessor.java:71)
>
> at org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73)
>
> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194)
>
> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185)
>
> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178)
>
> at
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.ingestProduct(XmlRpcFileManagerClient.java:1198)
>
> at
> org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction.execute(IngestProductCliAction.java:113)
>
> at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:331)
>
> at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
>
> at
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFileManagerClient.java:1350)
>
> Jul 30, 2015 11:36:37 AM
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient ingestProduct
>
> SEVERE: Failed to ingest product
> [org.apache.oodt.cas.filemgr.structs.Product@a2431d0] :
> java.lang.Exception:
> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
> ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd]
> : URI is not absolute -- rolling back ingest
>
> Jul 30, 2015 11:36:37 AM org.apache.oodt.cas.filemgr.catalog.LuceneCatalog
> removeProductDocument
>
> FINE: LuceneCatalog: remove document from index for product: [null]
>
> java.lang.Exception: Failed to ingest product
> [org.apache.oodt.cas.filemgr.structs.Product@a2431d0] :
> java.lang.Exception:
> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
> ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd]
> : URI is not absolute
>
> at
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.ingestProduct(XmlRpcFileManagerClient.java:1304)
>
> at
> org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction.execute(IngestProductCliAction.java:113)
>
> at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:331)
>
> at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
>
> at
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFileManagerClient.java:1350)
>
> ERROR: Failed to ingest product 'blah.txt' : Failed to ingest product
> [org.apache.oodt.cas.filemgr.structs.Product@a2431d0] :
> java.lang.Exception:
> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
> ingesting product [org.apache.oodt.cas.filemgr.structs.Product@77b774dd]
> : URI is not absolute
>
> [1]
> https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide
>
> --
> Regards
>
> W.Dimuthu Upeksha
> Undergraduate
> Department of Computer Science And Engineering
>
> University of Moratuwa, Sri Lanka
>
--
Regards
W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering
University of Moratuwa, Sri Lanka