You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@oodt.apache.org by "Lewis John McGibbney (JIRA)" <ji...@apache.org> on 2015/09/03 09:05:45 UTC
[jira] [Commented] (OODT-858) Integrate Avro RPC with the
filemanager module
[ https://issues.apache.org/jira/browse/OODT-858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728590#comment-14728590 ]
Lewis John McGibbney commented on OODT-858:
-------------------------------------------
Hi [~radu.manole] I've pulled the most recent patch on https://reviews.apache.org/r/36953/ and would like to merge it in to the avro_rpc branch however testing locally is unsuccessful. In particular TestXmlRpcFileManager fails.
I see that by default RpcCommunicationFactory specifies the FileManagerServer and FileManagerClient as AvroRPC now by default. I wonder if you can revert this to XMLRPC implementations until people have mad more time to test this out? Right now for example filemgr.properties contains configuration key value properties relating to AvroRPC as well as a number of other classes which simply remove and replace XMLRPC instead of deprecating it then replacing it. We will ideally work with the latter scenario before having AvroRPC as the main implementation say around 0.12 release.
Can you please have a look at this?
{code}
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
java.net.SocketTimeoutException: Read timed out
org.apache.oodt.cas.filemgr.structs.exceptions.ConnectionException: Exception connecting to filemgr: [http://localhost:50001]
at org.apache.oodt.cas.filemgr.system.AvroFileManagerClient.<init>(AvroFileManagerClient.java:101)
at org.apache.oodt.cas.filemgr.system.rpc.AvroFileManagerClientFactory.createFileManagerClient(AvroFileManagerClientFactory.java:59)
at org.apache.oodt.cas.filemgr.util.RpcCommunicationFactory.createClient(RpcCommunicationFactory.java:83)
at org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferer.setFileManagerUrl(LocalDataTransferer.java:86)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.loadConfiguration(XmlRpcFileManager.java:1362)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.<init>(XmlRpcFileManager.java:136)
at org.apache.oodt.cas.filemgr.system.TestXmlRpcFileManager.startXmlRpcFileManager(TestXmlRpcFileManager.java:295)
at org.apache.oodt.cas.filemgr.system.TestXmlRpcFileManager.setUp(TestXmlRpcFileManager.java:173)
at junit.framework.TestCase.runBare(TestCase.java:128)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:120)
at junit.framework.TestSuite.runTest(TestSuite.java:230)
at junit.framework.TestSuite.run(TestSuite.java:225)
at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
java.net.SocketTimeoutException: Read timed out
org.apache.oodt.cas.filemgr.structs.exceptions.ConnectionException: Exception connecting to filemgr: [http://localhost:50001]
at org.apache.oodt.cas.filemgr.system.AvroFileManagerClient.<init>(AvroFileManagerClient.java:101)
at org.apache.oodt.cas.filemgr.system.rpc.AvroFileManagerClientFactory.createFileManagerClient(AvroFileManagerClientFactory.java:59)
at org.apache.oodt.cas.filemgr.util.RpcCommunicationFactory.createClient(RpcCommunicationFactory.java:83)
at org.apache.oodt.cas.filemgr.ingest.StdIngester.setFileManager(StdIngester.java:257)
at org.apache.oodt.cas.filemgr.ingest.StdIngester.checkOrSetFileManager(StdIngester.java:251)
at org.apache.oodt.cas.filemgr.ingest.StdIngester.ingest(StdIngester.java:153)
at org.apache.oodt.cas.filemgr.system.TestXmlRpcFileManager.ingestTestFile(TestXmlRpcFileManager.java:227)
at org.apache.oodt.cas.filemgr.system.TestXmlRpcFileManager.setUp(TestXmlRpcFileManager.java:174)
at junit.framework.TestCase.runBare(TestCase.java:128)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:120)
at junit.framework.TestSuite.runTest(TestSuite.java:230)
at junit.framework.TestSuite.run(TestSuite.java:225)
at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
{code}
> Integrate Avro RPC with the filemanager module
> ----------------------------------------------
>
> Key: OODT-858
> URL: https://issues.apache.org/jira/browse/OODT-858
> Project: OODT
> Issue Type: Sub-task
> Components: file manager
> Reporter: Radu Manole
> Assignee: Radu Manole
> Fix For: 0.11
>
>
> Create avro types for the objects transmitted to the FileManager server though RPC.
> Integrate Avro with the existing FileManager and FileManagerClient.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)