You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by "Mazoyer, Frantz" <fr...@hp.com> on 2014/03/20 16:33:50 UTC

org.apache.thrift7.transport.TTransportException at deployment - Looking for archives of issue

Hello storm users,

I've recently run into the following issue upon deployment of a topology:
Internal error (system details org.apache.thrift7.transport.TTransportException)

Looking through the known issues, I found that an old issue was logged, pointing to:
https://github.com/nathanmarz/storm/issues/92<https://www.google.com/url?q=https%3A%2F%2Fgithub.com%2Fnathanmarz%2Fstorm%2Fissues%2F92&sa=D&sntz=1&usg=AFQjCNEMujgWtNjoyqUKKE7NdhpTlH61Bw>

(ref : https://groups.google.com/forum/#!topic/storm-user/8zBVakyTnJY)

Which is a dead link.

Could you tell me where I can find a history of the old issues, or better yet tell me what causes this problem ?

Thanks a lot for your help :)

Kind regards,
Frantz

Full stack trace:

Internal error (system details org.apache.thrift7.transport.TTransportException)
...
Caused by: java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException
               at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:94)
               at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:40)
               at com.hp.cae.cep.engine.TopologyJobUnit.initialize(TopologyJobUnit.java:94)
               at com.hp.cae.dal.engine.AnalysisJobUnit.run(AnalysisJobUnit.java:187)
               at com.hp.cae.dal.engine.impl.AbstractJobUnitStarter.startJob(AbstractJobUnitStarter.java:183)
               at com.hp.cae.dal.engine.impl.CompositeJobUnitStarter.started(CompositeJobUnitStarter.java:198)
               at com.hp.cae.dal.engine.impl.AbstractStarter.start(AbstractStarter.java:394)
               at com.hp.cae.cep.engine.CepTopologyLauncher.launch(CepTopologyLauncher.java:226)
               ... 10 more
Caused by: org.apache.thrift7.transport.TTransportException
               at org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
               at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
               at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
               at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
               at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
               at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
               at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
               at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
               at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
               at backtype.storm.generated.Nimbus$Client.recv_submitTopology(Nimbus.java:145)
               at backtype.storm.generated.Nimbus$Client.submitTopology(Nimbus.java:129)
               at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:80)
               ... 17 more


RE: org.apache.thrift7.transport.TTransportException at deployment - Looking for archives of issue

Posted by "Mazoyer, Frantz" <fr...@hp.com>.
Thanks a lot for your reply Adam.

On nimbus side, it looks like the stormjar never gets to the inbox; I checked that the directory under stormdist was indeed crated:

2014-03-21 13:29:40 nimbus [INFO] Received topology submission for test_topology with conf {"topology.max.task.parallelism" nil, "topology.acker.executors" 1, "topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name" "test_topology", "storm.id" "test_topology-4-1395404980", "topology.debug" false}
2014-03-21 13:29:40 nimbus [WARN] Topology submission exception. (topology name='test_topology') #<IllegalArgumentException java.lang.IllegalArgumentException: /test/storm//nimbus/inbox/stormjar-c75beeff-16fa-4175-8256-33ea2828fc68.jar to copy to /test/storm//nimbus/stormdist/test_topology-4-1395404980 does not exist!>
2014-03-21 13:29:40 TNonblockingServer [ERROR] Unexpected exception while invoking!
java.lang.IllegalArgumentException: /test/storm//nimbus/inbox/stormjar-c75beeff-16fa-4175-8256-33ea2828fc68.jar to copy to /test/storm//nimbus/stormdist/test_topology-4-1395404980 does not exist!
        at backtype.storm.daemon.nimbus$fn__3692.invoke(nimbus.clj:1133)
        at clojure.lang.MultiFn.invoke(MultiFn.java:172)
        at backtype.storm.daemon.nimbus$setup_storm_code.invoke(nimbus.clj:296)
        at backtype.storm.daemon.nimbus$fn__3592$exec_fn__1228__auto__$reify__3605.submitTopologyWithOpts(nimbus.clj:914)
        at backtype.storm.daemon.nimbus$fn__3592$exec_fn__1228__auto__$reify__3605.submitTopology(nimbus.clj:927)
        at backtype.storm.generated.Nimbus$Processor$submitTopology.getResult(Nimbus.java:1223)
        at backtype.storm.generated.Nimbus$Processor$submitTopology.getResult(Nimbus.java:1211)
        at org.apache.thrift7.ProcessFunction.process(ProcessFunction.java:32)
        at org.apache.thrift7.TBaseProcessor.process(TBaseProcessor.java:34)
        at org.apache.thrift7.server.TNonblockingServer$FrameBuffer.invoke(TNonblockingServer.java:632)
        at org.apache.thrift7.server.THsHaServer$Invocation.run(THsHaServer.java:201)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
2014-03-21 13:29:44 nimbus [INFO] Cleaning up test_topology-4-1395404980

Thanks again for your help :)
Frantz

De : supercargo@gmail.com [mailto:supercargo@gmail.com] De la part de Adam Lewis
Envoyé : jeudi 20 mars 2014 22:00
À : user
Objet : Re: org.apache.thrift7.transport.TTransportException at deployment - Looking for archives of issue

Are there any corresponding errors in the nimbus.log?

On Thu, Mar 20, 2014 at 11:33 AM, Mazoyer, Frantz <fr...@hp.com>> wrote:
Hello storm users,

I've recently run into the following issue upon deployment of a topology:
Internal error (system details org.apache.thrift7.transport.TTransportException)

Looking through the known issues, I found that an old issue was logged, pointing to:
https://github.com/nathanmarz/storm/issues/92<https://www.google.com/url?q=https%3A%2F%2Fgithub.com%2Fnathanmarz%2Fstorm%2Fissues%2F92&sa=D&sntz=1&usg=AFQjCNEMujgWtNjoyqUKKE7NdhpTlH61Bw>

(ref : https://groups.google.com/forum/#!topic/storm-user/8zBVakyTnJY)

Which is a dead link.

Could you tell me where I can find a history of the old issues, or better yet tell me what causes this problem ?

Thanks a lot for your help :)

Kind regards,
Frantz

Full stack trace:

Internal error (system details org.apache.thrift7.transport.TTransportException)
...
Caused by: java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException
               at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:94)
               at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:40)
               at com.hp.cae.cep.engine.TopologyJobUnit.initialize(TopologyJobUnit.java:94)
               at com.hp.cae.dal.engine.AnalysisJobUnit.run(AnalysisJobUnit.java:187)
               at com.hp.cae.dal.engine.impl.AbstractJobUnitStarter.startJob(AbstractJobUnitStarter.java:183)
               at com.hp.cae.dal.engine.impl.CompositeJobUnitStarter.started(CompositeJobUnitStarter.java:198)
               at com.hp.cae.dal.engine.impl.AbstractStarter.start(AbstractStarter.java:394)
               at com.hp.cae.cep.engine.CepTopologyLauncher.launch(CepTopologyLauncher.java:226)
               ... 10 more
Caused by: org.apache.thrift7.transport.TTransportException
               at org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
               at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
               at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
               at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
               at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
               at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
               at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
               at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
               at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
               at backtype.storm.generated.Nimbus$Client.recv_submitTopology(Nimbus.java:145)
               at backtype.storm.generated.Nimbus$Client.submitTopology(Nimbus.java:129)
               at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:80)
               ... 17 more



Re: org.apache.thrift7.transport.TTransportException at deployment - Looking for archives of issue

Posted by Adam Lewis <ma...@adamlewis.com>.
Are there any corresponding errors in the nimbus.log?


On Thu, Mar 20, 2014 at 11:33 AM, Mazoyer, Frantz <fr...@hp.com>wrote:

>  Hello storm users,
>
>
>
> I've recently run into the following issue upon deployment of a topology:
>
> Internal error (system details
> org.apache.thrift7.transport.TTransportException)
>
>
>
> Looking through the known issues, I found that an old issue was logged,
> pointing to:
>
> https://github.com/nathanmarz/storm/issues/92<https://www.google.com/url?q=https%3A%2F%2Fgithub.com%2Fnathanmarz%2Fstorm%2Fissues%2F92&sa=D&sntz=1&usg=AFQjCNEMujgWtNjoyqUKKE7NdhpTlH61Bw>
>
>
>
> (ref : https://groups.google.com/forum/#!topic/storm-user/8zBVakyTnJY)
>
>
>
> Which is a dead link.
>
>
>
> Could you tell me where I can find a history of the old issues, or better
> yet tell me what causes this problem ?
>
>
>
> Thanks a lot for your help J
>
>
>
> Kind regards,
>
> Frantz
>
>
>
> Full stack trace:
>
>
>
> Internal error (system details
> org.apache.thrift7.transport.TTransportException)
>
> ...
>
> Caused by: java.lang.RuntimeException:
> org.apache.thrift7.transport.TTransportException
>
>                at
> backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:94)
>
>                at
> backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:40)
>
>                at
> com.hp.cae.cep.engine.TopologyJobUnit.initialize(TopologyJobUnit.java:94)
>
>                at
> com.hp.cae.dal.engine.AnalysisJobUnit.run(AnalysisJobUnit.java:187)
>
>                at
> com.hp.cae.dal.engine.impl.AbstractJobUnitStarter.startJob(AbstractJobUnitStarter.java:183)
>
>                at
> com.hp.cae.dal.engine.impl.CompositeJobUnitStarter.started(CompositeJobUnitStarter.java:198)
>
>                at
> com.hp.cae.dal.engine.impl.AbstractStarter.start(AbstractStarter.java:394)
>
>                at
> com.hp.cae.cep.engine.CepTopologyLauncher.launch(CepTopologyLauncher.java:226)
>
>                ... 10 more
>
> Caused by: org.apache.thrift7.transport.TTransportException
>
>                at
> org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
>
>                at
> org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
>
>                at
> org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
>
>                at
> org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
>
>                at
> org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
>
>                at
> org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
>
>                at
> org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
>
>                at
> org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
>
>                at
> org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
>
>                at
> backtype.storm.generated.Nimbus$Client.recv_submitTopology(Nimbus.java:145)
>
>                at
> backtype.storm.generated.Nimbus$Client.submitTopology(Nimbus.java:129)
>
>                at
> backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:80)
>
>                ... 17 more
>
>
>