You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/06/25 07:55:00 UTC

[jira] [Created] (IOTDB-3652) ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:194 - can't connect to node TEndPoint(ip:172.20.70.16, port:9003)

刘珍 created IOTDB-3652:
-------------------------

             Summary: ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:194 - can't connect to node TEndPoint(ip:172.20.70.16, port:9003)
                 Key: IOTDB-3652
                 URL: https://issues.apache.org/jira/browse/IOTDB-3652
             Project: Apache IoTDB
          Issue Type: Bug
          Components: mpp-cluster
    Affects Versions: 0.14.0-SNAPSHOT
            Reporter: 刘珍
            Assignee: Jinrui Zhang
         Attachments: config.properties, ip13_log-all-20220625.0.log.gz, ip14_log-all-20220625.0.log.gz, ip16_log_all.log.gz

StandAloneConsensus,3C3D
详细日志,bm配置见附件
2022-06-25 15:50:27,325 [20220625_075027_55415_5-204] ERROR o.a.i.d.m.p.s.ClusterScheduler:102 - dispatch failed.
2022-06-25 15:50:27,329 [20220625_075027_55416_5.1.0-178] ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:194 - can't connec
t to node TEndPoint(ip:172.20.70.16, port:9003)
java.io.IOException: Borrow client from pool for node TEndPoint(ip:172.20.70.16, port:9003) failed.
        at org.apache.iotdb.commons.client.ClientManager.borrowClient(ClientManager.java:61)
        at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchRemote(FragmentInstanceDispatcherImpl.
java:175)
        at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchOneInstance(FragmentInstanceDispatcher
Impl.java:163)
        at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchWriteSync(FragmentInstanceDispatcherIm
pl.java:144)
        at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatch(FragmentInstanceDispatcherImpl.java:9
3)
        at org.apache.iotdb.db.mpp.plan.scheduler.ClusterScheduler.start(ClusterScheduler.java:95)
        at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.schedule(QueryExecution.java:215)
        at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.start(QueryExecution.java:169)
        at org.apache.iotdb.db.mpp.plan.Coordinator.execute(Coordinator.java:131)
        at org.apache.iotdb.db.service.thrift.impl.DataNodeTSIServiceImpl.insertTablet(DataNodeTSIServiceImpl.java:911)
        at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$insertTablet.getResult(TSIService.java:3328)
        at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$insertTablet.getResult(TSIService.java:3308)
        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: net.sf.cglib.core.CodeGenerationException: org.apache.thrift.transport.TTransportException-->java.net.ConnectExcepti
on: Connection refused (Connection refused)
        at net.sf.cglib.core.ReflectUtils.newInstance(ReflectUtils.java:235)
        at net.sf.cglib.core.ReflectUtils.newInstance(ReflectUtils.java:220)
        at net.sf.cglib.proxy.Enhancer.createUsingReflection(Enhancer.java:639)
        at net.sf.cglib.proxy.Enhancer.firstInstance(Enhancer.java:538)
        at net.sf.cglib.core.AbstractClassGenerator.create(AbstractClassGenerator.java:231)
        at net.sf.cglib.proxy.Enhancer.createHelper(Enhancer.java:377)
        at net.sf.cglib.proxy.Enhancer.create(Enhancer.java:304)
        at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.newErrorHandler(SyncThriftClientWithErrorHandl
er.java:48)
        at org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$Factory.makeObject(SyncDataNodeInternalServic
eClient.java:127)
        at org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$Factory.makeObject(SyncDataNodeInternalServic
eClient.java:105)
        at org.apache.commons.pool2.impl.GenericKeyedObjectPool.create(GenericKeyedObjectPool.java:780)
        at org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:439)
        at org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:350)
        at org.apache.iotdb.commons.client.ClientManager.borrowClient(ClientManager.java:50)
        ... 17 common frames omitted
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
        at org.apache.thrift.transport.TSocket.open(TSocket.java:243)
        at org.apache.iotdb.rpc.TElasticFramedTransport.open(TElasticFramedTransport.java:91)
        at org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient.<init>(SyncDataNodeInternalServiceClient.java
:63)
        at org.apache.iotdb.commons.client.sync.SyncDataNodeInternalServiceClient$$EnhancerByCGLIB$$1eb1dc11.<init>(<generated>
)
        at sun.reflect.GeneratedConstructorAccessor11.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at net.sf.cglib.core.ReflectUtils.newInstance(ReflectUtils.java:228)
        ... 30 common frames omitted
Caused by: java.net.ConnectException: Connection refused (Connection refused)
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at org.apache.thrift.transport.TSocket.open(TSocket.java:238)
        ... 37 common frames omitted


1. 机器环境 私有云
172.20.70.13,172.20.70.16,172.20.70.14

8C32G



--
This message was sent by Atlassian Jira
(v8.20.7#820007)