You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zhengshubin (via GitHub)" <gi...@apache.org> on 2023/01/26 07:57:14 UTC
[GitHub] [doris] zhengshubin opened a new issue, #16142: [Bug] be dead when execute hive catalog dml
zhengshubin opened a new issue, #16142:
URL: https://github.com/apache/doris/issues/16142
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
hive 3.1.3 doris 1.2.1
### What's Wrong?
I had create hive catalog like this:
CREATE RESOURCE hms_resource PROPERTIES (
'type'='hms',
'hive.metastore.uris' = 'thrift://ip:9083',
'hadoop.username' = 'web',
'dfs.nameservices'='cluster01',
'dfs.ha.namenodes.cluster01'='nn1,nn2',
'dfs.namenode.rpc-address.cluster01.nn1'='ip:8020',
'dfs.namenode.rpc-address.cluster01.nn2'='ip:8020',
'dfs.client.failover.proxy.provider.cluster01'='org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider'
);
CREATE CATALOG hive WITH RESOURCE hms_resource;
use hive.`default`;
When I use like show tables,it work. But when I use dml like :
SELECT count(1) FROM ms_3;
The one of the be would dead.
FE.WARN.log :
2023-01-26 14:36:15,089 WARN (heartbeat-mgr-pool-0|102) [HeartbeatMgr$BackendHeartbeatHandler.call():268] backend heartbeat got exception
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.doris.thrift.HeartbeatService$Client.recvHeartbeat(HeartbeatService.java:61) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.doris.thrift.HeartbeatService$Client.heartbeat(HeartbeatService.java:48) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.doris.system.HeartbeatMgr$BackendHeartbeatHandler.call(HeartbeatMgr.java:226) ~[doris-fe.jar:1.0-SNAPSHOT]
at org.apache.doris.system.HeartbeatMgr$BackendHeartbeatHandler.call(HeartbeatMgr.java:203) ~[doris-fe.jar:1.0-SNAPSHOT]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_282]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_282]
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[?:1.8.0_282]
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) ~[?:1.8.0_282]
at java.net.SocketInputStream.read(SocketInputStream.java:171) ~[?:1.8.0_282]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0_282]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) ~[?:1.8.0_282]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) ~[?:1.8.0_282]
at java.io.BufferedInputStream.read(BufferedInputStream.java:345) ~[?:1.8.0_282]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:125) ~[spark-dpp-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
... 13 more
2023-01-26 14:36:15,092 WARN (heartbeat mgr|31) [HeartbeatMgr.runAfterCatalogReady():139] get bad heartbeat response: type: BACKEND, status: BAD, msg: java.net.SocketTimeoutException: Read timed out, beId: 16006, beHost: 1.2.3.4, bePort: 0, httpPort: 0, brpcPort: 0
### What You Expected?
BE don't dead whether hive catalog dml execute successfully or not
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] lorenking commented on issue #16142: [Bug] be dead when execute hive catalog dml
Posted by "lorenking (via GitHub)" <gi...@apache.org>.
lorenking commented on issue #16142:
URL: https://github.com/apache/doris/issues/16142#issuecomment-1588440750
问题解决了吗？我也是一样的问题，我的doris版本是1.2，执行 查询就报错：
ERROR 1105 (HY000): errCode = 2, detailMessage = failed to init reader for file /usr/hive/warehouse/ads_dev.db/ads_wms_count/data_dt=2021-01/000000_0, err: Seek to offset failed. (BE: 192.168.21.24) offset=3, err: (errno: 22) Invalid argument
而且我的 show create catalog hive；命令执行就报错
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org