You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/12/23 11:40:05 UTC
[GitHub] [doris] xiaopoyu opened a new issue, #15327: [Bug] mysql external table, select be crash
xiaopoyu opened a new issue, #15327:
URL: https://github.com/apache/doris/issues/15327
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
doris 1.2.0
mysql 8.0.18-X-Cluster-1.0.8
### What's Wrong?
create mysql external table ,
select * from table_name_external
ERROR 1105 (HY000): RpcException, msg: org.apache.doris.rpc.RpcException: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason
### What You Expected?
select * rom table_name_external
### How to Reproduce?
CREATE EXTERNAL RESOURCE mysql_resource
properties (
"type"="jdbc",
"user"="root",
"password"="",
"jdbc_url"="jdbc:mysql://*:3306/new?characterEncoding=utf8&serverTimezone=Asia/Shanghai&useSSL=false",
"driver_url"="file:///opt/doris/connector/mysql-connector-java-8.0.21.jar",
"driver_class"="com.mysql.cj.jdbc.Driver"
);
CREATE EXTERNAL TABLE `doris_ods`.`table`(
`id` BIGINT ,
`order_sn` varchar(255) ,
`main_order_sn` varchar(255) ,
`merchant_id` BIGINT ,
`merchant_type` INT ,
`merchant_name` varchar(255) ,
`merchant_img` varchar(255) ,
`fee_ratio` decimal(10,2) ,
`company_id` BIGINT ,
`order_type` INT ,
`goods_spu_type` INT ,
`pay_type` INT ,
`pay_status` INT ,
`order_status` INT ,
`close_type` INT ,
`delivery_type` INT ,
`delivery_price` decimal(10,2) ,
`delivery_sn` varchar(255) ,
`order_time` DATETIME ,
`pay_time` DATETIME ,
`if_can_settlement` INT ,
`if_settlement` INT ,
`settlement_time` DATETIME ,
`finsh_time` DATETIME ,
`receive_address_id` BIGINT ,
`receive_address_snapshot` STRING ,
`receive_contact` varchar(255) ,
`receive_mobile` varchar(50) ,
`member_id` BIGINT ,
`mobile` varchar(255) ,
`recharge_mobile` varchar(255) ,
`member_name` varchar(255) ,
`remark` varchar(255) ,
`total_price` decimal(10,2) ,
`goods_price` decimal(10,2) ,
`discount_price` decimal(10,2) ,
`reserve_price` decimal(10,2) ,
`order_discount_quota` decimal(10,2) ,
`real_price` decimal(10,2) ,
`if_integral` TINYINT ,
`use_integral` decimal(10,2) ,
`callback_integral` decimal(10,2) ,
`callBack_integral_ratio` varchar(255) ,
`if_single_card` TINYINT ,
`use_single_card_amount` decimal(10,2) ,
`single_card_service_amount` decimal(10,2) ,
`if_overseas_tao` INT ,
`real_name_authentication_id` BIGINT ,
`single_card_delivery_fee` decimal(10,2) ,
`integral_delivery_fee` decimal(10,2) ,
`cash_delivery_fee` decimal(10,2) ,
`pay_discount_quota` decimal(10,0) ,
`if_bill` INT ,
`unit` INT ,
`activity_type` INT ,
`activity_name` varchar(64) ,
`source` INT ,
`coupon_code` varchar(255) ,
`coupon_amount` varchar(255) ,
`coupon_id` INT ,
`activity_id` INT ,
`channel_id` INT ,
`delete_status` INT ,
`recharge_status` INT ,
`sign_id` varchar(255) ,
`platform_id` INT ,
`merchant_remark` varchar(255) ,
`create_time` DATETIME ,
`creater` varchar(255) ,
`update_time` DATETIME ,
`updator` varchar(255) ,
) ENGINE=JDBC
PROPERTIES(
"resource" = "mysql_resource",
"database" = "mysql",
"table" = "table",
"table_type"="mysql",
"charset" = "utf8mb4"
);
select * from table limit 1;
ERROR 1105 (HY000): RpcException, msg: org.apache.doris.rpc.RpcException: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason
be.out
ERROR StatusLogger Unrecognized format specifier [d]
ERROR StatusLogger Unrecognized conversion specifier [d] starting at position 16 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [thread]
ERROR StatusLogger Unrecognized conversion specifier [thread] starting at position 25 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [level]
ERROR StatusLogger Unrecognized conversion specifier [level] starting at position 35 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [logger]
ERROR StatusLogger Unrecognized conversion specifier [logger] starting at position 47 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [msg]
ERROR StatusLogger Unrecognized conversion specifier [msg] starting at position 54 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [n]
ERROR StatusLogger Unrecognized conversion specifier [n] starting at position 56 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [d]
ERROR StatusLogger Unrecognized conversion specifier [d] starting at position 16 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [thread]
ERROR StatusLogger Unrecognized conversion specifier [thread] starting at position 25 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [level]
ERROR StatusLogger Unrecognized conversion specifier [level] starting at position 35 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [logger]
ERROR StatusLogger Unrecognized conversion specifier [logger] starting at position 47 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [msg]
ERROR StatusLogger Unrecognized conversion specifier [msg] starting at position 54 in conversion pattern.
ERROR StatusLogger Unrecognized format specifier [n]
ERROR StatusLogger Unrecognized conversion specifier [n] starting at position 56 in conversion pattern.
*** Query id: 0-0 ***
*** Aborted at 1671794326 (unix time) try "date -d @1671794326" if you are using GNU date ***
*** Current BE git commitID: Unknown ***
*** SIGSEGV address not mapped to object (@0x1800000035) received by PID 2897 (TID 0x7f08a3de6700) from PID 53; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
1# os::Linux::chained_handler(int, siginfo*, void*) in /opt/jdk1.8.0_311/jre/lib/amd64/server/libjvm.so
2# JVM_handle_linux_signal in /opt/jdk1.8.0_311/jre/lib/amd64/server/libjvm.so
3# signalHandler(int, siginfo*, void*) in /opt/jdk1.8.0_311/jre/lib/amd64/server/libjvm.so
4# 0x00007F0910604400 in /lib64/libc.so.6
5# Fingerprinter::Fingerprinter(methodHandle) in /opt/jdk1.8.0_311/jre/lib/amd64/server/libjvm.so
6# jni_invoke_nonstatic(JNIEnv_*, JavaValue*, _jobject*, JNICallType, _jmethodID*, JNI_ArgumentPusher*, Thread*) [clone .constprop.111] in /opt/jdk1.8.0_311/jre/lib/amd64/server/libjvm.so
7# jni_CallByteMethodV in /opt/jdk1.8.0_311/jre/lib/amd64/server/libjvm.so
8# JNIEnv_::CallByteMethod(_jobject*, _jmethodID*, ...) at /usr/lib/jvm/java-1.8.0/include/jni.h:939
9# doris::vectorized::JdbcConnector::_convert_column_data(JNIEnv_*, _jobject*, doris::SlotDescriptor const*, doris::vectorized::IColumn*) at /root/doris/be/src/vec/exec/vjdbc_connector.cpp:291
10# doris::vectorized::JdbcConnector::get_next(bool*, std::vector<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>, std::allocator<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn> > >&, int) at /root/doris/be/src/vec/exec/vjdbc_connector.cpp:210
11# doris::vectorized::NewJdbcScanner::_get_block_impl(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /root/doris/be/src/vec/exec/scan/new_jdbc_scanner.cpp:120
12# doris::vectorized::VScanner::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /root/doris/be/src/vec/exec/scan/vscanner.cpp:53
13# doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler*, doris::vectorized::ScannerContext*, doris::vectorized::VScanner*) at /root/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:236
14# doris::ThreadPool::dispatch_thread() at /root/doris/be/src/util/threadpool.cpp:542
15# doris::Thread::supervise_thread(void*) at /root/doris/be/src/util/thread.cpp:455
16# start_thread in /lib64/libpthread.so.0
17# clone in /lib64/libc.so.6
### Anything Else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] zhangstar333 commented on issue #15327: [Bug] mysql external table, select be crash
Posted by GitBox <gi...@apache.org>.
zhangstar333 commented on issue #15327:
URL: https://github.com/apache/doris/issues/15327#issuecomment-1367278448
mysql tinyint(1) mapping to doris is boolean, use this type will be good
<img width="1681" alt="image" src="https://user-images.githubusercontent.com/87313068/209949639-7f6b4c16-c180-462b-9b55-f374e8e4a243.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] Yulei-Yang commented on issue #15327: [Bug] mysql external table, select be crash
Posted by GitBox <gi...@apache.org>.
Yulei-Yang commented on issue #15327:
URL: https://github.com/apache/doris/issues/15327#issuecomment-1364677312
can you please try to use mysql-connector-java-5.1.47.jar and tell us if this error happens again?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org