You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "qian0817 (via GitHub)" <gi...@apache.org> on 2024/01/18 09:04:02 UTC
[I] [Bug] 查询 Hive 外表时出现 Invalid data 错误 [doris]
qian0817 opened a new issue, #30106:
URL: https://github.com/apache/doris/issues/30106
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
doris-2.0.4-rc02-e529646
### What's Wrong?
When querying the hive external table, an "Invalid data" error occurs.
```text
java.sql.SQLException: errCode = 2, detailMessage = (10.196.150.125)[CANCELLED][INTERNAL_ERROR]Couldn't deserialize thrift msg:
TProtocolException: Invalid data
0# doris::Status doris::deserialize_thrift_msg<tparquet::ColumnIndex>(unsigned char const*, unsigned int*, bool, tparquet::ColumnIndex*) at /root/src/doris-2.0/be/src/util/t
hrift_util.h:153
1# doris::vectorized::PageIndex::parse_column_index(tparquet::ColumnChunk const&, unsigned char const*, tparquet::ColumnIndex*) at /root/src/doris-2.0/be/src/common/status.h
:443
2# doris::vectorized::ParquetReader::_process_page_index(tparquet::RowGroup const&, std::vector<doris::vectorized::RowRange, std::allocator<doris::vectorized::RowRange> >&)
at /root/src/doris-2.0/be/src/common/status.h:443
3# doris::vectorized::ParquetReader::_next_row_group_reader() at /root/src/doris-2.0/be/src/common/status.h:443
4# doris::vectorized::ParquetReader::get_next_block(doris::vectorized::Block*, unsigned long*, bool*) at /root/src/doris-2.0/be/src/common/status.h:443
5# doris::vectorized::VFileScanner::_get_block_impl(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /root/src/doris-2.0/be/src/common/status.h:443
6# doris::vectorized::VScanner::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /root/src/doris-2.0/be/src/vec/exec/scan/vscanner.cpp:0
7# doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler*, doris::vectorized::ScannerContext*, std::shared_ptr<doris::vectorized::VScanner>)
at /root/src/doris-2.0/be/src/common/status.h:355
8# std::_Function_handler<void (), doris::vectorized::ScannerScheduler::_schedule_scanners(doris::vectorized::ScannerContext*)::$_1::operator()() const::{lambda()#4}>::_M_in
voke(std::_Any_data const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
9# doris::WorkThreadPool<true>::work_thread(int) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/atomic_base.h:646
10# execute_native_thread_routine at /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:85
11# start_thread
12# clone
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130) ~[mysql-connector-j-8.0.33.jar!/:8.0.33]
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) ~[mysql-connector-j-8.0.33.jar!/:8.0.33]
at com.mysql.cj.jdbc.StatementImpl.executeQuery(StatementImpl.java:1200) ~[mysql-connector-j-8.0.33.jar!/:8.0.33]
```
The structure of the SQL is as follows:
```sql
select col1,col2
from tbl1
where col3='xxx'
group by col1,col2;
```
This error seems to only occur on some tables, and running similar SQL on other tables does not result in an error.
### What You Expected?
There will be no query errors.
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] When querying the Hive external table, an Invalid data error occurred. [doris]
Posted by "qian0817 (via GitHub)" <gi...@apache.org>.
qian0817 commented on issue #30106:
URL: https://github.com/apache/doris/issues/30106#issuecomment-1903522749
> is 2.0.3 OK?
This issue existed in 2.0.3, but looks to have been fixed by #28891.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] When querying the Hive external table, an Invalid data error occurred. [doris]
Posted by "LemonLiTree (via GitHub)" <gi...@apache.org>.
LemonLiTree commented on issue #30106:
URL: https://github.com/apache/doris/issues/30106#issuecomment-1899912244
is 2.0.3 OK?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] When querying the Hive external table, an Invalid data error occurred. [doris]
Posted by "qian0817 (via GitHub)" <gi...@apache.org>.
qian0817 commented on issue #30106:
URL: https://github.com/apache/doris/issues/30106#issuecomment-1898072516
After removing the where condition in the SQL, the error changed to
```text
ERROR 1105 (HY000): errCode = 2, detailMessage = (10.196.150.130)[CANCELLED][INTERNAL_ERROR]Read parquet file hdfs://xxx/.../day=xxx/000001_0 failed, reason = [IO_ERROR]Failed to deserialize parquet page header. offset: 1193158, header size: 1444553, end offset: 2637711, real header size: 1444553
0# doris::vectorized::PageReader::next_page_header() at /root/src/doris-2.0/be/src/common/status.h:378
1# doris::vectorized::ColumnChunkReader::
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] When querying the Hive external table, an Invalid data error occurred. [doris]
Posted by "qian0817 (via GitHub)" <gi...@apache.org>.
qian0817 closed issue #30106: [Bug] When querying the Hive external table, an Invalid data error occurred.
URL: https://github.com/apache/doris/issues/30106
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org