You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zy-kkk (via GitHub)" <gi...@apache.org> on 2023/08/02 08:36:07 UTC
[GitHub] [doris] zy-kkk opened a new pull request, #22498: [improvement](jdbc-catalog) Add Connection Keepalive and Detailed Error Messaging for Druid Pool in FE
zy-kkk opened a new pull request, #22498:
URL: https://github.com/apache/doris/pull/22498
## Proposed changes
Issue Number: close #xxx
In this PR, we've made improvements to the JDBC Catalog in the Frontend (FE) of Doris, specifically when connecting to the JDBC Catalog via the Druid connection pool.
Changes include:
1. **Connection Keepalive Mechanism**: We've added a connection keepalive mechanism to the Druid connection pool to prevent connections from becoming inactive during long periods of inactivity. This is achieved by setting a validation query that is executed periodically on idle connections. The queries are database-specific (Oracle, SAP HANA, etc.) to ensure compatibility.
2. **Detailed Error Messaging**: We've improved error messaging by throwing more specific exceptions when a connection error occurs in the Druid connection pool. This change will provide more detailed error messages, aiding in understanding and debugging connection-related issues.
These improvements will make the JDBC Catalog more robust and easier to maintain, particularly in scenarios where connections in the Druid connection pool are expected to be idle for extended periods of time.
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22498: [improvement](jdbc-catalog) Add Connection Keepalive and Detailed Error Messaging for Druid Pool in FE
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #22498:
URL: https://github.com/apache/doris/pull/22498#issuecomment-1661845398
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.62 seconds
stream load tsv: 546 seconds loaded 74807831229 Bytes, about 130 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.3 seconds inserted 10000000 Rows, about 341K ops/s
storage size: 17161952482 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] zy-kkk closed pull request #22498: [improvement](jdbc-catalog) Add Connection Keepalive and Detailed Error Messaging for Druid Pool in FE
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk closed pull request #22498: [improvement](jdbc-catalog) Add Connection Keepalive and Detailed Error Messaging for Druid Pool in FE
URL: https://github.com/apache/doris/pull/22498
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] zy-kkk commented on pull request #22498: [improvement](jdbc-catalog) Add Connection Keepalive and Detailed Error Messaging for Druid Pool in FE
Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #22498:
URL: https://github.com/apache/doris/pull/22498#issuecomment-1661755111
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org