You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "smileLuckBoy (via GitHub)" <gi...@apache.org> on 2024/06/13 07:24:18 UTC
[I] [Bug] [Module Name] Clickhouse remote function not work as well [dolphinscheduler]
smileLuckBoy opened a new issue, #16146:
URL: https://github.com/apache/dolphinscheduler/issues/16146
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
I use clickhouse function remote to sync remote table data into local clickhouse , but the count of remote table is not equals as local table , the sql just like
insert into dim_call_task select * from remote('host:9000','db','table','userName','password')
### What you expected to happen
the count of remote table is equals as local table
### How to reproduce
version 3.2.1 ，Deploy using docker
there should be two clickhouse ,they have same table A
then use the taskType SQL , and choose databaseType clickhouse
and then fill the clickhouse insert remote script
### Anything else
_No response_
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] Clickhouse remote function not work as well [dolphinscheduler]
Posted by "smileLuckBoy (via GitHub)" <gi...@apache.org>.
smileLuckBoy commented on issue #16146:
URL: https://github.com/apache/dolphinscheduler/issues/16146#issuecomment-2165409804
the max row of sync data is 16384
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] Clickhouse remote function not work as well [dolphinscheduler]
Posted by "smileLuckBoy (via GitHub)" <gi...@apache.org>.
smileLuckBoy commented on issue #16146:
URL: https://github.com/apache/dolphinscheduler/issues/16146#issuecomment-2167608373
fix, add SETTINGS max_result_rows=0 config after insert remote sql
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] Clickhouse remote function not work as well [dolphinscheduler]
Posted by "smileLuckBoy (via GitHub)" <gi...@apache.org>.
smileLuckBoy commented on issue #16146:
URL: https://github.com/apache/dolphinscheduler/issues/16146#issuecomment-2164832788
the version of clickhouse-jdbc in dolphinscheduler is 0.4.6 (I found it in the dir /opt/dolphinscheduler/libs/worker-server),
I use this version jar to test the clickhouse remote function, and it work well
but the dolphinscheduler work not well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] Clickhouse remote function not work as well [dolphinscheduler]
Posted by "smileLuckBoy (via GitHub)" <gi...@apache.org>.
smileLuckBoy closed issue #16146: [Bug] [Task] Clickhouse remote function not work as well
URL: https://github.com/apache/dolphinscheduler/issues/16146
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org