You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "LYL41011 (via GitHub)" <gi...@apache.org> on 2023/03/24 03:09:52 UTC
[GitHub] [incubator-seatunnel] LYL41011 opened a new issue, #4408: [Bug] [clickhouse source] Unsupported data type data type in array is not supported
LYL41011 opened a new issue, #4408:
URL: https://github.com/apache/incubator-seatunnel/issues/4408
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
I want to synchronize clickhouse data to hive.
Some fields in the clickhouse table are **Array (Date),**
and an error is reported after running 。**data type in array is not supported.**
By looking up the source code, I found that an exception
`thrownew ClickhouseConnectorException (CommonErrorCode.UNSUPPORTED_DATA_TYPE, "data type in array is not supported:"+subArrayDataType. getDataType()) `
was directly thrown in the **TypeConvertUtil** class;
Can you support this type?Thanks
### SeaTunnel Version
2.3.0release
### SeaTunnel Config
```conf
env {
execution.parallelism = 1
job.mode = "STREAMING"
}
source {
Clickhouse {
host = "10.220.171.9:8123"
database = "dist"
sql = "select soon_appl_date,'2022-03-21' as partitions from dist.ics_ln_loan limit 10"
username = "default"
password = "6lYaUiFi"
result_table_name = "test"
}
}
transform {
}
sink {
# choose stdout output plugin to output data to console
Hive {
kerberos.enable="N"
table_name = "ods_tmp.test_seatunnel_sink"
metastore_uri = "thrift://p71368v.hulk.bjmd.qihoo.net:9083"
partition_by = ["partitions"]
sink_columns = ["soon_appl_date", "partitions"]
}
}
```
### Running Command
```shell
bin/start-seatunnel-flink-connector-v2.sh --config ./config/flink.ck2hive.batch.conf.template
```
### Error Exception
```log
data type in array is not supported.
```
### Flink or Spark Version
Flink1.13.6release
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #4408: [Bug] [clickhouse source] Unsupported data type data type in array is not supported
Posted by "MonsterChenzhuo (via GitHub)" <gi...@apache.org>.
MonsterChenzhuo commented on issue #4408:
URL: https://github.com/apache/incubator-seatunnel/issues/4408#issuecomment-1482207487
please assign to me; thx。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4408: [Bug] [clickhouse source] Unsupported array data type
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4408:
URL: https://github.com/apache/incubator-seatunnel/issues/4408#issuecomment-1524280702
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org