You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "LYL41011 (via GitHub)" <gi...@apache.org> on 2023/03/24 03:09:52 UTC

[GitHub] [incubator-seatunnel] LYL41011 opened a new issue, #4408: [Bug] [clickhouse source] Unsupported data type data type in array is not supported

LYL41011 opened a new issue, #4408:
URL: https://github.com/apache/incubator-seatunnel/issues/4408

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   I want to synchronize clickhouse data to hive. 
   Some fields in the clickhouse table are **Array (Date),** 
   and an error is reported after running 。**data type in array is not supported.**
   
   By looking up the source code, I found that an exception
    `thrownew ClickhouseConnectorException (CommonErrorCode.UNSUPPORTED_DATA_TYPE, "data type in array is not supported:"+subArrayDataType. getDataType()) ` 
   was directly thrown in the **TypeConvertUtil** class;
   
   Can you support this type?Thanks
   
   
   ### SeaTunnel Version
   
   2.3.0release
   
   ### SeaTunnel Config
   
   ```conf
   env {
     execution.parallelism = 1
     job.mode = "STREAMING"
   }
   
   source {
     
      Clickhouse {
       host = "10.220.171.9:8123"
       database = "dist"
       sql = "select soon_appl_date,'2022-03-21' as partitions from dist.ics_ln_loan  limit 10"
       username = "default"
       password = "6lYaUiFi"
       result_table_name = "test"
     } 
   }
   
   transform {
   
   }
   sink {
     # choose stdout output plugin to output data to console
   
     Hive {
       kerberos.enable="N"
       table_name = "ods_tmp.test_seatunnel_sink"
       metastore_uri = "thrift://p71368v.hulk.bjmd.qihoo.net:9083"
       partition_by = ["partitions"]
       sink_columns = ["soon_appl_date", "partitions"]
     }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   bin/start-seatunnel-flink-connector-v2.sh --config ./config/flink.ck2hive.batch.conf.template
   ```
   
   
   ### Error Exception
   
   ```log
   data type in array is not supported.
   ```
   
   
   ### Flink or Spark Version
   
   Flink1.13.6release
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #4408: [Bug] [clickhouse source] Unsupported data type data type in array is not supported

Posted by "MonsterChenzhuo (via GitHub)" <gi...@apache.org>.
MonsterChenzhuo commented on issue #4408:
URL: https://github.com/apache/incubator-seatunnel/issues/4408#issuecomment-1482207487

   please assign to me; thx。 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4408: [Bug] [clickhouse source] Unsupported array data type

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4408:
URL: https://github.com/apache/incubator-seatunnel/issues/4408#issuecomment-1524280702

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org