You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "wellbin-li (via GitHub)" <gi...@apache.org> on 2023/09/27 03:12:08 UTC
[GitHub] [seatunnel] wellbin-li opened a new issue, #5569: [Bug] [Sink Clickhouse] Cannot set null to non-nullable column
wellbin-li opened a new issue, #5569:
URL: https://github.com/apache/seatunnel/issues/5569
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
hive sink ck, exception: Cannot set null to non-nullable colum
### SeaTunnel Version
v2.3.3
### SeaTunnel Config
```conf
env {
execution.parallelism = 1
job.mode = "BATCH"
}
source {
Hive {
table_name = "hive_db.table1"
sql = "select * from hive_db.table1"
result_table_name = "res1"
metastore_uri = "******:9083"
}
}
transform {
}
sink {
Clickhouse {
host = "******:80"
database = "ck_db"
table = "table1_all"
username = "user-clusters"
password = "******"
}
}
```
### Running Command
```shell
./bin/start-seatunnel-spark-3-connector-v2.sh \
--master local[4] \
--deploy-mode client \
--config ./config/seatunnel.streaming.conf.template
```
### Error Exception
```log
Caused by: java.sql.SQLException: Cannot set null to non-nullable column #48 [last_order_creation_date_with_outbound String]
at com.clickhouse.jdbc.SqlExceptionUtils.clientError(SqlExceptionUtils.java:73)
at com.clickhouse.jdbc.internal.InputBasedPreparedStatement.addBatch(InputBasedPreparedStatement.java:328)
at org.apache.seatunnel.connectors.seatunnel.clickhouse.sink.client.executor.FieldNamedPreparedStatement.addBatch(FieldNamedPreparedStatement.java:371)
at org.apache.seatunnel.connectors.seatunnel.clickhouse.sink.client.executor.SimpleBatchStatementExecutor.addToBatch(SimpleBatchStatementExecutor.java:43)
at org.apache.seatunnel.connectors.seatunnel.clickhouse.sink.client.executor.BufferedBatchStatementExecutor.executeBatch(BufferedBatchStatementExecutor.java:51)
at org.apache.seatunnel.connectors.seatunnel.clickhouse.sink.client.ClickhouseSinkWriter.flush(ClickhouseSinkWriter.java:124)
... 16 more
```
### Zeta or Flink or Spark Version
Spark 3.2
### Java or Scala Version
java8
### Screenshots
<img width="1147" alt="image" src="https://github.com/apache/seatunnel/assets/34698497/e420c521-277c-4a9f-a6c7-fb9d7be5ad8f">
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Sink Clickhouse] Cannot set null to non-nullable column [seatunnel]
Posted by "liugddx (via GitHub)" <gi...@apache.org>.
liugddx commented on issue #5569:
URL: https://github.com/apache/seatunnel/issues/5569#issuecomment-1744144487
Is there a null value in this field?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org