You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "sohurdc (via GitHub)" <gi...@apache.org> on 2025/08/07 04:05:16 UTC
[I] [Bug] [milvus] sink database config is no use [seatunnel]
sohurdc opened a new issue, #9678:
URL: https://github.com/apache/seatunnel/issues/9678
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
Seatunnel Milvus source and Milvus sink, I has config:
{
"env": {
"execution.parallelism": 3,
"job.mode": "BATCH"
},
"source": [
{
"plugin_name": "Milvus",
"url": "http://10.18.x.x:9091",
"token": "xxx:xxx",
"database": "default",
"collection": "knowledge_embeddings_totals"
}
],
"sink": [
{
"plugin_name": "Milvus",
"url": "http://x.com:9091",
"token": "yyy:yyy",
"database": "zikang_migrate",
"enable_upsert": "true"
}
]
}
Got error bellow:
PERMISSION_DENIED: PrivilegeCreateCollection: permission deny to yyy in the `default` database
The database configuration under the sink section doesn't seem to take effect — the sink still tries to write to the default database, which causes an error because the user doesn't have write permissions on the default database.
After I granted the user yyy write permissions on the default database, I checked the job status and found the following:
vertexInfoMap":[{"vertexId":1,"type":"source","vertexName":"pipeline-1 [Source[0]-Milvus]","tablePaths":["default.knowledge_embeddings_totals"]},{"vertexId":2,"type":"sink","vertexName":"pipeline-1 [Sink[0]-Milvus-default.knowledge_embeddings_totals]","tablePaths":["zikang_migrate.knowledge_embeddings_totals"]
Sink[0]-Milvus-default.knowledge_embeddings_totals] , Ideally, it should have been zikang_migrate.knowledge_embeddings_totals
### SeaTunnel Version
2.3.9
### SeaTunnel Config
```conf
{
"env": {
"execution.parallelism": 3,
"job.mode": "BATCH"
},
"source": [
{
"plugin_name": "Milvus",
"url": "http://10.18.x.x:9091",
"token": "xxx:xxx",
"database": "default",
"collection": "knowledge_embeddings_totals"
}
],
"sink": [
{
"plugin_name": "Milvus",
"url": "http://x.com:9091",
"token": "yyy:yyy",
"database": "zikang_migrate",
"enable_upsert": "true"
}
]
}
```
### Running Command
```shell
curl -X POST "http://10.18.xx.xx:10901/submit-job" \
-H "Content-Type: multipart/form-data" --data-binary @/home/seatunnel/m4.conf
```
### Error Exception
```log
PERMISSION_DENIED: PrivilegeCreateCollection: permission deny to yyy in the `default` database
```
### Zeta or Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org