You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "jianJizz (via GitHub)" <gi...@apache.org> on 2025/01/23 02:36:07 UTC
[I] [Bug] [Module Name] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]
jianJizz opened a new issue, #8575:
URL: https://github.com/apache/seatunnel/issues/8575
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty
我按照官方的配置进行操作,sqlserver写入hive报错,hive依赖的jar报都放到seatunnel的lib目录下去了
I followed the official configuration instructions, but encountered an error when writing data from SQL Server to Hive. All the JAR files that Hive depends on have been placed in the Seatunnel's lib directory.
### SeaTunnel Version
seatunnel version: 2.3.9
hive version: 3.1.3 r16e97596921c8514713bcadb3b3568bccc7ef26c
### SeaTunnel Config
```conf
env {
parallelism = 3
job.name = "test_mssql2hive"
job.mode = "BATCH"
}
source {
Jdbc {
driver = com.microsoft.sqlserver.jdbc.SQLServerDriver
url = "jdbc:sqlserver://xxx:1433;database=ODS;encrypt=false;trustServerCertificate=true"
user = xxx
password = "xxx"
query = "select id, name from dbo.test_st (nolock)"
}
}
transform {
}
sink {
Hive {
metastore_uri = "thrift://xxx:9083"
table_name = "db_ods.pds_test_st"
}
}
```
### Running Command
```shell
bin/seatunnel.sh --config mssql2hive.conf -m local
```
### Error Exception
```log
-- 错误信息 error message
2025-01-23 10:23:47,645 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Fatal Error,
2025-01-23 10:23:47,645 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Please submit bug report in https://github.com/apache/seatunnel/issues
2025-01-23 10:23:47,645 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Reason:SeaTunnel job executed failed
2025-01-23 10:23:47,646 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:228)
at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by: org.apache.seatunnel.api.table.factory.FactoryException: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a sink for identifier 'Hive'.
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSink(FactoryUtil.java:173)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.createSinkAction(MultipleTableJobConfigParser.java:698)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSink(MultipleTableJobConfigParser.java:629)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:249)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag(ClientJobExecutionEnvironment.java:123)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute(ClientJobExecutionEnvironment.java:191)
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:165)
... 2 more
Caused by: org.apache.seatunnel.common.utils.SeaTunnelException: Table default.default.default field name cannot be empty
at org.apache.seatunnel.api.table.factory.TableFactoryContext.checkCatalogTableIllegal(TableFactoryContext.java:48)
at org.apache.seatunnel.api.table.factory.TableSinkFactoryContext.<init>(TableSinkFactoryContext.java:41)
at org.apache.seatunnel.api.table.factory.TableSinkFactoryContext.replacePlaceholderAndCreate(TableSinkFactoryContext.java:54)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSink(FactoryUtil.java:157)
... 8 more
```
### Zeta or Flink or Spark Version
zeta
### Java or Scala Version
openjdk version "1.8.0_392"
OpenJDK Runtime Environment (build 1.8.0_392-b08)
OpenJDK 64-Bit Server VM (build 25.392-b08, mixed mode)
### Screenshots


### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]
Posted by "jianJizz (via GitHub)" <gi...@apache.org>.
jianJizz closed issue #8575: [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty
URL: https://github.com/apache/seatunnel/issues/8575
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]
Posted by "jianJizz (via GitHub)" <gi...@apache.org>.
jianJizz commented on issue #8575:
URL: https://github.com/apache/seatunnel/issues/8575#issuecomment-2649843337
已解决,是source的sql中查询字段用了cast函数,没有取别名导致,解决:用了函数的字段一定要取别名
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]
Posted by "jianJizz (via GitHub)" <gi...@apache.org>.
jianJizz commented on issue #8575:
URL: https://github.com/apache/seatunnel/issues/8575#issuecomment-2611483277
Can someone take a look at this?please
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org