You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "jianJizz (via GitHub)" <gi...@apache.org> on 2025/01/23 02:36:07 UTC

[I] [Bug] [Module Name] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]

jianJizz opened a new issue, #8575:
URL: https://github.com/apache/seatunnel/issues/8575

   ### Search before asking
   
   - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty
   
   我按照官方的配置进行操作,sqlserver写入hive报错,hive依赖的jar报都放到seatunnel的lib目录下去了
   I followed the official configuration instructions, but encountered an error when writing data from SQL Server to Hive. All the JAR files that Hive depends on have been placed in the Seatunnel's lib directory.
   
   ### SeaTunnel Version
   
   seatunnel version: 2.3.9
   hive version: 3.1.3 r16e97596921c8514713bcadb3b3568bccc7ef26c
   
   ### SeaTunnel Config
   
   ```conf
   env {
     parallelism = 3
     job.name = "test_mssql2hive"
     job.mode = "BATCH"
   }
   
   source {
       Jdbc {
           driver = com.microsoft.sqlserver.jdbc.SQLServerDriver
           url = "jdbc:sqlserver://xxx:1433;database=ODS;encrypt=false;trustServerCertificate=true"
           user = xxx
           password = "xxx"
           query = "select id, name from dbo.test_st (nolock)"
       }
   }
   
   transform {
   }
   
   sink {
     Hive {
       metastore_uri = "thrift://xxx:9083"
   	table_name = "db_ods.pds_test_st"
     }
   }
   ```
   
   ### Running Command
   
   ```shell
   bin/seatunnel.sh --config mssql2hive.conf -m local
   ```
   
   ### Error Exception
   
   ```log
   -- 错误信息 error message
   2025-01-23 10:23:47,645 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Fatal Error, 
   
   2025-01-23 10:23:47,645 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Please submit bug report in https://github.com/apache/seatunnel/issues
   
   2025-01-23 10:23:47,645 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Reason:SeaTunnel job executed failed 
   
   2025-01-23 10:23:47,646 ERROR [o.a.s.c.s.SeaTunnel           ] [main] - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
           at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:228)
           at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
           at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
   Caused by: org.apache.seatunnel.api.table.factory.FactoryException: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a sink for identifier 'Hive'.
           at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSink(FactoryUtil.java:173)
           at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.createSinkAction(MultipleTableJobConfigParser.java:698)
           at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSink(MultipleTableJobConfigParser.java:629)
           at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:249)
           at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag(ClientJobExecutionEnvironment.java:123)
           at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute(ClientJobExecutionEnvironment.java:191)
           at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:165)
           ... 2 more
   Caused by: org.apache.seatunnel.common.utils.SeaTunnelException: Table default.default.default field name cannot be empty
           at org.apache.seatunnel.api.table.factory.TableFactoryContext.checkCatalogTableIllegal(TableFactoryContext.java:48)
           at org.apache.seatunnel.api.table.factory.TableSinkFactoryContext.<init>(TableSinkFactoryContext.java:41)
           at org.apache.seatunnel.api.table.factory.TableSinkFactoryContext.replacePlaceholderAndCreate(TableSinkFactoryContext.java:54)
           at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSink(FactoryUtil.java:157)
           ... 8 more
   ```
   
   ### Zeta or Flink or Spark Version
   
   zeta
   
   ### Java or Scala Version
   
   openjdk version "1.8.0_392"
   OpenJDK Runtime Environment (build 1.8.0_392-b08)
   OpenJDK 64-Bit Server VM (build 25.392-b08, mixed mode)
   
   ### Screenshots
   
   ![Image](https://github.com/user-attachments/assets/781b4ba1-1123-4f26-a323-3029545b9ed1)
   
   ![Image](https://github.com/user-attachments/assets/9ab0f4e7-4b8f-48d6-bb95-8b20087ace46)
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]

Posted by "jianJizz (via GitHub)" <gi...@apache.org>.
jianJizz closed issue #8575: [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty
URL: https://github.com/apache/seatunnel/issues/8575


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]

Posted by "jianJizz (via GitHub)" <gi...@apache.org>.
jianJizz commented on issue #8575:
URL: https://github.com/apache/seatunnel/issues/8575#issuecomment-2649843337

   已解决,是source的sql中查询字段用了cast函数,没有取别名导致,解决:用了函数的字段一定要取别名


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]

Posted by "jianJizz (via GitHub)" <gi...@apache.org>.
jianJizz commented on issue #8575:
URL: https://github.com/apache/seatunnel/issues/8575#issuecomment-2611483277

   Can someone take a look at this?please


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org