You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@seatunnel.apache.org by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/03/13 15:42:55 UTC

[GitHub] [incubator-seatunnel] laglangyue opened a new issue, #4345: [Bug] [FLink] [Streaming] not supported void Type

laglangyue opened a new issue, #4345:
URL: https://github.com/apache/incubator-seatunnel/issues/4345

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   when I run flink example use with the conf, it exception
   ```json
       schema = {
         fields {
           c_map = "map<string, string>"
           c_array = "array<int>"
           c_string = string
           c_boolean = boolean
           c_tinyint = tinyint
           c_smallint = smallint
           c_int = int
           c_bigint = bigint
           c_float = float
           c_double = double
           c_decimal = "decimal(30, 8)"
           c_null = "null"
           c_bytes = bytes
           c_date = date
           c_timestamp = timestamp
         }
       }
   
   ```
   
   ![image](https://user-images.githubusercontent.com/35491928/224752540-4bf81cd8-f856-4637-8a10-580c8c49515c.png)
   
   
   
   ### SeaTunnel Version
   
   dev 
   
   ### SeaTunnel Config
   
   ```conf
   #
   # Licensed to the Apache Software Foundation (ASF) under one or more
   # contributor license agreements.  See the NOTICE file distributed with
   # this work for additional information regarding copyright ownership.
   # The ASF licenses this file to You under the Apache License, Version 2.0
   # (the "License"); you may not use this file except in compliance with
   # the License.  You may obtain a copy of the License at
   #
   #    http://www.apache.org/licenses/LICENSE-2.0
   #
   # Unless required by applicable law or agreed to in writing, software
   # distributed under the License is distributed on an "AS IS" BASIS,
   # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   # See the License for the specific language governing permissions and
   # limitations under the License.
   #
   ######
   ###### This config file is a demonstration of streaming processing in seatunnel config
   ######
   
   env {
     # You can set flink configuration here
     execution.parallelism = 2
     job.mode = "STREAMING"
     #execution.checkpoint.interval = 10000
     #execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
   }
   
   source {
     # This is a example source plugin **only for test and demonstrate the feature source plugin**
     FakeSource {
       parallelism = 2
       result_table_name = "fake"
       row.num = 16
       schema = {
         fields {
           c_map = "map<string, string>"
           c_array = "array<int>"
           c_string = string
           c_boolean = boolean
           c_tinyint = tinyint
           c_smallint = smallint
           c_int = int
           c_bigint = bigint
           c_float = float
           c_double = double
           c_decimal = "decimal(30, 8)"
           c_null = "null"
           c_bytes = bytes
           c_date = date
           c_timestamp = timestamp
         }
       }
     }
   
     # If you would like to get more information about how to configure seatunnel and see full list of source plugins,
     # please go to https://seatunnel.apache.org/docs/category/source-v2
   }
   
   transform {
     # split data by specific delimiter
   
     # you can also use other transform plugins, such as sql
     sql {
       source_table_name = "fake"
       query = "select c_map,c_array,c_string,c_boolean,c_tinyint,c_smallint,c_int,c_bigint,c_float,c_double,c_null,c_bytes,c_date,c_timestamp from fake"
       result_table_name = "sql"
     }
   
     # If you would like to get more information about how to configure seatunnel and see full list of transform plugins,
     # please go to https://seatunnel.apache.org/docs/category/transform
   }
   
   sink {
     Console {
       parallelism = 3
     }
   
     # If you would like to get more information about how to configure seatunnel and see full list of sink plugins,
     # please go to https://seatunnel.apache.org/docs/category/sink-v2
   }
   ```
   
   
   ### Running Command
   
   ```shell
   nothing
   ```
   
   
   ### Error Exception
   
   ```log
   Caused by: org.apache.flink.table.api.ValidationException: Column types of query result and sink for unregistered table do not match.
   Cause: Incompatible types for sink column 'c_null' at position 11.
   
   Query schema: [c_map: MAP<STRING, STRING>, c_array: ARRAY<INT>, c_string: STRING, c_boolean: BOOLEAN, c_tinyint: TINYINT, c_smallint: SMALLINT, c_int: INT, c_bigint: BIGINT, c_float: FLOAT, c_double: DOUBLE, c_decimal: DECIMAL(38, 18), c_null: RAW('java.lang.Void', '...'), c_bytes: BYTES, c_date: DATE, c_timestamp: TIMESTAMP(9)]
   Sink schema:  [c_map: MAP<STRING, STRING>, c_array: ARRAY<INT>, c_string: STRING, c_boolean: BOOLEAN, c_tinyint: TINYINT, c_smallint: SMALLINT, c_int: INT, c_bigint: BIGINT, c_float: FLOAT, c_double: DOUBLE, c_decimal: DECIMAL(38, 18), c_null: RAW('java.lang.Void', ?), c_bytes: BYTES, c_date: DATE, c_timestamp: TIMESTAMP(3)]
   	at org.apache.flink.table.planner.connectors.DynamicSinkUtils.createSchemaMismatchException(DynamicSinkUtils.java:432)
   	at org.apache.flink.table.planner.connectors.DynamicSinkUtils.validateSchemaAndApplyImplicitCast(DynamicSinkUtils.java:255)
   	at org.apache.flink.table.planner.delegation.PlannerBase.translateToRel(PlannerBase.scala:255)
   	at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:162)
   	at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:162)
   	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
   	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
   ```
   
   
   ### Flink or Spark Version
   
   examplt
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] laglangyue commented on issue #4345: [Bug] [FLink] [Streaming] not supported void Type

Posted by "laglangyue (via GitHub)" <gi...@apache.org>.

laglangyue commented on issue #4345:
URL: https://github.com/apache/incubator-seatunnel/issues/4345#issuecomment-1500830365

   > Do you fix it?I meet the same problem.I want to ask for help.
   
   what happend? I am pool with Flink, so are you willing to do this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug] [FLink] [Streaming] not supported void Type [seatunnel]

Posted by "CheneyYin (via GitHub)" <gi...@apache.org>.

CheneyYin commented on issue #4345:
URL: https://github.com/apache/seatunnel/issues/4345#issuecomment-1907235779

   @Carl-Zhou-CN PTAL


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] CodingGPT commented on issue #4345: [Bug] [FLink] [Streaming] not supported void Type

Posted by "CodingGPT (via GitHub)" <gi...@apache.org>.

CodingGPT commented on issue #4345:
URL: https://github.com/apache/incubator-seatunnel/issues/4345#issuecomment-1472202099

   why use void type？ what type  void type should be trasformed ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org