You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "xtz123 (via GitHub)" <gi...@apache.org> on 2023/05/10 03:44:49 UTC

[GitHub] [incubator-seatunnel] xtz123 opened a new issue, #4728: [Bug] [KafkaSource] The program has no error messages, and the kafka data has not been printed out

xtz123 opened a new issue, #4728:
URL: https://github.com/apache/incubator-seatunnel/issues/4728

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   
   Kafka serves as the data source and prints it out. The program started running, and when I sent data to Kafka, I couldn't see the printed message and there was no error. I'm not sure if this is a bug or if I configured it incorrectly. Please help me take a look. Thank you
   
   
   
   ### SeaTunnel Version
   
   2.3.1
   
   ### SeaTunnel Config
   
   ```conf
   env {
     # You can set flink configuration here
     execution.parallelism = 1
     job.mode = "STREAMING"
     checkpoint.interval = 2000
     #execution.checkpoint.interval = 10000
     execution.checkpoint.data-uri = "obs://ddmc-obs-test/user/flink/checkpoint"
   }
   
   source {
     Kafka {
       result_table_name = "kafka_name"
       schema = {
         fields {
           name = "string"
           age = "int"
         }
       }
       format = JSON
       topic = "source_test_2"
       bootstrap.servers = "xx.xx.xx.xx:9092"
     }
   }
   
   transform {
   }
   
   sink {
        Console {
   
       }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/start-seatunnel-flink-13-connector-v2.sh --config ./config/kafka2console.conf -m yarn-cluster -ynm kafka2console -yjm 1g -ytm 1g -ys 1 -yqu default -yd -p 1
   ```
   
   
   ### Error Exception
   
   ```log
   no Exception.
   ```
   
   
   ### Flink or Spark Version
   
   flink1.14.6
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] xtz123 commented on issue #4728: [Bug] [KafkaSource] The program has no error messages, and the kafka data has not been printed out

Posted by "xtz123 (via GitHub)" <gi...@apache.org>.
xtz123 commented on issue #4728:
URL: https://github.com/apache/incubator-seatunnel/issues/4728#issuecomment-1543602807

   It's my configuration issue, not a bug. I need to have a thorough understanding of its usage principles in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] xtz123 closed issue #4728: [Bug] [KafkaSource] The program has no error messages, and the kafka data has not been printed out

Posted by "xtz123 (via GitHub)" <gi...@apache.org>.
xtz123 closed issue #4728: [Bug] [KafkaSource] The program has no error messages, and the kafka data has not been printed out
URL: https://github.com/apache/incubator-seatunnel/issues/4728


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org