You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/03/20 06:41:38 UTC

[GitHub] [incubator-seatunnel] DingPengfei opened a new issue #1522: [Bug] [seatunnel-connector-spark-redis] default config as official doc said can't run correctly

DingPengfei opened a new issue #1522:
URL: https://github.com/apache/incubator-seatunnel/issues/1522


   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   Doc from [spark redis sink](https://seatunnel.apache.org/docs/spark/configuration/sink-plugins/Redis) says only "host" and "port" are required in config file. But I got this
   `ERROR org.apache.seatunnel.command.BaseTaskExecuteCommand  - Plugin[org.apache.seatunnel.spark.sink.Redis] contains invalid config, error: No configuration setting found for key 'data_type'`
   in my local dev env
   
   ### SeaTunnel Version
   
   dev
   
   ### SeaTunnel Config
   
   ```conf
   env {
     spark.app.name = "SeaTunnel"
     spark.executor.instances = 2
     spark.executor.cores = 1
     spark.executor.memory = "1g"
     spark.master = local
   }
   
   source {
     Fake {
       result_table_name = "my_dataset"
     }
   }
   
   transform {
   }
   
   sink {
     Console {}
     Redis {
       host = "localhost"
       port = 6379
     }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   start in my local dev env
   ```
   
   
   ### Error Exception
   
   ```log
   ERROR org.apache.seatunnel.command.BaseTaskExecuteCommand  - Plugin[org.apache.seatunnel.spark.sink.Redis] contains invalid config, error: No configuration setting found for key 'data_type'
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] CalvinKirs closed issue #1522: [Bug] [seatunnel-connector-spark-redis] default config as official doc said can't run correctly

Posted by GitBox <gi...@apache.org>.
CalvinKirs closed issue #1522:
URL: https://github.com/apache/incubator-seatunnel/issues/1522


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] ruanwenjun commented on issue #1522: [Bug] [seatunnel-connector-spark-redis] default config as official doc said can't run correctly

Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on issue #1522:
URL: https://github.com/apache/incubator-seatunnel/issues/1522#issuecomment-1073708732


   Yeah, this is a bug, we need to use `hasPath` to check if the configKey is exist.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] DingPengfei commented on issue #1522: [Bug] [seatunnel-connector-spark-redis] default config as official doc said can't run correctly

Posted by GitBox <gi...@apache.org>.
DingPengfei commented on issue #1522:
URL: https://github.com/apache/incubator-seatunnel/issues/1522#issuecomment-1073820300


   > Yeah, this is a bug, we need to use `hasPath` to check if the configKey is exist.
   
   I had submitted a PR for this. Maybe you can help me to review it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org