You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by "yaobukeji123 (via GitHub)" <gi...@apache.org> on 2023/04/19 03:40:15 UTC

[GitHub] [incubator-streampark] yaobukeji123 opened a new issue, #2658: Fault Restart function lead to 3 problems

yaobukeji123 opened a new issue, #2658:
URL: https://github.com/apache/incubator-streampark/issues/2658

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-streampark/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### Java Version
   
   1.8
   
   ### Scala Version
   
   2.12.x
   
   ### StreamPark Version
   
   2.0.0
   
   ### Flink Version
   
   1.15.3/1.16
   
   ### deploy mode
   
   yarn-application
   
   ### What happened
   
   1、Fault Restart Size is setted 99 ,but  sometimes is not work
       配置了重启次数,但是有时候并未重启起来,还没累计到重启设置的阈值。可能一般手动重启后会出现
   
   2、After stream-park Fault Restart ,flink program is not recovered  from cp/sp
       stream-park帮助自动重启失败任务后,flink并未从最近一次cp/sp恢复
   
   3、After stream-park  Fault Restart ,the one flink program may have many instances, so lead to data repetition
       stream-park帮助自动重启失败任务后,可能会出现一个任务同时多个实例在运行的情况,很容易导致数据结果重复
   ![image](https://user-images.githubusercontent.com/35523218/232960961-5d152d93-4a2f-4316-b1ea-e89d093d2a91.png)
   
   
   
   ### Error Exception
   
   ```log
   1、可以stream-park观察出来
   
   2、通过数据重复、因为从kafka的偏移量策略恢复的、而不是cp/sp的恢复、故可以很容易看出来
   
   3、通过监控、和yarn上的ui观察
   ```
   
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!(您是否要贡献这个PR?)
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-streampark] yaobukeji123 commented on issue #2658: 【bugs】Fault Restart function lead to 3 problems

Posted by "yaobukeji123 (via GitHub)" <gi...@apache.org>.
yaobukeji123 commented on issue #2658:
URL: https://github.com/apache/incubator-streampark/issues/2658#issuecomment-1514191385

   ![image](https://user-images.githubusercontent.com/35523218/232984181-2ea566bc-c1f2-41be-bf20-5a4aca443a0a.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org