You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/04/21 19:27:52 UTC

[GitHub] [incubator-doris] fanlongmengjd opened a new issue #3370: [Bug] Routine loads don't consume kafka topic

fanlongmengjd opened a new issue #3370:
URL: https://github.com/apache/incubator-doris/issues/3370


   **Describe the bug**
   Routine load was running but didn't consume
   1.  Be.INFO showed the frequency of routine load task scheduled to Be was less.
   ![image](https://user-images.githubusercontent.com/63618584/79904800-1f4d1800-83ca-11ea-8b5e-3e3c712753cb.png) 
   07:42->07:43-07:51->08:04->08:39
   2. There was "running" transactions which status were committed and got stuck , didn't change
   ![image](https://user-images.githubusercontent.com/63618584/79905027-794ddd80-83ca-11ea-8d5c-c53e926d9609.png)
   drill down and find 
   ![image](https://user-images.githubusercontent.com/63618584/79905437-1f99e300-83cb-11ea-9b0c-90f22f12e049.png)
   check the tablet 
   ![image](https://user-images.githubusercontent.com/63618584/79905478-2cb6d200-83cb-11ea-8733-4687ad093683.png)
   
   3. There were some warning in fe.warn.log
   ![image](https://user-images.githubusercontent.com/63618584/79905549-47894680-83cb-11ea-90d4-40f2ffa223f6.png)
   
   
   **To Reproduce**
   Steps to reproduce the behavior:
   1. Go to '...'
   2. Click on '....'
   3. Scroll down to '....'
   4. See error
   
   **Expected behavior**
   Consume properly
   
    - OS: CentOS
    - Browser chrome
    - Version 0.11.33.1
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] morningman commented on issue #3370: [Bug] Routine loads don't consume kafka topic

Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3370:
URL: https://github.com/apache/incubator-doris/issues/3370#issuecomment-619561476


   I can't see the image you post in issue.
   Did you see some rollback failure log? If yes, it seems that the scheduler process has something wrong, you can upgrade to 0.11.42 to see if the problem is fixed.
   We've make some bug fixed in new version.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] fanlongmengjd commented on issue #3370: [Bug] Routine loads don't consume kafka topic

Posted by GitBox <gi...@apache.org>.
fanlongmengjd commented on issue #3370:
URL: https://github.com/apache/incubator-doris/issues/3370#issuecomment-625577525


   this issue showed again. 
   i checked fe.log, fe.warn, fe.audit, there was not any drop action.
   but issue happened again.
   ![image](https://user-images.githubusercontent.com/63618584/81360004-838cfe80-908f-11ea-90c3-c475e6ad12ee.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] fanlongmengjd commented on issue #3370: [Bug] Routine loads don't consume kafka topic

Posted by GitBox <gi...@apache.org>.
fanlongmengjd commented on issue #3370:
URL: https://github.com/apache/incubator-doris/issues/3370#issuecomment-625578015


   this time admin set frontend config("catalog_trash_expire_second" = "5")


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] morningman commented on issue #3370: [Bug] Routine loads don't consume kafka topic

Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3370:
URL: https://github.com/apache/incubator-doris/issues/3370#issuecomment-619562616


   Oh I see, we talked in WeChat group. It seems DROPPING PARTITION may cause this problem. You can try to pause the process of dropping partition and see if this problem could happen again.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] fanlongmengjd commented on issue #3370: [Bug] Routine loads don't consume kafka topic

Posted by GitBox <gi...@apache.org>.
fanlongmengjd commented on issue #3370:
URL: https://github.com/apache/incubator-doris/issues/3370#issuecomment-622992395


   yes, sounds like that.
   I use :admin set frontend   config("catalog_trash_expire_second" = "60") to workaround this problem, but i don't know the root cause
   --
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org