You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/05/06 09:34:29 UTC
[GitHub] [incubator-doris] ZengRL opened a new issue #3482: Why Routine Load always be aborted?
ZengRL opened a new issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482
I can see "abortedTaskNum" is increasing from "show routine load for";
FE warn log has a lot of msg about "[RoutineLoadTaskScheduler.scheduleOneTask():120] ROUTINE_LOAD_TASK=fad7edd49a14421b-b6cef88b9e79dd19, error_msg={task has been abandoned when scheduling task}"
why it can not consume?? i am sure there are many msg in kafka.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL edited a comment on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL edited a comment on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-625076029
supplement：
① I have 300 routine load job
② Job run once in ten minutes
③ from “SHOW ROUTINE LOAD TASK WHERE”，TxnId=-1, TxnStatus=UNKNOWN, BeId=-1
④ from fe.warn.log，“[RoutineLoadTaskScheduler.scheduleOneTask():120] ROUTINE_LOAD_TASK=3caf5792be3e4fc3-874bc30d82d29e81, error_msg={task has been abandoned when scheduling task}”
⑤ if I pause some routine load job, keep running job number about 150, there were not see the warn log
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL commented on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL commented on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-624608903
> What is your Doris version?
0.11.25
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL commented on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL commented on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-624608150
> What is your Doris version?
0.11
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL commented on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL commented on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-625086182
oh, I see more message in be.INFO
2020-05-07 15:24:09,351 INFO 39 [GlobalTransactionMgr.beginTransaction():193] begin transaction: txn id 4731688 with label f00c7f57f0f5400d-b25f72389b624002 from coordinator FE: 172.18.30.60
2020-05-07 15:24:09,443 INFO 39 [RoutineLoadTaskScheduler.submitTask():230] failed to submit task f00c7f57f0f5400d-b25f72389b624002, BE: 10011, error code: TOO_MANY_TASKS
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL commented on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL commented on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-624997070
> What is your Doris version?
可以加个微信咨询你几个问题吗？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL commented on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL commented on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-624984762
> `task has been abandoned when scheduling task`
>
> This error probably because the sub task is timeout and be aborted by the FE.
> There were some bugs about the scheduling of routine load task. And They are fixed already.
> You can upgrade to 0.11.42 to try to solve the problem.
thanks very much
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL removed a comment on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL removed a comment on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-624608150
> What is your Doris version?
0.11
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-624546515
What is your Doris version?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-624667917
`task has been abandoned when scheduling task`
This error probably because the sub task is timeout and be aborted by the FE.
There were some bugs about the scheduling of routine load task. And They are fixed already.
You can upgrade to 0.11.42 to try to solve the problem.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] ZengRL edited a comment on issue #3482: Why Routine Load always be aborted?
Posted by GitBox <gi...@apache.org>.
ZengRL edited a comment on issue #3482:
URL: https://github.com/apache/incubator-doris/issues/3482#issuecomment-625076029
supplement：
① I have 300 routine load job
② Job run once in ten minutes
③ some log in be.INFO about CLEAR_TRANSACTION_TASK
④ from fe.warn.log，“[RoutineLoadTaskScheduler.scheduleOneTask():120] ROUTINE_LOAD_TASK=3caf5792be3e4fc3-874bc30d82d29e81, error_msg={task has been abandoned when scheduling task}”
⑤ if I pause some routine load job, keep running job number about 150, there were not see the warn log
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org