You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/04/29 07:29:58 UTC
[GitHub] [dolphinscheduler] Tandoy opened a new issue #5407: [Question]The master automatically hangs up when there are too many tasks
Tandoy opened a new issue #5407:
URL: https://github.com/apache/dolphinscheduler/issues/5407
**Steps to reproduce the behavior:**
Use the shell node to execute the hive -f command
**Expected behavior:**
Normal ETL
**Environment Description:**
dolphinscheduler：1.3.2
Hadoop version : 2.6.0-cdh5.13.3
Hive version : 1.1.0-cdh5.13.3
Storage (HDFS/S3/GCS..) : HDFS
Running on Docker? (yes/no) :no
**Configuration:**
master.properties
master.reserved.memory=0.6
**Stacktrace:**
dolphinscheduler-master.log:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ruanwenjun commented on issue #5407: [Question]The master automatically hangs up when there are too many tasks
Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on issue #5407:
URL: https://github.com/apache/dolphinscheduler/issues/5407#issuecomment-833201046
@Tandoy Which version are you using? Maybe you need to reduce this value `master.reserved.memory `.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5407: [Question]The master automatically hangs up when there are too many tasks
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5407:
URL: https://github.com/apache/dolphinscheduler/issues/5407#issuecomment-829005055
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/zh-cn/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Tandoy closed issue #5407: [Question]The master automatically hangs up when there are too many tasks
Posted by GitBox <gi...@apache.org>.
Tandoy closed issue #5407:
URL: https://github.com/apache/dolphinscheduler/issues/5407
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Tandoy commented on issue #5407: [Question]The master automatically hangs up when there are too many tasks
Posted by GitBox <gi...@apache.org>.
Tandoy commented on issue #5407:
URL: https://github.com/apache/dolphinscheduler/issues/5407#issuecomment-834307651
> @Tandoy Which version are you using? Maybe you need to reduce this value `master.reserved.memory `.
I am using dolphinscheduler-1.3.2 and tried to reduce `master.reserved.memory` to 0.3, but the master still hangs.Is there an optimal calculation method for the parameter `master.reserved.memory` based on the cluster configuration?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Tandoy commented on issue #5407: [Question]The master automatically hangs up when there are too many tasks
Posted by GitBox <gi...@apache.org>.
Tandoy commented on issue #5407:
URL: https://github.com/apache/dolphinscheduler/issues/5407#issuecomment-839372575
A worker node has been added to reduce the pressure on the master, and the master has been running stably.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org