You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/12/21 06:26:14 UTC
[GitHub] [incubator-dolphinscheduler] set-daemon opened a new issue #4277: [Question] what's the relationship between jvm memory configuration & business volume
set-daemon opened a new issue #4277:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4277
**For better global communication, Please describe it in English. If you feel the description in English is not clear, then you can append description in Chinese(just for Mandarin(CN)), thx! **
**Describe the question**
I'm trying the DS, get some launching configurations from file bin/dolphinscheduler-daemon.sh like that:
```
if [ "$command" = "api-server" ]; then
HEAP_INITIAL_SIZE=1g
HEAP_MAX_SIZE=1g
HEAP_NEW_GENERATION__SIZE=500m
LOG_FILE="-Dlogging.config=classpath:logback-api.xml -Dspring.profiles.active=api"
CLASS=org.apache.dolphinscheduler.api.ApiApplicationServer
elif [ "$command" = "master-server" ]; then
HEAP_INITIAL_SIZE=4g
HEAP_MAX_SIZE=4g
HEAP_NEW_GENERATION__SIZE=2g
LOG_FILE="-Dlogging.config=classpath:logback-master.xml -Ddruid.mysql.usePingMethod=false"
CLASS=org.apache.dolphinscheduler.server.master.MasterServer
elif [ "$command" = "worker-server" ]; then
HEAP_INITIAL_SIZE=2g
HEAP_MAX_SIZE=2g
HEAP_NEW_GENERATION__SIZE=1g
LOG_FILE="-Dlogging.config=classpath:logback-worker.xml -Ddruid.mysql.usePingMethod=false"
CLASS=org.apache.dolphinscheduler.server.worker.WorkerServer
elif [ "$command" = "alert-server" ]; then
HEAP_INITIAL_SIZE=1g
HEAP_MAX_SIZE=1g
HEAP_NEW_GENERATION__SIZE=500m
LOG_FILE="-Dlogback.configurationFile=conf/logback-alert.xml"
CLASS=org.apache.dolphinscheduler.alert.AlertServer
elif [ "$command" = "logger-server" ]; then
HEAP_INITIAL_SIZE=1g
HEAP_MAX_SIZE=1g
HEAP_NEW_GENERATION__SIZE=500m
CLASS=org.apache.dolphinscheduler.server.log.LoggerServer
else
echo "Error: No command named \`$command' was found."
exit 1
fi
```
wondering about:
1) what's the minimal memory for launching the entire system.
2) what's the relationship between the business volume & the memory configured above.
3)any relationships between the tasks & the memory required by DS? for example, one task may exhaust 1G Bits memory, the other one exhausts 2G Bits memory , will it effect the memory used by DS ?
THX!
**Which version of DolphinScheduler:**
-[1.3.3 ]
**Additional context**
**Requirement or improvement**
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong closed issue #4277: [Question] what's the relationship between jvm memory configuration & business volume
Posted by GitBox <gi...@apache.org>.
dailidong closed issue #4277:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4277
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #4277: [Question] what's the relationship between jvm memory configuration & business volume
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #4277:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4277#issuecomment-751603276
the minimal memory has written in the file bin/dolphinscheduler-daemon.sh, but you can try set much smaller, and the stability base on your business, so you'd better have a try to get the fit
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org