You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/06/19 07:45:42 UTC
[GitHub] [incubator-dolphinscheduler] glz-java opened a new issue #3019: Logstash publishes elasticsearch data. When it is executing, click stop, and the workerserver service will also stop
glz-java opened a new issue #3019:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3019
**Describe the question**
When we execute the shell task, during the process of publishing the index through logstash (Note: make sure that the logstash shell node is already running), click stop in the workflow instance, and the workeService service will be stop too
**System**
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04 LTS"
**Which version of DolphinScheduler:**
-[1.2.0] OR [1.2.1]
**Additional context**



**Requirement or improvement
Expectation: the workers server service will not stop after clicking stop
**Logfile**
[dolphinscheduler-worker.log](https://github.com/apache/incubator-dolphinscheduler/files/4803037/dolphinscheduler-worker.log)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] glz-java edited a comment on issue #3019: Logstash publishes elasticsearch data. When it is executing, click stop, and the workerserver service will also stop
Posted by GitBox <gi...@apache.org>.
glz-java edited a comment on issue #3019:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3019#issuecomment-647225630
> 1、are you sure that your linux user jiawei can execute `/home/fuming/software/logstash-7.1.1/bin/logstash -f /home/fuming/software/logstash-7.1.1/config_db_indexer/sql.indexer_es.conf` ?
> 2、does a simple shell task like `echo 111` runs normally, and is this simple shell task also lead to Worker server stop?
1、It can be confirmed that normal conditions can be executed successfully
2、Simple shell tasks are OK
At present, the problem only occurs when the logstash task is executed. If you do not click stop manually, the problem will not occur. You can execute the process normally
Simple shell task, click stop task will not appear, only in logstash task
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] glz-java commented on issue #3019: Logstash publishes elasticsearch data. When it is executing, click stop, and the workerserver service will also stop
Posted by GitBox <gi...@apache.org>.
glz-java commented on issue #3019:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3019#issuecomment-647225630
> 1、are you sure that your linux user jiawei can execute `/home/fuming/software/logstash-7.1.1/bin/logstash -f /home/fuming/software/logstash-7.1.1/config_db_indexer/sql.indexer_es.conf` ?
> 2、does a simple shell task like `echo 111` runs normally, and is this simple shell task also lead to Worker server stop?
1、It can be confirmed that normal conditions can be executed successfully
2、Simple shell tasks are OK
At present, the problem only occurs when the logstash task is executed. If you do not click stop manually, the problem will not occur. You can execute the process normally
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #3019: Logstash publishes elasticsearch data. When it is executing, click stop, and the workerserver service will also stop
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #3019:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3019#issuecomment-646997071
this situation is abnormal, you can try set config items in the zookeeper.properties:
zookeeper.session.timeout=60000
zookeeper.connection.timeout=30000
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #3019: Logstash publishes elasticsearch data. When it is executing, click stop, and the workerserver service will also stop
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #3019:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3019#issuecomment-646999149
1、are you sure that your linux user jiawei can execute `/home/fuming/software/logstash-7.1.1/bin/logstash -f /home/fuming/software/logstash-7.1.1/config_db_indexer/sql.indexer_es.conf` ?
2、does a simple shell task like `echo 111` runs normally, and is this simple shell task also lead to Worker server stop?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] glz-java commented on issue #3019: Logstash publishes elasticsearch data. When it is executing, click stop, and the workerserver service will also stop
Posted by GitBox <gi...@apache.org>.
glz-java commented on issue #3019:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3019#issuecomment-647233086
> this situation is abnormal, you can try set config items in the zookeeper.properties:
>
> zookeeper.session.timeout=60000
> zookeeper.connection.timeout=30000
After these two parameters are modified, they still appear
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org