You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Joe McDonnell (Code Review)" <ge...@cloudera.org> on 2019/12/26 20:31:19 UTC

[Impala-ASF-CR] IMPALA-9241: Remove pid files on successful shutdown of minicluster

Joe McDonnell has uploaded this change for review. ( http://gerrit.cloudera.org:8080/14950


Change subject: IMPALA-9241: Remove pid files on successful shutdown of minicluster
......................................................................

IMPALA-9241: Remove pid files on successful shutdown of minicluster

The minicluster init scripts currently keep track of pids
for HDFS, YARN, etc by writing the pid to files for each
service. It uses the pid in the file to see what is running and
needs to shutdown or start. Currently, it does not remove the pid
file after the minicluster shuts down. This means that it would
be reading a zombie pid from the pid file to see if the service
is already running. If the pid is reused by something else, it
can fail to start up a necessary service.

This removes the pid files when the minicluster components shut down
successfully.

Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
---
M testdata/cluster/node_templates/common/etc/init.d/common.tmpl
1 file changed, 2 insertions(+), 0 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/50/14950/1
-- 
To view, visit http://gerrit.cloudera.org:8080/14950
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
Gerrit-Change-Number: 14950
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell <jo...@cloudera.com>

[Impala-ASF-CR] IMPALA-9241: Remove pid files on successful shutdown of minicluster

Posted by "Andrew Sherman (Code Review)" <ge...@cloudera.org>.
Andrew Sherman has posted comments on this change. ( http://gerrit.cloudera.org:8080/14950 )

Change subject: IMPALA-9241: Remove pid files on successful shutdown of minicluster
......................................................................


Patch Set 1: Code-Review+2

LGTM


-- 
To view, visit http://gerrit.cloudera.org:8080/14950
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
Gerrit-Change-Number: 14950
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Andrew Sherman <as...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Comment-Date: Fri, 27 Dec 2019 18:05:29 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-9241: Remove pid files on successful shutdown of minicluster

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/14950 )

Change subject: IMPALA-9241: Remove pid files on successful shutdown of minicluster
......................................................................


Patch Set 1:

Build Successful 

https://jenkins.impala.io/job/gerrit-code-review-checks/5338/ : Initial code review checks passed. Use gerrit-verify-dryrun-external or gerrit-verify-dryrun to run full precommit tests.


-- 
To view, visit http://gerrit.cloudera.org:8080/14950
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
Gerrit-Change-Number: 14950
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Comment-Date: Thu, 26 Dec 2019 21:01:30 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-9241: Remove pid files on successful shutdown of minicluster

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/14950 )

Change subject: IMPALA-9241: Remove pid files on successful shutdown of minicluster
......................................................................


Patch Set 1:

Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/5371/ DRY_RUN=true


-- 
To view, visit http://gerrit.cloudera.org:8080/14950
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
Gerrit-Change-Number: 14950
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Andrew Sherman <as...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Comment-Date: Fri, 27 Dec 2019 21:27:35 +0000
Gerrit-HasComments: No

[Impala-ASF-CR] IMPALA-9241: Remove pid files on successful shutdown of minicluster

Posted by "Joe McDonnell (Code Review)" <ge...@cloudera.org>.
Joe McDonnell has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/14950 )

Change subject: IMPALA-9241: Remove pid files on successful shutdown of minicluster
......................................................................

IMPALA-9241: Remove pid files on successful shutdown of minicluster

The minicluster init scripts currently keep track of pids
for HDFS, YARN, etc by writing the pid to files for each
service. It uses the pid in the file to see what is running and
needs to shutdown or start. Currently, it does not remove the pid
file after the minicluster shuts down. This means that it would
be reading a zombie pid from the pid file to see if the service
is already running. If the pid is reused by something else, it
can fail to start up a necessary service.

This removes the pid files when the minicluster components shut down
successfully.

Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
Reviewed-on: http://gerrit.cloudera.org:8080/14950
Reviewed-by: Andrew Sherman <as...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
M testdata/cluster/node_templates/common/etc/init.d/common.tmpl
1 file changed, 2 insertions(+), 0 deletions(-)

Approvals:
  Andrew Sherman: Looks good to me, approved
  Impala Public Jenkins: Verified

-- 
To view, visit http://gerrit.cloudera.org:8080/14950
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
Gerrit-Change-Number: 14950
Gerrit-PatchSet: 2
Gerrit-Owner: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Andrew Sherman <as...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Joe McDonnell <jo...@cloudera.com>

[Impala-ASF-CR] IMPALA-9241: Remove pid files on successful shutdown of minicluster

Posted by "Impala Public Jenkins (Code Review)" <ge...@cloudera.org>.
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/14950 )

Change subject: IMPALA-9241: Remove pid files on successful shutdown of minicluster
......................................................................


Patch Set 1: Verified+1


-- 
To view, visit http://gerrit.cloudera.org:8080/14950
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I5b14d74df8061b6595b9897df9c9667e3f569e34
Gerrit-Change-Number: 14950
Gerrit-PatchSet: 1
Gerrit-Owner: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Andrew Sherman <as...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Comment-Date: Sat, 28 Dec 2019 01:56:41 +0000
Gerrit-HasComments: No