You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by GitBox <gi...@apache.org> on 2020/09/22 07:36:23 UTC
[GitHub] [zeppelin] zjffdu opened a new pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
zjffdu opened a new pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918
### What is this PR for?
The root cause in the log4j.properties in the zeppelin server image. For k8s, we should use stdout for logging, but for the single zeppelin server container, we should use dailyfile for logging (both zeppelin server and interpreter). This PR add a new env `ZEPPELIN_IN_DOCKER` to choose the right log4j properties file for the right scenario.
### What type of PR is it?
[Bug Fix ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5055
### How should this be tested?
* CI pass
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] Reamer commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
Reamer commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-701936926
> Any more comment ? @Reamer
No.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] zjffdu commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
zjffdu commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696766543
Right, the scenario is that user run zeppelin-server in a docker container, he doesn't need k8s cluster, just docker container runtime. This is especially useful for new users who want to try zeppelin in a docker container without any setup. Here's the doc https://github.com/apache/zeppelin/blob/master/docs/setup/deployment/docker.md
BTW, it looks like the doc is missing in zeppelin site, we should also fix this as well.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] asfgit closed pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
asfgit closed pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] Reamer commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
Reamer commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696628058
The Interpreting process runs inside the Zeppelin server container?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] Reamer commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
Reamer commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696566517
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] zjffdu commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
zjffdu commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-701431910
Any more comment @Reamer
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] zjffdu commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
zjffdu commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-702723204
Will merge it if no more comment
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] zjffdu edited a comment on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
zjffdu edited a comment on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-701431910
Any more comment ? @Reamer
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] zjffdu commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
zjffdu commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696571729
But this command can only see the zeppelin server log, the issue here is that the interpreter log is missing because it is also written to stdout
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] Reamer edited a comment on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
Reamer edited a comment on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696566517
Hello @zjffdu,
docker containers should not write the logs to the OverlayFS. I think that our current [log4j.properties](https://github.com/apache/zeppelin/blob/master/scripts/docker/zeppelin/bin/log4j.properties) is sufficient.
You can view the logs with `docker logs xyz`.
If you write your logs only with 'ConsoleAppender'', then you can get all container logs with an agent like [Filebeat](https://www.elastic.co/guide/en/beats/filebeat/current/configuration-autodiscover.html#_docker_2) running on the host system.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] Reamer commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
Reamer commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696566517
Hello @zjffdu,
Dockers should not write the logs to the OverlayFS. I think that our current [log4j.properties](https://github.com/apache/zeppelin/blob/master/scripts/docker/zeppelin/bin/log4j.properties) is sufficient.
You can view the logs with `docker logs xyz`.
If you write your logs only with 'ConsoleAppender'', then you can get all container logs with an agent like [Filebeat](https://www.elastic.co/guide/en/beats/filebeat/current/configuration-autodiscover.html#_docker_2) running on the host system.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] Reamer edited a comment on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
Reamer edited a comment on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696566517
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] Reamer edited a comment on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
Reamer edited a comment on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696566517
Hello @zjffdu,
docker containers should not write the logs to the OverlayFS. I think that our current [log4j.properties](https://github.com/apache/zeppelin/blob/master/scripts/docker/zeppelin/bin/log4j.properties) is sufficient.
You can view the logs with `docker logs xyz`.
If you write your logs only with `ConsoleAppender`, then you can get all container logs with an agent like [Filebeat](https://www.elastic.co/guide/en/beats/filebeat/current/configuration-autodiscover.html#_docker_2) running on the host system.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [zeppelin] zjffdu commented on pull request #3918: [ZEPPELIN-5055]. Interpreter log is missing in zeppelin server docker container
Posted by GitBox <gi...@apache.org>.
zjffdu commented on pull request #3918:
URL: https://github.com/apache/zeppelin/pull/3918#issuecomment-696571729
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org