You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Thomas Jungblut (JIRA)" <ji...@apache.org> on 2011/09/22 13:01:27 UTC
[jira] [Created] (HAMA-441) Logging to distinct files and Web
Interface update
Logging to distinct files and Web Interface update
--------------------------------------------------
Key: HAMA-441
URL: https://issues.apache.org/jira/browse/HAMA-441
Project: Hama
Issue Type: Improvement
Affects Versions: 0.3.0
Reporter: Thomas Jungblut
We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-441:
---------------------------------
Attachment: HAMA-441.patch
Added a redirection of the STDOUT and ERR output to distinct log files.
It uses the system property of hamas log dir and puts the tasklogs into a subdirectory.
Layout is like following:
logs/tasklogs/job_id/task_id.log/err
At first I added a subdirectory for the task-attempt id, but it is the same like the task id currently, so I tagged this with a todo.
The web interface is a bit more work. We need to add a web server on the grooms and add the servlet which tails the files.
Then we have to add a job-report site where all tasks are listed.
Should we split this into smaller task? Or I guess nobody else want to do this?;D
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113055#comment-13113055 ]
Edward J. Yoon commented on HAMA-441:
-------------------------------------
If you have people around you who want to help this project, Pls invite them.
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113821#comment-13113821 ]
Hudson commented on HAMA-441:
-----------------------------
Integrated in Hama-Nightly #317 (See [https://builds.apache.org/job/Hama-Nightly/317/])
[HAMA-441] Tasks now logging to distinct files.
tjungblut :
Files :
* /incubator/hama/trunk/CHANGES.txt
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/GroomServer.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/TaskRunner.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/TestBSPMasterGroomServer.java
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13112472#comment-13112472 ]
Thomas Jungblut commented on HAMA-441:
--------------------------------------
Task log redirection is done in the class org.apache.hama.bsp.TaskRunner.
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113162#comment-13113162 ]
Thomas Jungblut commented on HAMA-441:
--------------------------------------
{quote}
You can close this after commit, and open new ticket.
{quote}
I guess this is the best thing to do. The web interface is very costly in terms of time.
Another vote on that? I'm submitting it to jenkins.
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113059#comment-13113059 ]
Edward J. Yoon commented on HAMA-441:
-------------------------------------
{quote}Should we split this into smaller task?{quote}
You can close this after commit, and open new ticket.
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-441:
---------------------------------
Fix Version/s: 0.4.0
Assignee: Thomas Jungblut
Status: Patch Available (was: Open)
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-441:
---------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-441) Logging to distinct files and Web
Interface update
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113519#comment-13113519 ]
Thomas Jungblut commented on HAMA-441:
--------------------------------------
Just committed this in 1174853. I open a new task for the web interface.
> Logging to distinct files and Web Interface update
> --------------------------------------------------
>
> Key: HAMA-441
> URL: https://issues.apache.org/jira/browse/HAMA-441
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-441.patch
>
>
> We should output the log of a task directly into the grooms local filesystem, instead of redirecting the log to the groom.
> Additionally we need to provide a web interface capability to tail the log files. Hadoop has similar features.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira