You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Thomas Jungblut (JIRA)" <ji...@apache.org> on 2011/09/14 15:31:09 UTC
[jira] [Created] (HAMA-436) Web Interface does not update Superstep
Count
Web Interface does not update Superstep Count
---------------------------------------------
Key: HAMA-436
URL: https://issues.apache.org/jira/browse/HAMA-436
Project: Hama
Issue Type: Bug
Components: bsp
Affects Versions: 0.3.0
Reporter: Thomas Jungblut
Fix For: 0.4.0
Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] [Updated] (HAMA-436) Web Interface does not update
Superstep Count
Posted by "Edward J. Yoon" <ed...@apache.org>.
Tested on my test cluster. I'm committing this patch to update large
cluster status easily.
Please let me know if there's a problem.
On Fri, Nov 4, 2011 at 7:21 PM, Edward J. Yoon (Updated) (JIRA)
<ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> Edward J. Yoon updated HAMA-436:
> --------------------------------
>
> Attachment: patch.txt
>
> This patch fixes the problem and deleting unnecessary Thread.sleep() calls in a loop.
>
>> Web Interface does not update Superstep Count
>> ---------------------------------------------
>>
>> Key: HAMA-436
>> URL: https://issues.apache.org/jira/browse/HAMA-436
>> Project: Hama
>> Issue Type: Bug
>> Components: bsp
>> Affects Versions: 0.3.0
>> Reporter: Thomas Jungblut
>> Assignee: Thomas Jungblut
>> Fix For: 0.4.0
>>
>> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, patch.txt, superstepbug.png, test.png
>>
>>
>> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
--
Best Regards, Edward J. Yoon
@eddieyoon
[jira] [Resolved] (HAMA-436) Web Interface does not update
Superstep Count
Posted by "Thomas Jungblut (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut resolved HAMA-436.
----------------------------------
Resolution: Fixed
This is comitted and fixed.
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, patch.txt, superstepbug.png, test.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HAMA-436) Web Interface does not update
Superstep Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut reassigned HAMA-436:
------------------------------------
Assignee: Thomas Jungblut
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-436) Web Interface does not update
Superstep Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105308#comment-13105308 ]
Thomas Jungblut commented on HAMA-436:
--------------------------------------
I think this is okay for now, otherwise I have to pull out of the task scheduling and so on...
Can someone please check this?
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-436:
---------------------------------
Attachment: HAMA-436.patch
I messed up progress with getSuperSteps(). But I'm wondering why we are holding both, since the supersteps are always zero.
Would someone please review this?
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-436) Web Interface does not update
Superstep Count
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105668#comment-13105668 ]
Hudson commented on HAMA-436:
-----------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12494506/HAMA-436_1.patch
against trunk revision 1165994.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
core tests +1. The patch passed core unit tests.
Changes : http://builds.apache.org/hudson/job/Hama-Patch/355/changes/
Console output: http://builds.apache.org/hudson/job/Hama-Patch/355/console
This message is automatically generated.
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-436:
---------------------------------
Attachment: hostbug.PNG
Hmm there is another bug, which shows that there are for each host 1 tasks. Correct would be 3.
We can now take the currently running tasks per host into account too.
Let's put that into this issue, too.
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, hostbug.PNG, superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-436:
--------------------------------
Attachment: test.png
Tested on 2 nodes cluster and it works well!
+1
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png, test.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-436:
---------------------------------
Attachment: superstepbug.png
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-436) Web Interface does not update
Superstep Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106008#comment-13106008 ]
Thomas Jungblut commented on HAMA-436:
--------------------------------------
Fine.
Would you please commit this?:D So I can start with HAMA-437
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png, test.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-436:
---------------------------------
Status: Patch Available (was: Open)
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Edward J. Yoon (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-436:
--------------------------------
Attachment: patch.txt
This patch fixes the problem and deleting unnecessary Thread.sleep() calls in a loop.
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, patch.txt, superstepbug.png, test.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-436:
--------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've committed this!
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png, test.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HAMA-436) Web Interface does not update
Superstep Count
Posted by "Edward J. Yoon (Reopened) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon reopened HAMA-436:
---------------------------------
Web UI doen't update superstep count again. :o
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png, test.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-436) Web Interface does not update Superstep
Count
Posted by "Thomas Jungblut (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut updated HAMA-436:
---------------------------------
Attachment: HAMA-436_1.patch
I added some more information to the ClusterStatus.
The Webinterface now contains (like Hadoop) the number of current running task per host, the last seen and the maximum number of tasks.
Actually these datas are not working properly, I don't know why the data in the BSPMaster is not right.
For example while running bench example, every task should be used, I see the messages from them, but the web interface just shows a single task.
{noformat}
ubuntu.ubuntu-domain:61002 to ubuntu.ubuntu-domain:61000 : 512
ubuntu.ubuntu-domain:61002 to ubuntu.ubuntu-domain:61001 : 512
{noformat}
As you can see on the ports there are 3 tasks, but the interface just showed one.
It seems that the ''groomServers'' map in the master isn't updated correctly.
The heartbeat (last_seen) seem to be not used as well.
Additionally I observed that there is a problem with the PiEstimator example in local mode.
{noformat}
conf.set(MASTER_TASK, hostName + ":" + Constants.DEFAULT_PEER_PORT);
{noformat}
The default port does not exist in local mode.
> Web Interface does not update Superstep Count
> ---------------------------------------------
>
> Key: HAMA-436
> URL: https://issues.apache.org/jira/browse/HAMA-436
> Project: Hama
> Issue Type: Bug
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Thomas Jungblut
> Assignee: Thomas Jungblut
> Fix For: 0.4.0
>
> Attachments: HAMA-436.patch, HAMA-436_1.patch, hostbug.PNG, superstepbug.png
>
>
> Web Interface does not update Superstep Count during executiong of a job. See the Screenshot.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira