You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Nitay Joffe (JIRA)" <ji...@apache.org> on 2012/10/29 17:04:13 UTC
[jira] [Created] (GIRAPH-390) MasterCompute end of application
callback
Nitay Joffe created GIRAPH-390:
----------------------------------
Summary: MasterCompute end of application callback
Key: GIRAPH-390
URL: https://issues.apache.org/jira/browse/GIRAPH-390
Project: Giraph
Issue Type: Improvement
Reporter: Nitay Joffe
Assignee: Nitay Joffe
There is no way to run something on the master at the end of the application like in WorkerContext. This adds a method to MasterCompute to allow this.
I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-390) MasterCompute end of application
callback
Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486107#comment-13486107 ]
Nitay Joffe commented on GIRAPH-390:
------------------------------------
https://reviews.apache.org/r/7762/
> MasterCompute end of application callback
> -----------------------------------------
>
> Key: GIRAPH-390
> URL: https://issues.apache.org/jira/browse/GIRAPH-390
> Project: Giraph
> Issue Type: Improvement
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
>
> There is no way to run something on the master at the end of the application like in WorkerContext. This adds a method to MasterCompute to allow this.
> I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-390) MasterCompute end of application
callback
Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nitay Joffe updated GIRAPH-390:
-------------------------------
Attachment: GIRAPH-390-2.patch
> MasterCompute end of application callback
> -----------------------------------------
>
> Key: GIRAPH-390
> URL: https://issues.apache.org/jira/browse/GIRAPH-390
> Project: Giraph
> Issue Type: Improvement
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
> Attachments: GIRAPH-390-2.patch, GIRAPH-390.patch
>
>
> There is no way to run something on the master at the end of the application like in WorkerContext. This adds a MasterObserver which gets called at the end of the job by the master. The user can register as many MasterObservers as they like, allowing flexibility.
> I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
> https://reviews.apache.org/r/7762/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-390) MasterCompute end of application
callback
Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nitay Joffe updated GIRAPH-390:
-------------------------------
Attachment: GIRAPH-390.patch
> MasterCompute end of application callback
> -----------------------------------------
>
> Key: GIRAPH-390
> URL: https://issues.apache.org/jira/browse/GIRAPH-390
> Project: Giraph
> Issue Type: Improvement
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
> Attachments: GIRAPH-390.patch
>
>
> There is no way to run something on the master at the end of the application like in WorkerContext. This adds a method to MasterCompute to allow this.
> I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (GIRAPH-390) Observer for end of computation on
Master
Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nitay Joffe resolved GIRAPH-390.
--------------------------------
Resolution: Duplicate
> Observer for end of computation on Master
> -----------------------------------------
>
> Key: GIRAPH-390
> URL: https://issues.apache.org/jira/browse/GIRAPH-390
> Project: Giraph
> Issue Type: Improvement
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
> Attachments: GIRAPH-390-2.patch, GIRAPH-390.patch
>
>
> There is no way to run something on the master at the end of the application like in WorkerContext. This adds a MasterObserver which gets called at the end of the job by the master. The user can register as many MasterObservers as they like, allowing flexibility.
> I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
> https://reviews.apache.org/r/7762/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-390) MasterCompute end of application
callback
Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nitay Joffe updated GIRAPH-390:
-------------------------------
Description:
There is no way to run something on the master at the end of the application like in WorkerContext. This adds a MasterObserver which gets called at the end of the job by the master. The user can register as many MasterObservers as they like, allowing flexibility.
I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
https://reviews.apache.org/r/7762/
was:
There is no way to run something on the master at the end of the application like in WorkerContext. This adds a method to MasterCompute to allow this.
I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
> MasterCompute end of application callback
> -----------------------------------------
>
> Key: GIRAPH-390
> URL: https://issues.apache.org/jira/browse/GIRAPH-390
> Project: Giraph
> Issue Type: Improvement
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
> Attachments: GIRAPH-390.patch
>
>
> There is no way to run something on the master at the end of the application like in WorkerContext. This adds a MasterObserver which gets called at the end of the job by the master. The user can register as many MasterObservers as they like, allowing flexibility.
> I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
> https://reviews.apache.org/r/7762/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-390) Observer for end of computation on
Master
Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nitay Joffe updated GIRAPH-390:
-------------------------------
Summary: Observer for end of computation on Master (was: MasterCompute end of application callback)
> Observer for end of computation on Master
> -----------------------------------------
>
> Key: GIRAPH-390
> URL: https://issues.apache.org/jira/browse/GIRAPH-390
> Project: Giraph
> Issue Type: Improvement
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
> Attachments: GIRAPH-390-2.patch, GIRAPH-390.patch
>
>
> There is no way to run something on the master at the end of the application like in WorkerContext. This adds a MasterObserver which gets called at the end of the job by the master. The user can register as many MasterObservers as they like, allowing flexibility.
> I am using this to write the Hadoop counters to a database at the end of the job. As a part of this I also cleaned up the logic around those counters and made them more easily accessible by others.
> https://reviews.apache.org/r/7762/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira