You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Alexander Lorenz-Alten (Created) (JIRA)" <ji...@apache.org> on 2012/02/28 11:29:48 UTC
[jira] [Created] (FLUME-1006) PID creation of starting flume agents
PID creation of starting flume agents
-------------------------------------
Key: FLUME-1006
URL: https://issues.apache.org/jira/browse/FLUME-1006
Project: Flume
Issue Type: Improvement
Components: Configuration
Affects Versions: v1.1.0
Reporter: Alexander Lorenz-Alten
New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1006) PID creation of starting flume
agents
Posted by "Alexander Lorenz-Alten (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219034#comment-13219034 ]
Alexander Lorenz-Alten commented on FLUME-1006:
-----------------------------------------------
Hi Brock,
to manage flume later we need a working PID environment, at the moment I found nothing similar. First flume have to start from a valid init script, here we need the PID of the process himself (getPID). After, when flume runs, flume could have a lot of channels in a configuration. For all of that channels (single threads) we need the PID of the thread too, to manage the flows (kill, status etc). For that I thought two separate classes are will be fine, the first get the PID of the flume-init process back (as .pid via /var/run/ or /proc/), the second a PID of a running thread for easier management. Its a idea, not more :)
thanks,
Alex
> PID creation of starting flume agents
> -------------------------------------
>
> Key: FLUME-1006
> URL: https://issues.apache.org/jira/browse/FLUME-1006
> Project: Flume
> Issue Type: Improvement
> Components: Configuration
> Affects Versions: v1.1.0
> Reporter: Alexander Lorenz-Alten
> Labels: config, pid
> Attachments: getPID.java, getThread.java
>
>
> New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1006) PID creation of starting flume
agents
Posted by "Brock Noland (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219021#comment-13219021 ]
Brock Noland commented on FLUME-1006:
-------------------------------------
Hi Alexander,
Are you looking for the pid to be written out in the log or in a .pid file?
Brock
> PID creation of starting flume agents
> -------------------------------------
>
> Key: FLUME-1006
> URL: https://issues.apache.org/jira/browse/FLUME-1006
> Project: Flume
> Issue Type: Improvement
> Components: Configuration
> Affects Versions: v1.1.0
> Reporter: Alexander Lorenz-Alten
> Labels: config, pid
> Attachments: getPID.java, getThread.java
>
>
> New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (FLUME-1006) PID creation of starting flume
agents
Posted by "Alexander Lorenz-Alten (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander Lorenz-Alten reassigned FLUME-1006:
---------------------------------------------
Assignee: Alexander Lorenz-Alten
> PID creation of starting flume agents
> -------------------------------------
>
> Key: FLUME-1006
> URL: https://issues.apache.org/jira/browse/FLUME-1006
> Project: Flume
> Issue Type: Improvement
> Components: Configuration
> Affects Versions: v1.1.0
> Reporter: Alexander Lorenz-Alten
> Assignee: Alexander Lorenz-Alten
> Labels: config, pid
> Attachments: getPID.java, getThread.java
>
>
> New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1006) PID creation of starting flume agents
Posted by "Alexander Lorenz-Alten (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander Lorenz-Alten updated FLUME-1006:
------------------------------------------
Attachment: getThread.java
get the PID from a java process via reflection, since flume starts as a thread safe process here we could printout the PID for managing / monitoring
> PID creation of starting flume agents
> -------------------------------------
>
> Key: FLUME-1006
> URL: https://issues.apache.org/jira/browse/FLUME-1006
> Project: Flume
> Issue Type: Improvement
> Components: Configuration
> Affects Versions: v1.1.0
> Reporter: Alexander Lorenz-Alten
> Labels: config, pid
> Attachments: getPID.java, getThread.java
>
>
> New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1006) PID creation of starting flume agents
Posted by "Alexander Lorenz-Alten (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander Lorenz-Alten updated FLUME-1006:
------------------------------------------
Attachment: getPID.java
> PID creation of starting flume agents
> -------------------------------------
>
> Key: FLUME-1006
> URL: https://issues.apache.org/jira/browse/FLUME-1006
> Project: Flume
> Issue Type: Improvement
> Components: Configuration
> Affects Versions: v1.1.0
> Reporter: Alexander Lorenz-Alten
> Labels: config, pid
> Attachments: getPID.java
>
>
> New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1006) PID creation of starting flume agents
Posted by "Alexander Lorenz-Alten (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander Lorenz-Alten updated FLUME-1006:
------------------------------------------
Status: Patch Available (was: Open)
Submitted for review
> PID creation of starting flume agents
> -------------------------------------
>
> Key: FLUME-1006
> URL: https://issues.apache.org/jira/browse/FLUME-1006
> Project: Flume
> Issue Type: Improvement
> Components: Configuration
> Affects Versions: v1.1.0
> Reporter: Alexander Lorenz-Alten
> Labels: config, pid
>
> New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1006) PID creation of starting flume
agents
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219450#comment-13219450 ]
Bruno Mahé commented on FLUME-1006:
-----------------------------------
Not sure if we all refer to the same thing when we talk about init scripts but from an Apache Bigtop (incubating) point of view, here is what we do:
The init script: https://github.com/apache/bigtop/blob/trunk/bigtop-packages/src/common/flume/flume-node.init
The wrapper script: https://github.com/apache/bigtop/blob/trunk/bigtop-packages/src/common/flume/install_flume.sh#L116
It feels a little bit hackish right now due to the way flume was spawning itself in 1.0.0, but some patches were sent and the situation should be much better for the coming version of Apache Flume (incubating).
But in any case, please keep things simple and stupid :)
> PID creation of starting flume agents
> -------------------------------------
>
> Key: FLUME-1006
> URL: https://issues.apache.org/jira/browse/FLUME-1006
> Project: Flume
> Issue Type: Improvement
> Components: Configuration
> Affects Versions: v1.1.0
> Reporter: Alexander Lorenz-Alten
> Labels: config, pid
> Attachments: getPID.java, getThread.java
>
>
> New class to let new flume agents write their own pid. Thats we need in future to start flume agents from init, for monitoring too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira