You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Sreejith S <sr...@gmail.com> on 2016/08/28 13:03:38 UTC
Programatically collect taskmanagers details from Job Manager
Hi All,
Is there any programmatic way to get the taskmanager details from a flink
clluster ?
At least the IP of taskmanagers ?
Thanks,
--
*Sreejith.S*
https://github.com/srijiths/
tweet2sree@twitter <http://tweet2Sree>
Re: Programatically collect taskmanagers details from Job Manager
Posted by Robert Metzger <rm...@apache.org>.
Hi,
I think the JMX port is logged, but not accessible through the REST
interface of the JobManager.
I think its a useful feature. If you want, you can file a JIRA for it.
On Mon, Aug 29, 2016 at 12:14 PM, Sreejith S <sr...@gmail.com> wrote:
> Thank you Stephen ! That helps,
>
> Is it possible to get the JMX_PORT kind of details from taskmanagers ?
>
> My program will connect to Job Manager and get all taskmaneger IP's and
> JMX Port and create a JMX_URL automatically. This is what i am trying to
> achieve.
>
> Is it possible ?
>
> Thanks,
>
> On Mon, Aug 29, 2016 at 2:38 PM, Stephan Ewen <se...@apache.org> wrote:
>
>> You should be able to call the Monitor handler of the JobManager:
>> http://jobmanagerhost:8081/taskmanagers
>>
>> That gives you a JSON response like this:
>>
>> { "taskmanagers [
>> { "id" : "7c8835b89acf533cb8a5119dbcaf4b4f",
>> "path" : "akka.tcp://flink@127.0.1.1:56343/user/taskmanager",
>> "dataPort" : 56199,
>> "timeSinceLastHeartbeat" : 1472461577563,
>> "slotsNumber" : 4,
>> ....},
>> { "id " :"460bfbf8b540bf28befd616cbc9ea532",
>> "path" : "akka.tcp://flink@127.0.1.1:58404/user/taskmanager",
>> "dataPort" : 39233,
>> "timeSinceLastHeartbeat" : 1472461577967,
>> "slotsNumber":4,
>> ....}
>> ]
>> }
>>
>> That should have the hostname/IP in the TaskManager URL:
>>
>> Hope that helps
>>
>> Stephan
>>
>>
>> On Sun, Aug 28, 2016 at 3:03 PM, Sreejith S <sr...@gmail.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> Is there any programmatic way to get the taskmanager details from a
>>> flink clluster ?
>>>
>>> At least the IP of taskmanagers ?
>>>
>>> Thanks,
>>>
>>> --
>>>
>>>
>>> *Sreejith.S*
>>> https://github.com/srijiths/
>>> tweet2sree@twitter <http://tweet2Sree>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
>
> --
>
>
> *Sreejith.S*
> https://github.com/srijiths/
> http://srijiths.wordpress.com/
> tweet2sree@twitter <http://tweet2Sree>
>
>
>
>
>
>
>
Re: Programatically collect taskmanagers details from Job Manager
Posted by Sreejith S <sr...@gmail.com>.
Thank you Stephen ! That helps,
Is it possible to get the JMX_PORT kind of details from taskmanagers ?
My program will connect to Job Manager and get all taskmaneger IP's and JMX
Port and create a JMX_URL automatically. This is what i am trying to
achieve.
Is it possible ?
Thanks,
On Mon, Aug 29, 2016 at 2:38 PM, Stephan Ewen <se...@apache.org> wrote:
> You should be able to call the Monitor handler of the JobManager:
> http://jobmanagerhost:8081/taskmanagers
>
> That gives you a JSON response like this:
>
> { "taskmanagers [
> { "id" : "7c8835b89acf533cb8a5119dbcaf4b4f",
> "path" : "akka.tcp://flink@127.0.1.1:56343/user/taskmanager",
> "dataPort" : 56199,
> "timeSinceLastHeartbeat" : 1472461577563,
> "slotsNumber" : 4,
> ....},
> { "id " :"460bfbf8b540bf28befd616cbc9ea532",
> "path" : "akka.tcp://flink@127.0.1.1:58404/user/taskmanager",
> "dataPort" : 39233,
> "timeSinceLastHeartbeat" : 1472461577967,
> "slotsNumber":4,
> ....}
> ]
> }
>
> That should have the hostname/IP in the TaskManager URL:
>
> Hope that helps
>
> Stephan
>
>
> On Sun, Aug 28, 2016 at 3:03 PM, Sreejith S <sr...@gmail.com> wrote:
>
>> Hi All,
>>
>> Is there any programmatic way to get the taskmanager details from a flink
>> clluster ?
>>
>> At least the IP of taskmanagers ?
>>
>> Thanks,
>>
>> --
>>
>>
>> *Sreejith.S*
>> https://github.com/srijiths/
>> tweet2sree@twitter <http://tweet2Sree>
>>
>>
>>
>>
>>
>>
>>
>
--
*Sreejith.S*
https://github.com/srijiths/
http://srijiths.wordpress.com/
tweet2sree@twitter <http://tweet2Sree>
Re: Programatically collect taskmanagers details from Job Manager
Posted by Stephan Ewen <se...@apache.org>.
You should be able to call the Monitor handler of the JobManager:
http://jobmanagerhost:8081/taskmanagers
That gives you a JSON response like this:
{ "taskmanagers [
{ "id" : "7c8835b89acf533cb8a5119dbcaf4b4f",
"path" : "akka.tcp://flink@127.0.1.1:56343/user/taskmanager",
"dataPort" : 56199,
"timeSinceLastHeartbeat" : 1472461577563,
"slotsNumber" : 4,
....},
{ "id " :"460bfbf8b540bf28befd616cbc9ea532",
"path" : "akka.tcp://flink@127.0.1.1:58404/user/taskmanager",
"dataPort" : 39233,
"timeSinceLastHeartbeat" : 1472461577967,
"slotsNumber":4,
....}
]
}
That should have the hostname/IP in the TaskManager URL:
Hope that helps
Stephan
On Sun, Aug 28, 2016 at 3:03 PM, Sreejith S <sr...@gmail.com> wrote:
> Hi All,
>
> Is there any programmatic way to get the taskmanager details from a flink
> clluster ?
>
> At least the IP of taskmanagers ?
>
> Thanks,
>
> --
>
>
> *Sreejith.S*
> https://github.com/srijiths/
> tweet2sree@twitter <http://tweet2Sree>
>
>
>
>
>
>
>