You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Tomas Delvechio <to...@gmail.com> on 2015/07/14 00:17:01 UTC
node location of mapreduce task from CLI
Hi for all,
I'm trying to get the location of scheduled mapreduce tasks for a job in my
cluster from CLI because I don't have access to WebUI.
I saw [1] and [2], but I'm not lucky.
For location of reducer, I want to get some like this:
TASK_ID
TYPE (MAP or REDUCE)
IP_SLAVE
Any clue will be fine.
Thanks in advance.
[1]:
https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html
[2]:
https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-site/YarnCommands.html
--
Tomas Delvechio
Re: node location of mapreduce task from CLI
Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2015-07-13 19:29 GMT-03:00 Hitesh Shah <hi...@apache.org>:
>
> Maybe try the web services for the MR AM:
https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html
?
The cluster is behind a firewall, and I don't have HTTP access, only ssh :/
--
Tomas Delvechio
Blog: http://tomasdel.com
Twitter: http://twitter.com/tdelvechio
Skype: tomasdelvechio
Code: https://github.com/tomasdelvechio
Re: node location of mapreduce task from CLI
Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2015-07-13 19:29 GMT-03:00 Hitesh Shah <hi...@apache.org>:
>
> Maybe try the web services for the MR AM:
https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html
?
The cluster is behind a firewall, and I don't have HTTP access, only ssh :/
--
Tomas Delvechio
Blog: http://tomasdel.com
Twitter: http://twitter.com/tdelvechio
Skype: tomasdelvechio
Code: https://github.com/tomasdelvechio
Re: node location of mapreduce task from CLI
Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2015-07-13 19:29 GMT-03:00 Hitesh Shah <hi...@apache.org>:
>
> Maybe try the web services for the MR AM:
https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html
?
The cluster is behind a firewall, and I don't have HTTP access, only ssh :/
--
Tomas Delvechio
Blog: http://tomasdel.com
Twitter: http://twitter.com/tdelvechio
Skype: tomasdelvechio
Code: https://github.com/tomasdelvechio
Re: node location of mapreduce task from CLI
Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2015-07-13 19:29 GMT-03:00 Hitesh Shah <hi...@apache.org>:
>
> Maybe try the web services for the MR AM:
https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html
?
The cluster is behind a firewall, and I don't have HTTP access, only ssh :/
--
Tomas Delvechio
Blog: http://tomasdel.com
Twitter: http://twitter.com/tdelvechio
Skype: tomasdelvechio
Code: https://github.com/tomasdelvechio
Re: node location of mapreduce task from CLI
Posted by Hitesh Shah <hi...@apache.org>.
Maybe try the web services for the MR AM: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html ?
— Hitesh
On Jul 13, 2015, at 3:17 PM, Tomas Delvechio <to...@gmail.com> wrote:
> Hi for all,
>
> I'm trying to get the location of scheduled mapreduce tasks for a job in my cluster from CLI because I don't have access to WebUI.
>
> I saw [1] and [2], but I'm not lucky.
>
> For location of reducer, I want to get some like this:
>
> TASK_ID
> TYPE (MAP or REDUCE)
> IP_SLAVE
>
> Any clue will be fine.
>
> Thanks in advance.
>
> [1]: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html
> [2]: https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-site/YarnCommands.html
>
>
> --
> Tomas Delvechio
>
Re: node location of mapreduce task from CLI
Posted by Hitesh Shah <hi...@apache.org>.
Maybe try the web services for the MR AM: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html ?
— Hitesh
On Jul 13, 2015, at 3:17 PM, Tomas Delvechio <to...@gmail.com> wrote:
> Hi for all,
>
> I'm trying to get the location of scheduled mapreduce tasks for a job in my cluster from CLI because I don't have access to WebUI.
>
> I saw [1] and [2], but I'm not lucky.
>
> For location of reducer, I want to get some like this:
>
> TASK_ID
> TYPE (MAP or REDUCE)
> IP_SLAVE
>
> Any clue will be fine.
>
> Thanks in advance.
>
> [1]: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html
> [2]: https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-site/YarnCommands.html
>
>
> --
> Tomas Delvechio
>
Re: node location of mapreduce task from CLI
Posted by Hitesh Shah <hi...@apache.org>.
Maybe try the web services for the MR AM: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html ?
— Hitesh
On Jul 13, 2015, at 3:17 PM, Tomas Delvechio <to...@gmail.com> wrote:
> Hi for all,
>
> I'm trying to get the location of scheduled mapreduce tasks for a job in my cluster from CLI because I don't have access to WebUI.
>
> I saw [1] and [2], but I'm not lucky.
>
> For location of reducer, I want to get some like this:
>
> TASK_ID
> TYPE (MAP or REDUCE)
> IP_SLAVE
>
> Any clue will be fine.
>
> Thanks in advance.
>
> [1]: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html
> [2]: https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-site/YarnCommands.html
>
>
> --
> Tomas Delvechio
>
Re: node location of mapreduce task from CLI
Posted by Hitesh Shah <hi...@apache.org>.
Maybe try the web services for the MR AM: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html ?
— Hitesh
On Jul 13, 2015, at 3:17 PM, Tomas Delvechio <to...@gmail.com> wrote:
> Hi for all,
>
> I'm trying to get the location of scheduled mapreduce tasks for a job in my cluster from CLI because I don't have access to WebUI.
>
> I saw [1] and [2], but I'm not lucky.
>
> For location of reducer, I want to get some like this:
>
> TASK_ID
> TYPE (MAP or REDUCE)
> IP_SLAVE
>
> Any clue will be fine.
>
> Thanks in advance.
>
> [1]: https://hadoop.apache.org/docs/r2.7.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html
> [2]: https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-site/YarnCommands.html
>
>
> --
> Tomas Delvechio
>