You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Wangda Tan <wh...@gmail.com> on 2016/10/18 23:46:21 UTC
[Discuss] Merge YARN-3368 to trunk
YARN Devs,
*Updates since Sep 22, 2016:*
We sent a merge YARN-3368 discussion email on Sep 22, 2016 and received
some valuable feedbacks, since then, we have updated:
*- The biggest change* is configuration model, the latest UI project
doesn't require to configure RM/Timeline-server's address in a separate
config (configs.env) any more, it will directly get timeline server address
from REST endpoint of RM, more details please refer to (YARN-5145)
And some minor fixes:
- Moved all temporary ember/npm build stuffs to target/ like all the other
projects.
- Removed unnecessary files in source tree and ASF license exclusions.
*Main content:*
We propose to merge YARN-3368 (YARN next generation web UI) development
branch into trunk for better development, would like to hear your thoughts
before sending out vote mail.
The new UI will co-exist with the old YARN UI, by default it is disabled.
Please refer to User documentation of the new YARN UI
<https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
for
more details.
In addition, There’re two working-in-progress features need the new UI to
be merged to trunk for further development.
1) UI of YARN Timeline Server v2 (YARN-2928)
2) UI of YARN ResourceManager Federation (YARN-2915).
*Status of YARN next generation web UI*
Completed features
- Cluster Overview Page
- Scheduler page
- Applications / Application / Application-attempts pages
- Nodes / Node page
Integration to YARN
- Hosts new web UI in RM
- Integrates to maven build / package
Miscs:
- Added dependencies to LICENSE.txt/NOTICE.txt
- Documentated how to use it. (In hadoop-yarn-project/hadoop-yarn/hadoop-
yarn-site/src/site/markdown/YarnUI2.md)
Major items will finish on trunk:
- Security support
We have run the new UI in our internal cluster for more than 3 months, lots
of people have tried the new UI and gave lots of valuable feedbacks and
reported suggestions / issues to us. We fixed many of them so now we
believe it is more ready for wider folks to try.
Merge JIRA for Jenkins is: https://issues.apache.org/jira/browse/YARN-4734.
The latest Jenkins run
<https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15583884&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15583884>
gave
+1.
Please share your thoughts about this.
Thanks,
Wangda
Re: [Discuss] Merge YARN-3368 to trunk
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Wangda and all other contributors to new YarnWeb UI work.
I am able to built and deploy the Yarn WebUI from branch YARN-3368. The
look and feel of UI is pretty much impressive. The new web UI hosted along
with same http port of existing web UI. I could able to navigate all the
tabs such as Cluster Overview, Queues, Applications, Nodes pages and
verified information displayed.
As mentioned by Wangda, Timelinev2 integration is next phase of work to be
done. Merging will definitely help for moving forward for Atsv2
integration.
I am +1 for merging to trunk.
Thanks & Regards
Rohith Sharma K S
On 19 October 2016 at 05:16, Wangda Tan <wh...@gmail.com> wrote:
> YARN Devs,
>
> *Updates since Sep 22, 2016:*
>
> We sent a merge YARN-3368 discussion email on Sep 22, 2016 and received
> some valuable feedbacks, since then, we have updated:
>
> *- The biggest change* is configuration model, the latest UI project
> doesn't require to configure RM/Timeline-server's address in a separate
> config (configs.env) any more, it will directly get timeline server address
> from REST endpoint of RM, more details please refer to (YARN-5145)
>
> And some minor fixes:
> - Moved all temporary ember/npm build stuffs to target/ like all the other
> projects.
> - Removed unnecessary files in source tree and ASF license exclusions.
>
> *Main content:*
>
> We propose to merge YARN-3368 (YARN next generation web UI) development
> branch into trunk for better development, would like to hear your thoughts
> before sending out vote mail.
>
> The new UI will co-exist with the old YARN UI, by default it is disabled.
> Please refer to User documentation of the new YARN UI
> <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-
> yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> for
> more details.
>
> In addition, There’re two working-in-progress features need the new UI to
> be merged to trunk for further development.
>
> 1) UI of YARN Timeline Server v2 (YARN-2928)
> 2) UI of YARN ResourceManager Federation (YARN-2915).
>
> *Status of YARN next generation web UI*
>
> Completed features
>
> - Cluster Overview Page
> - Scheduler page
> - Applications / Application / Application-attempts pages
> - Nodes / Node page
>
> Integration to YARN
>
> - Hosts new web UI in RM
> - Integrates to maven build / package
>
> Miscs:
>
> - Added dependencies to LICENSE.txt/NOTICE.txt
> - Documentated how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> yarn-site/src/site/markdown/YarnUI2.md)
>
> Major items will finish on trunk:
>
> - Security support
>
> We have run the new UI in our internal cluster for more than 3 months, lots
> of people have tried the new UI and gave lots of valuable feedbacks and
> reported suggestions / issues to us. We fixed many of them so now we
> believe it is more ready for wider folks to try.
>
> Merge JIRA for Jenkins is: https://issues.apache.org/jira/browse/YARN-4734
> .
> The latest Jenkins run
> <https://issues.apache.org/jira/browse/YARN-4734?
> focusedCommentId=15583884&page=com.atlassian.jira.
> plugin.system.issuetabpanels:comment-tabpanel#comment-15583884>
> gave
> +1.
>
> Please share your thoughts about this.
>
> Thanks,
> Wangda
>
Re: [Discuss] Merge YARN-3368 to trunk
Posted by Li Lu <ll...@hortonworks.com>.
Thanks Wangda and all contributors to the new UI work. This is great! As Wangda mentioned in the mail, the ongoing work of timeline service v2 works with the new UI framework. Besides other significant benefits, merging YARN-3368 back to trunk can greatly simplify the development process of downstream features like timeline v2. In this mail it looks like we’ve addressed community concerns that previously block this from merging back, so shall we plan to merge this to trunk soon? Thanks!
Li Lu
> On Oct 18, 2016, at 16:46, Wangda Tan <wh...@gmail.com> wrote:
>
> YARN Devs,
>
> *Updates since Sep 22, 2016:*
>
> We sent a merge YARN-3368 discussion email on Sep 22, 2016 and received
> some valuable feedbacks, since then, we have updated:
>
> *- The biggest change* is configuration model, the latest UI project
> doesn't require to configure RM/Timeline-server's address in a separate
> config (configs.env) any more, it will directly get timeline server address
> from REST endpoint of RM, more details please refer to (YARN-5145)
>
> And some minor fixes:
> - Moved all temporary ember/npm build stuffs to target/ like all the other
> projects.
> - Removed unnecessary files in source tree and ASF license exclusions.
>
> *Main content:*
>
> We propose to merge YARN-3368 (YARN next generation web UI) development
> branch into trunk for better development, would like to hear your thoughts
> before sending out vote mail.
>
> The new UI will co-exist with the old YARN UI, by default it is disabled.
> Please refer to User documentation of the new YARN UI
> <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> for
> more details.
>
> In addition, There’re two working-in-progress features need the new UI to
> be merged to trunk for further development.
>
> 1) UI of YARN Timeline Server v2 (YARN-2928)
> 2) UI of YARN ResourceManager Federation (YARN-2915).
>
> *Status of YARN next generation web UI*
>
> Completed features
>
> - Cluster Overview Page
> - Scheduler page
> - Applications / Application / Application-attempts pages
> - Nodes / Node page
>
> Integration to YARN
>
> - Hosts new web UI in RM
> - Integrates to maven build / package
>
> Miscs:
>
> - Added dependencies to LICENSE.txt/NOTICE.txt
> - Documentated how to use it. (In hadoop-yarn-project/hadoop-yarn/hadoop-
> yarn-site/src/site/markdown/YarnUI2.md)
>
> Major items will finish on trunk:
>
> - Security support
>
> We have run the new UI in our internal cluster for more than 3 months, lots
> of people have tried the new UI and gave lots of valuable feedbacks and
> reported suggestions / issues to us. We fixed many of them so now we
> believe it is more ready for wider folks to try.
>
> Merge JIRA for Jenkins is: https://issues.apache.org/jira/browse/YARN-4734.
> The latest Jenkins run
> <https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15583884&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15583884>
> gave
> +1.
>
> Please share your thoughts about this.
>
> Thanks,
> Wangda
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [Discuss] Merge YARN-3368 to trunk
Posted by Sreenath Somarajapuram <ss...@hortonworks.com>.
Tried the UI.
+1 LGTM
Thanks,
- Sreenath
On 10/24/16, 11:19 AM, "Sunil Govind" <su...@gmail.com> wrote:
>Thanks Wangda for starting the thread.
>
>Tested latest patch against trunk. UI looks good. +1 for the merge.
>
>+ Sunil
>
>On Wed, Oct 19, 2016 at 5:16 AM Wangda Tan <wh...@gmail.com> wrote:
>
>> YARN Devs,
>>
>> *Updates since Sep 22, 2016:*
>>
>> We sent a merge YARN-3368 discussion email on Sep 22, 2016 and received
>> some valuable feedbacks, since then, we have updated:
>>
>> *- The biggest change* is configuration model, the latest UI project
>> doesn't require to configure RM/Timeline-server's address in a separate
>> config (configs.env) any more, it will directly get timeline server
>>address
>> from REST endpoint of RM, more details please refer to (YARN-5145)
>>
>> And some minor fixes:
>> - Moved all temporary ember/npm build stuffs to target/ like all the
>>other
>> projects.
>> - Removed unnecessary files in source tree and ASF license exclusions.
>>
>> *Main content:*
>>
>> We propose to merge YARN-3368 (YARN next generation web UI) development
>> branch into trunk for better development, would like to hear your
>>thoughts
>> before sending out vote mail.
>>
>> The new UI will co-exist with the old YARN UI, by default it is
>>disabled.
>> Please refer to User documentation of the new YARN UI
>> <
>>
>>https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn-project/hadoo
>>p-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md
>> >
>> for
>> more details.
>>
>> In addition, There¹re two working-in-progress features need the new UI
>>to
>> be merged to trunk for further development.
>>
>> 1) UI of YARN Timeline Server v2 (YARN-2928)
>> 2) UI of YARN ResourceManager Federation (YARN-2915).
>>
>> *Status of YARN next generation web UI*
>>
>> Completed features
>>
>> - Cluster Overview Page
>> - Scheduler page
>> - Applications / Application / Application-attempts pages
>> - Nodes / Node page
>>
>> Integration to YARN
>>
>> - Hosts new web UI in RM
>> - Integrates to maven build / package
>>
>> Miscs:
>>
>> - Added dependencies to LICENSE.txt/NOTICE.txt
>> - Documentated how to use it. (In
>> hadoop-yarn-project/hadoop-yarn/hadoop-
>> yarn-site/src/site/markdown/YarnUI2.md)
>>
>> Major items will finish on trunk:
>>
>> - Security support
>>
>> We have run the new UI in our internal cluster for more than 3 months,
>>lots
>> of people have tried the new UI and gave lots of valuable feedbacks and
>> reported suggestions / issues to us. We fixed many of them so now we
>> believe it is more ready for wider folks to try.
>>
>> Merge JIRA for Jenkins is:
>>https://issues.apache.org/jira/browse/YARN-4734
>> .
>> The latest Jenkins run
>> <
>>
>>https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15583884
>>&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#co
>>mment-15583884
>> >
>> gave
>> +1.
>>
>> Please share your thoughts about this.
>>
>> Thanks,
>> Wangda
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [Discuss] Merge YARN-3368 to trunk
Posted by Sunil Govind <su...@gmail.com>.
Thanks Wangda for starting the thread.
Tested latest patch against trunk. UI looks good. +1 for the merge.
+ Sunil
On Wed, Oct 19, 2016 at 5:16 AM Wangda Tan <wh...@gmail.com> wrote:
> YARN Devs,
>
> *Updates since Sep 22, 2016:*
>
> We sent a merge YARN-3368 discussion email on Sep 22, 2016 and received
> some valuable feedbacks, since then, we have updated:
>
> *- The biggest change* is configuration model, the latest UI project
> doesn't require to configure RM/Timeline-server's address in a separate
> config (configs.env) any more, it will directly get timeline server address
> from REST endpoint of RM, more details please refer to (YARN-5145)
>
> And some minor fixes:
> - Moved all temporary ember/npm build stuffs to target/ like all the other
> projects.
> - Removed unnecessary files in source tree and ASF license exclusions.
>
> *Main content:*
>
> We propose to merge YARN-3368 (YARN next generation web UI) development
> branch into trunk for better development, would like to hear your thoughts
> before sending out vote mail.
>
> The new UI will co-exist with the old YARN UI, by default it is disabled.
> Please refer to User documentation of the new YARN UI
> <
> https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md
> >
> for
> more details.
>
> In addition, There’re two working-in-progress features need the new UI to
> be merged to trunk for further development.
>
> 1) UI of YARN Timeline Server v2 (YARN-2928)
> 2) UI of YARN ResourceManager Federation (YARN-2915).
>
> *Status of YARN next generation web UI*
>
> Completed features
>
> - Cluster Overview Page
> - Scheduler page
> - Applications / Application / Application-attempts pages
> - Nodes / Node page
>
> Integration to YARN
>
> - Hosts new web UI in RM
> - Integrates to maven build / package
>
> Miscs:
>
> - Added dependencies to LICENSE.txt/NOTICE.txt
> - Documentated how to use it. (In
> hadoop-yarn-project/hadoop-yarn/hadoop-
> yarn-site/src/site/markdown/YarnUI2.md)
>
> Major items will finish on trunk:
>
> - Security support
>
> We have run the new UI in our internal cluster for more than 3 months, lots
> of people have tried the new UI and gave lots of valuable feedbacks and
> reported suggestions / issues to us. We fixed many of them so now we
> believe it is more ready for wider folks to try.
>
> Merge JIRA for Jenkins is: https://issues.apache.org/jira/browse/YARN-4734
> .
> The latest Jenkins run
> <
> https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15583884&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15583884
> >
> gave
> +1.
>
> Please share your thoughts about this.
>
> Thanks,
> Wangda
>