You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Wangda Tan <wh...@gmail.com> on 2016/10/31 22:53:38 UTC
[VOTE] Merge YARN-3368 (new web UI) to trunk
YARN Devs,
We propose to merge YARN-3368 (YARN next generation web UI) development
branch into trunk for better development, would like to hear your thoughts
before sending out vote mail.
The new UI will co-exist with the old YARN UI, by default it is disabled.
Please refer to User documentation of the new YARN UI
<https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
for
more details.
In addition, There’re two working-in-progress features need the new UI to
be merged to trunk for further development.
1) UI of YARN Timeline Server v2 (YARN-2928)
2) UI of YARN ResourceManager Federation (YARN-2915).
*Status of YARN next generation web UI*
Completed features
- Cluster Overview Page
- Scheduler page
- Applications / Application / Application-attempts pages
- Nodes / Node page
Integration to YARN
- Hosts new web UI in RM
- Integrates to maven build / package
Miscs:
- Added dependencies to LICENSE.txt/NOTICE.txt
- Documented how to use it. (In hadoop-yarn-project/hadoop-yarn/hadoop-
yarn-site/src/site/markdown/YarnUI2.md)
Major items will finish on trunk:
- Security support
We have run the new UI in our internal cluster for more than 3 months, lots
of people have tried the new UI and gave lots of valuable feedbacks and
reported suggestions / issues to us. We fixed many of them so now we
believe it is more ready for wider folks to try.
Merge JIRA for Jenkins is: https://issues.apache.org/jira/browse/YARN-4734.
The latest Jenkins run
<https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15620808&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15620808>
gave
+1.
The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
comment if you have any questions/doubts. I'll start with my +1 (binding).
Please share your thoughts about this.
Thanks,
Wangda
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Wangda Tan <wh...@gmail.com>.
Thanks everybody for voting, we get 3 binding +1 (Sunil and Rohith are all
committers so their votes should be considered as binding vote for branch
merge) and no -1. So vote is passed.
Thanks Sunil, Sreenath, Varun Saxena, Akhil, Li Lu, Kai Sasaki, Padma,
Weiwei Yang, Rohith for contributing to YARN-3368 branch. Thanks Vinod,
Jian, Allen, Varun Vasudev, Gour, Yufei, Yesha, Sumana, Kostas, Ravi and a
bunch of other folks for testing, review and giving suggestions to the
feature. Especially thanks Sunil and Sreeanth for maintaining the branch!
Just merged and pushed YARN-3368 to trunk, configured pseudo cluster with
new UI and without new UI, submitted simple job which can successfully
finished on both setups.
Regards,
Wangda
On Fri, Nov 4, 2016 at 1:26 PM, Konstantinos Karanasos <kkaranasos@gmail.com
> wrote:
> Thanks for all the effort, Wangda!
> New Web UI looks very nice.
>
> I deployed in a 10-node cluster, ran some sample jobs, and then also
> changed the capacity scheduler configuration adding some extra queues.
>
> Everything worked well and looked good.
>
> +1 from me (non-binding).
>
> Thanks,
> Konstantinos
>
> On Thu, Nov 3, 2016 at 2:30 AM, Sreenath Somarajapuram <
> ssomarajapuram@hortonworks.com> wrote:
>
>>
>> Tried out the UI in my local cluster, and looks good to me.
>> +1(non-binding)
>>
>> Thanks,
>> Sreenath
>>
>>
>> On 11/1/16, 11:13 PM, "Sunil Govind" <su...@gmail.com> wrote:
>>
>> >Thank you very much Wangda for starting the vote thread.
>> >
>> >I have launched new UI in a 5 node cluster and tested. All pages are
>> >loading fine and provides necessary information.
>> >I think new UI will be a very good addition and it can provide a lot of
>> >information which user seeking for in much easier way compared to now.
>> >
>> >+1(non-binding) from me.
>> >
>> >Thanks,
>> >Sunil
>> >
>> >
>> >On Tue, Nov 1, 2016 at 4:24 AM Wangda Tan <wh...@gmail.com> wrote:
>> >
>> >> YARN Devs,
>> >>
>> >> We propose to merge YARN-3368 (YARN next generation web UI) development
>> >> branch into trunk for better development, would like to hear your
>> >>thoughts
>> >> before sending out vote mail.
>> >>
>> >> The new UI will co-exist with the old YARN UI, by default it is
>> >>disabled.
>> >> Please refer to User documentation of the new YARN UI
>> >> <
>> >>
>> >>https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yar
>> n-project/hadoo
>> >>p-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md
>> >> >
>> >> for
>> >> more details.
>> >>
>> >> In addition, There¹re two working-in-progress features need the new UI
>> >>to
>> >> be merged to trunk for further development.
>> >>
>> >> 1) UI of YARN Timeline Server v2 (YARN-2928)
>> >> 2) UI of YARN ResourceManager Federation (YARN-2915).
>> >>
>> >> *Status of YARN next generation web UI*
>> >>
>> >> Completed features
>> >>
>> >> - Cluster Overview Page
>> >> - Scheduler page
>> >> - Applications / Application / Application-attempts pages
>> >> - Nodes / Node page
>> >>
>> >> Integration to YARN
>> >>
>> >> - Hosts new web UI in RM
>> >> - Integrates to maven build / package
>> >>
>> >> Miscs:
>> >>
>> >> - Added dependencies to LICENSE.txt/NOTICE.txt
>> >> - Documented how to use it. (In
>> >>hadoop-yarn-project/hadoop-yarn/hadoop-
>> >> yarn-site/src/site/markdown/YarnUI2.md)
>> >>
>> >> Major items will finish on trunk:
>> >>
>> >> - Security support
>> >>
>> >> We have run the new UI in our internal cluster for more than 3 months,
>> >>lots
>> >> of people have tried the new UI and gave lots of valuable feedbacks and
>> >> reported suggestions / issues to us. We fixed many of them so now we
>> >> believe it is more ready for wider folks to try.
>> >>
>> >> Merge JIRA for Jenkins is:
>> >>https://issues.apache.org/jira/browse/YARN-4734
>> >> .
>> >> The latest Jenkins run
>> >> <
>> >>
>> >>https://issues.apache.org/jira/browse/YARN-4734?focusedCom
>> mentId=15620808
>> >>&page=com.atlassian.jira.plugin.system.issuetabpanels:comm
>> ent-tabpanel#co
>> >>mment-15620808
>> >> >
>> >> gave
>> >> +1.
>> >>
>> >> The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free
>> >>to
>> >> comment if you have any questions/doubts. I'll start with my +1
>> >>(binding).
>> >>
>> >> Please share your thoughts about this.
>> >>
>> >> Thanks,
>> >> Wangda
>> >>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Konstantinos Karanasos <kk...@gmail.com>.
Thanks for all the effort, Wangda!
New Web UI looks very nice.
I deployed in a 10-node cluster, ran some sample jobs, and then also
changed the capacity scheduler configuration adding some extra queues.
Everything worked well and looked good.
+1 from me (non-binding).
Thanks,
Konstantinos
On Thu, Nov 3, 2016 at 2:30 AM, Sreenath Somarajapuram <
ssomarajapuram@hortonworks.com> wrote:
>
> Tried out the UI in my local cluster, and looks good to me.
> +1(non-binding)
>
> Thanks,
> Sreenath
>
>
> On 11/1/16, 11:13 PM, "Sunil Govind" <su...@gmail.com> wrote:
>
> >Thank you very much Wangda for starting the vote thread.
> >
> >I have launched new UI in a 5 node cluster and tested. All pages are
> >loading fine and provides necessary information.
> >I think new UI will be a very good addition and it can provide a lot of
> >information which user seeking for in much easier way compared to now.
> >
> >+1(non-binding) from me.
> >
> >Thanks,
> >Sunil
> >
> >
> >On Tue, Nov 1, 2016 at 4:24 AM Wangda Tan <wh...@gmail.com> wrote:
> >
> >> YARN Devs,
> >>
> >> We propose to merge YARN-3368 (YARN next generation web UI) development
> >> branch into trunk for better development, would like to hear your
> >>thoughts
> >> before sending out vote mail.
> >>
> >> The new UI will co-exist with the old YARN UI, by default it is
> >>disabled.
> >> Please refer to User documentation of the new YARN UI
> >> <
> >>
> >>https://github.com/apache/hadoop/blob/YARN-3368/hadoop-
> yarn-project/hadoo
> >>p-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md
> >> >
> >> for
> >> more details.
> >>
> >> In addition, There¹re two working-in-progress features need the new UI
> >>to
> >> be merged to trunk for further development.
> >>
> >> 1) UI of YARN Timeline Server v2 (YARN-2928)
> >> 2) UI of YARN ResourceManager Federation (YARN-2915).
> >>
> >> *Status of YARN next generation web UI*
> >>
> >> Completed features
> >>
> >> - Cluster Overview Page
> >> - Scheduler page
> >> - Applications / Application / Application-attempts pages
> >> - Nodes / Node page
> >>
> >> Integration to YARN
> >>
> >> - Hosts new web UI in RM
> >> - Integrates to maven build / package
> >>
> >> Miscs:
> >>
> >> - Added dependencies to LICENSE.txt/NOTICE.txt
> >> - Documented how to use it. (In
> >>hadoop-yarn-project/hadoop-yarn/hadoop-
> >> yarn-site/src/site/markdown/YarnUI2.md)
> >>
> >> Major items will finish on trunk:
> >>
> >> - Security support
> >>
> >> We have run the new UI in our internal cluster for more than 3 months,
> >>lots
> >> of people have tried the new UI and gave lots of valuable feedbacks and
> >> reported suggestions / issues to us. We fixed many of them so now we
> >> believe it is more ready for wider folks to try.
> >>
> >> Merge JIRA for Jenkins is:
> >>https://issues.apache.org/jira/browse/YARN-4734
> >> .
> >> The latest Jenkins run
> >> <
> >>
> >>https://issues.apache.org/jira/browse/YARN-4734?
> focusedCommentId=15620808
> >>&page=com.atlassian.jira.plugin.system.issuetabpanels:
> comment-tabpanel#co
> >>mment-15620808
> >> >
> >> gave
> >> +1.
> >>
> >> The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free
> >>to
> >> comment if you have any questions/doubts. I'll start with my +1
> >>(binding).
> >>
> >> Please share your thoughts about this.
> >>
> >> Thanks,
> >> Wangda
> >>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Sreenath Somarajapuram <ss...@hortonworks.com>.
Tried out the UI in my local cluster, and looks good to me.
+1(non-binding)
Thanks,
Sreenath
On 11/1/16, 11:13 PM, "Sunil Govind" <su...@gmail.com> wrote:
>Thank you very much Wangda for starting the vote thread.
>
>I have launched new UI in a 5 node cluster and tested. All pages are
>loading fine and provides necessary information.
>I think new UI will be a very good addition and it can provide a lot of
>information which user seeking for in much easier way compared to now.
>
>+1(non-binding) from me.
>
>Thanks,
>Sunil
>
>
>On Tue, Nov 1, 2016 at 4:24 AM Wangda Tan <wh...@gmail.com> wrote:
>
>> YARN Devs,
>>
>> We propose to merge YARN-3368 (YARN next generation web UI) development
>> branch into trunk for better development, would like to hear your
>>thoughts
>> before sending out vote mail.
>>
>> The new UI will co-exist with the old YARN UI, by default it is
>>disabled.
>> Please refer to User documentation of the new YARN UI
>> <
>>
>>https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn-project/hadoo
>>p-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md
>> >
>> for
>> more details.
>>
>> In addition, There¹re two working-in-progress features need the new UI
>>to
>> be merged to trunk for further development.
>>
>> 1) UI of YARN Timeline Server v2 (YARN-2928)
>> 2) UI of YARN ResourceManager Federation (YARN-2915).
>>
>> *Status of YARN next generation web UI*
>>
>> Completed features
>>
>> - Cluster Overview Page
>> - Scheduler page
>> - Applications / Application / Application-attempts pages
>> - Nodes / Node page
>>
>> Integration to YARN
>>
>> - Hosts new web UI in RM
>> - Integrates to maven build / package
>>
>> Miscs:
>>
>> - Added dependencies to LICENSE.txt/NOTICE.txt
>> - Documented how to use it. (In
>>hadoop-yarn-project/hadoop-yarn/hadoop-
>> yarn-site/src/site/markdown/YarnUI2.md)
>>
>> Major items will finish on trunk:
>>
>> - Security support
>>
>> We have run the new UI in our internal cluster for more than 3 months,
>>lots
>> of people have tried the new UI and gave lots of valuable feedbacks and
>> reported suggestions / issues to us. We fixed many of them so now we
>> believe it is more ready for wider folks to try.
>>
>> Merge JIRA for Jenkins is:
>>https://issues.apache.org/jira/browse/YARN-4734
>> .
>> The latest Jenkins run
>> <
>>
>>https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15620808
>>&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#co
>>mment-15620808
>> >
>> gave
>> +1.
>>
>> The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free
>>to
>> comment if you have any questions/doubts. I'll start with my +1
>>(binding).
>>
>> Please share your thoughts about this.
>>
>> Thanks,
>> Wangda
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Sunil Govind <su...@gmail.com>.
Thank you very much Wangda for starting the vote thread.
I have launched new UI in a 5 node cluster and tested. All pages are
loading fine and provides necessary information.
I think new UI will be a very good addition and it can provide a lot of
information which user seeking for in much easier way compared to now.
+1(non-binding) from me.
Thanks,
Sunil
On Tue, Nov 1, 2016 at 4:24 AM Wangda Tan <wh...@gmail.com> wrote:
> YARN Devs,
>
> We propose to merge YARN-3368 (YARN next generation web UI) development
> branch into trunk for better development, would like to hear your thoughts
> before sending out vote mail.
>
> The new UI will co-exist with the old YARN UI, by default it is disabled.
> Please refer to User documentation of the new YARN UI
> <
> https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md
> >
> for
> more details.
>
> In addition, There’re two working-in-progress features need the new UI to
> be merged to trunk for further development.
>
> 1) UI of YARN Timeline Server v2 (YARN-2928)
> 2) UI of YARN ResourceManager Federation (YARN-2915).
>
> *Status of YARN next generation web UI*
>
> Completed features
>
> - Cluster Overview Page
> - Scheduler page
> - Applications / Application / Application-attempts pages
> - Nodes / Node page
>
> Integration to YARN
>
> - Hosts new web UI in RM
> - Integrates to maven build / package
>
> Miscs:
>
> - Added dependencies to LICENSE.txt/NOTICE.txt
> - Documented how to use it. (In hadoop-yarn-project/hadoop-yarn/hadoop-
> yarn-site/src/site/markdown/YarnUI2.md)
>
> Major items will finish on trunk:
>
> - Security support
>
> We have run the new UI in our internal cluster for more than 3 months, lots
> of people have tried the new UI and gave lots of valuable feedbacks and
> reported suggestions / issues to us. We fixed many of them so now we
> believe it is more ready for wider folks to try.
>
> Merge JIRA for Jenkins is: https://issues.apache.org/jira/browse/YARN-4734
> .
> The latest Jenkins run
> <
> https://issues.apache.org/jira/browse/YARN-4734?focusedCommentId=15620808&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15620808
> >
> gave
> +1.
>
> The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> comment if you have any questions/doubts. I'll start with my +1 (binding).
>
> Please share your thoughts about this.
>
> Thanks,
> Wangda
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Vrushali C <vr...@gmail.com>.
Thanks everyone. The new YARN UI v2 has now landed on branch-2 with the
merge done with --no-ff.
We will keep monitoring this to see if any issues arise.
Special thanks to Sunil Govind, Wangda Tan and Varun Saxena for all their
help on completing this.
Details at
https://issues.apache.org/jira/browse/YARN-7169
https://github.com/apache/hadoop/commit/769087288ad753ca58509ff3fe5efcc2d2b061aa
thanks
Vrushali
On Fri, Oct 20, 2017 at 1:00 AM, Sunil G <su...@apache.org> wrote:
> Thanks Vrushali for helping to backport YARN-7170 as well.
>
> +1 from my end. tested UI against latest branch and all pages seems to
> work fine.
>
> - Sunil
>
>
> On Fri, Oct 20, 2017 at 11:07 AM Vrushali C <vr...@gmail.com>
> wrote:
>
>> Thanks everyone!
>>
>> Subru: Yes, I will back-port YARN-7170 as well.
>>
>> Will do some more sanity tests and check QA for YARN-3368_branch2 and
>> then will proceed with the merge to branch2.
>>
>> thanks
>> Vrushali
>>
>>
>> On Thu, Oct 19, 2017 at 3:24 PM, Subramaniam V K <su...@gmail.com>
>> wrote:
>>
>>> I think we should get in YARN-7170 before we merge the UI to branch-2
>>> especially since it looks like it is ready for commit?
>>>
>>> Thanks,
>>> Subru
>>>
>>> On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
>>>
>>>> Eric, thanks for updating your vote! I just committed YARN-7338
>>>>
>>>> Vrushali:
>>>>
>>>> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0,
>>>> I'm
>>>> preferred to merge all existing JIRAs to branch-2 first and backport
>>>> YARN-7364 separately.
>>>>
>>>> Thanks,
>>>> Wangda
>>>>
>>>>
>>>> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com>
>>>> wrote:
>>>>
>>>> > +1 on merge when YARN-7338 is resolved.
>>>> >
>>>> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>>>> >
>>>> > Thank you
>>>> >
>>>> > Regards,
>>>> > Eric
>>>> >
>>>> > From: Vrushali C <vr...@gmail.com>
>>>> > Date: Monday, October 16, 2017 at 3:26 PM
>>>> > To: Eric Yang <ey...@hortonworks.com>
>>>> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
>>>> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
>>>> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
>>>> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>>> >
>>>> > Thanks Eric, I have filed https://issues.apache.org/
>>>> > jira/browse/YARN-7338 to track this.
>>>> >
>>>> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
>>>> > <ma...@hortonworks.com>> wrote:
>>>> > -1 (binding).
>>>> >
>>>> > Ui2 does not seem to support same origin policy for cross site
>>>> > scripting prevention.
>>>> > The following parameters has no effect for /ui2:
>>>> >
>>>> > hadoop.http.cross-origin.enabled = true
>>>> > yarn.resourcemanager.webapp.cross-origin.enabled = true
>>>> >
>>>> > This is because ui2 is designed as a separate web application.
>>>> > WebFilters setup for existing resource manager doesn’t apply to the
>>>> new web
>>>> > application.
>>>> > Please open JIRA to track the security issue and resolve the
>>>> problem
>>>> > prior to backporting this to branch-2.
>>>> > This would minimize the risk to open up security hole in branch-2.
>>>> >
>>>> > Thank you
>>>> >
>>>> > Regards,
>>>> > Eric
>>>> >
>>>> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<
>>>> mailto:
>>>> > vrushalic2016@gmail.com>> wrote:
>>>> >
>>>> > We are planning to include the new YARN UI as part of 2.9
>>>> > release. There
>>>> > is work in progress for back-porting the UI to branch2.
>>>> >
>>>> > Details at https://issues.apache.org/jira/browse/YARN-7169.
>>>> >
>>>> >
>>>> >
>>>> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
>>>> > rohithsharmaks@apache.org<ma...@apache.org>
>>>> > > wrote:
>>>> >
>>>> > > I just noticed that my voted mail has been sent to Wangda
>>>> and
>>>> > forgotten to
>>>> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
>>>> > mail to
>>>> > > yarn-dev.
>>>> > >
>>>> > > Thanks & Regards
>>>> > > Rohith Sharma K S
>>>> > >
>>>> > >
>>>> > > ---------- Forwarded message ----------
>>>> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
>>>> > rohithsharmaks@apache.org>>
>>>> > > Date: 3 November 2016 at 12:06
>>>> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>>> > > To: Wangda Tan <wheeleast@gmail.com<mailto:wh
>>>> eeleast@gmail.com>>
>>>> > >
>>>> > >
>>>> > > +1
>>>> > >
>>>> > > Built from YARN-3368 branch and hosted in cluster. It is
>>>> pretty
>>>> > much good
>>>> > > user experience UI.
>>>> > > I hosted new web UI in same port as existing UI. I was able
>>>> to
>>>> > experience
>>>> > > Queue, Application and Nodes pages.
>>>> > >
>>>> > >
>>>> > > Thanks & Regards
>>>> > > Rohith Sharma K S
>>>> > >
>>>> > > On 1 November 2016 at 04:23, Wangda Tan <
>>>> wheeleast@gmail.com
>>>> > <ma...@gmail.com>> wrote:
>>>> > >
>>>> > > > YARN Devs,
>>>> > > >
>>>> > > > We propose to merge YARN-3368 (YARN next generation web
>>>> UI)
>>>> > development
>>>> > > > branch into trunk for better development, would like to
>>>> hear
>>>> > your
>>>> > > thoughts
>>>> > > > before sending out vote mail.
>>>> > > >
>>>> > > > The new UI will co-exist with the old YARN UI, by default
>>>> it
>>>> > is disabled.
>>>> > > > Please refer to User documentation of the new YARN UI
>>>> > > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-
>>>> yarn
>>>> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
>>>> > YarnUI2.md>
>>>> > > > for
>>>> > > > more details.
>>>> > > >
>>>> > > > In addition, There’re two working-in-progress features
>>>> need
>>>> > the new UI to
>>>> > > > be merged to trunk for further development.
>>>> > > >
>>>> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
>>>> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
>>>> > > >
>>>> > > > *Status of YARN next generation web UI*
>>>> > > >
>>>> > > > Completed features
>>>> > > >
>>>> > > > - Cluster Overview Page
>>>> > > > - Scheduler page
>>>> > > > - Applications / Application / Application-attempts
>>>> pages
>>>> > > > - Nodes / Node page
>>>> > > >
>>>> > > > Integration to YARN
>>>> > > >
>>>> > > > - Hosts new web UI in RM
>>>> > > > - Integrates to maven build / package
>>>> > > >
>>>> > > > Miscs:
>>>> > > >
>>>> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
>>>> > > > - Documented how to use it. (In
>>>> hadoop-yarn-project/hadoop-
>>>> > > yarn/hadoop-
>>>> > > > yarn-site/src/site/markdown/YarnUI2.md)
>>>> > > >
>>>> > > > Major items will finish on trunk:
>>>> > > >
>>>> > > > - Security support
>>>> > > >
>>>> > > > We have run the new UI in our internal cluster for more
>>>> than 3
>>>> > months,
>>>> > > lots
>>>> > > > of people have tried the new UI and gave lots of valuable
>>>> > feedbacks and
>>>> > > > reported suggestions / issues to us. We fixed many of
>>>> them so
>>>> > now we
>>>> > > > believe it is more ready for wider folks to try.
>>>> > > >
>>>> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
>>>> > > jira/browse/YARN-4734
>>>> > > > .
>>>> > > > The latest Jenkins run
>>>> > > > <https://issues.apache.org/jira/browse/YARN-4734?
>>>> focusedComm
>>>> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
>>>> > > > issuetabpanels:comment-tabpanel#comment-15620808>
>>>> > > > gave
>>>> > > > +1.
>>>> > > >
>>>> > > > The vote will run for 7 days, ending Sun, 11/06/2016.
>>>> Please
>>>> > feel free to
>>>> > > > comment if you have any questions/doubts. I'll start with
>>>> my +1
>>>> > > (binding).
>>>> > > >
>>>> > > > Please share your thoughts about this.
>>>> > > >
>>>> > > > Thanks,
>>>> > > > Wangda
>>>> > > >
>>>> > >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>>
>>>
>>>
>>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Sunil G <su...@apache.org>.
Thanks Vrushali for helping to backport YARN-7170 as well.
+1 from my end. tested UI against latest branch and all pages seems to work
fine.
- Sunil
On Fri, Oct 20, 2017 at 11:07 AM Vrushali C <vr...@gmail.com> wrote:
> Thanks everyone!
>
> Subru: Yes, I will back-port YARN-7170 as well.
>
> Will do some more sanity tests and check QA for YARN-3368_branch2 and then
> will proceed with the merge to branch2.
>
> thanks
> Vrushali
>
>
> On Thu, Oct 19, 2017 at 3:24 PM, Subramaniam V K <su...@gmail.com>
> wrote:
>
>> I think we should get in YARN-7170 before we merge the UI to branch-2
>> especially since it looks like it is ready for commit?
>>
>> Thanks,
>> Subru
>>
>> On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
>>
>>> Eric, thanks for updating your vote! I just committed YARN-7338
>>>
>>> Vrushali:
>>>
>>> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0,
>>> I'm
>>> preferred to merge all existing JIRAs to branch-2 first and backport
>>> YARN-7364 separately.
>>>
>>> Thanks,
>>> Wangda
>>>
>>>
>>> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com>
>>> wrote:
>>>
>>> > +1 on merge when YARN-7338 is resolved.
>>> >
>>> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>>> >
>>> > Thank you
>>> >
>>> > Regards,
>>> > Eric
>>> >
>>> > From: Vrushali C <vr...@gmail.com>
>>> > Date: Monday, October 16, 2017 at 3:26 PM
>>> > To: Eric Yang <ey...@hortonworks.com>
>>> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
>>> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
>>> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
>>> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>> >
>>> > Thanks Eric, I have filed https://issues.apache.org/
>>> > jira/browse/YARN-7338 to track this.
>>> >
>>> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
>>> > <ma...@hortonworks.com>> wrote:
>>> > -1 (binding).
>>> >
>>> > Ui2 does not seem to support same origin policy for cross site
>>> > scripting prevention.
>>> > The following parameters has no effect for /ui2:
>>> >
>>> > hadoop.http.cross-origin.enabled = true
>>> > yarn.resourcemanager.webapp.cross-origin.enabled = true
>>> >
>>> > This is because ui2 is designed as a separate web application.
>>> > WebFilters setup for existing resource manager doesn’t apply to the
>>> new web
>>> > application.
>>> > Please open JIRA to track the security issue and resolve the
>>> problem
>>> > prior to backporting this to branch-2.
>>> > This would minimize the risk to open up security hole in branch-2.
>>> >
>>> > Thank you
>>> >
>>> > Regards,
>>> > Eric
>>> >
>>> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com
>>> <mailto:
>>> > vrushalic2016@gmail.com>> wrote:
>>> >
>>> > We are planning to include the new YARN UI as part of 2.9
>>> > release. There
>>> > is work in progress for back-porting the UI to branch2.
>>> >
>>> > Details at https://issues.apache.org/jira/browse/YARN-7169.
>>> >
>>> >
>>> >
>>> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
>>> > rohithsharmaks@apache.org<ma...@apache.org>
>>> > > wrote:
>>> >
>>> > > I just noticed that my voted mail has been sent to Wangda and
>>> > forgotten to
>>> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
>>> > mail to
>>> > > yarn-dev.
>>> > >
>>> > > Thanks & Regards
>>> > > Rohith Sharma K S
>>> > >
>>> > >
>>> > > ---------- Forwarded message ----------
>>> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
>>> > rohithsharmaks@apache.org>>
>>> > > Date: 3 November 2016 at 12:06
>>> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>> > > To: Wangda Tan <wheeleast@gmail.com<mailto:
>>> wheeleast@gmail.com>>
>>> > >
>>> > >
>>> > > +1
>>> > >
>>> > > Built from YARN-3368 branch and hosted in cluster. It is
>>> pretty
>>> > much good
>>> > > user experience UI.
>>> > > I hosted new web UI in same port as existing UI. I was able
>>> to
>>> > experience
>>> > > Queue, Application and Nodes pages.
>>> > >
>>> > >
>>> > > Thanks & Regards
>>> > > Rohith Sharma K S
>>> > >
>>> > > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
>>> > <ma...@gmail.com>> wrote:
>>> > >
>>> > > > YARN Devs,
>>> > > >
>>> > > > We propose to merge YARN-3368 (YARN next generation web UI)
>>> > development
>>> > > > branch into trunk for better development, would like to
>>> hear
>>> > your
>>> > > thoughts
>>> > > > before sending out vote mail.
>>> > > >
>>> > > > The new UI will co-exist with the old YARN UI, by default
>>> it
>>> > is disabled.
>>> > > > Please refer to User documentation of the new YARN UI
>>> > > > <
>>> https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
>>> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
>>> > YarnUI2.md>
>>> > > > for
>>> > > > more details.
>>> > > >
>>> > > > In addition, There’re two working-in-progress features need
>>> > the new UI to
>>> > > > be merged to trunk for further development.
>>> > > >
>>> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
>>> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
>>> > > >
>>> > > > *Status of YARN next generation web UI*
>>> > > >
>>> > > > Completed features
>>> > > >
>>> > > > - Cluster Overview Page
>>> > > > - Scheduler page
>>> > > > - Applications / Application / Application-attempts
>>> pages
>>> > > > - Nodes / Node page
>>> > > >
>>> > > > Integration to YARN
>>> > > >
>>> > > > - Hosts new web UI in RM
>>> > > > - Integrates to maven build / package
>>> > > >
>>> > > > Miscs:
>>> > > >
>>> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
>>> > > > - Documented how to use it. (In
>>> hadoop-yarn-project/hadoop-
>>> > > yarn/hadoop-
>>> > > > yarn-site/src/site/markdown/YarnUI2.md)
>>> > > >
>>> > > > Major items will finish on trunk:
>>> > > >
>>> > > > - Security support
>>> > > >
>>> > > > We have run the new UI in our internal cluster for more
>>> than 3
>>> > months,
>>> > > lots
>>> > > > of people have tried the new UI and gave lots of valuable
>>> > feedbacks and
>>> > > > reported suggestions / issues to us. We fixed many of them
>>> so
>>> > now we
>>> > > > believe it is more ready for wider folks to try.
>>> > > >
>>> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
>>> > > jira/browse/YARN-4734
>>> > > > .
>>> > > > The latest Jenkins run
>>> > > > <
>>> https://issues.apache.org/jira/browse/YARN-4734?focusedComm
>>> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
>>> > > > issuetabpanels:comment-tabpanel#comment-15620808>
>>> > > > gave
>>> > > > +1.
>>> > > >
>>> > > > The vote will run for 7 days, ending Sun, 11/06/2016.
>>> Please
>>> > feel free to
>>> > > > comment if you have any questions/doubts. I'll start with
>>> my +1
>>> > > (binding).
>>> > > >
>>> > > > Please share your thoughts about this.
>>> > > >
>>> > > > Thanks,
>>> > > > Wangda
>>> > > >
>>> > >
>>> >
>>> >
>>> >
>>> >
>>> >
>>>
>>
>>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Vrushali C <vr...@gmail.com>.
Thanks everyone!
Subru: Yes, I will back-port YARN-7170 as well.
Will do some more sanity tests and check QA for YARN-3368_branch2 and then
will proceed with the merge to branch2.
thanks
Vrushali
On Thu, Oct 19, 2017 at 3:24 PM, Subramaniam V K <su...@gmail.com> wrote:
> I think we should get in YARN-7170 before we merge the UI to branch-2
> especially since it looks like it is ready for commit?
>
> Thanks,
> Subru
>
> On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
>
>> Eric, thanks for updating your vote! I just committed YARN-7338
>>
>> Vrushali:
>>
>> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0, I'm
>> preferred to merge all existing JIRAs to branch-2 first and backport
>> YARN-7364 separately.
>>
>> Thanks,
>> Wangda
>>
>>
>> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com>
>> wrote:
>>
>> > +1 on merge when YARN-7338 is resolved.
>> >
>> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>> >
>> > Thank you
>> >
>> > Regards,
>> > Eric
>> >
>> > From: Vrushali C <vr...@gmail.com>
>> > Date: Monday, October 16, 2017 at 3:26 PM
>> > To: Eric Yang <ey...@hortonworks.com>
>> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
>> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
>> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
>> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>> >
>> > Thanks Eric, I have filed https://issues.apache.org/
>> > jira/browse/YARN-7338 to track this.
>> >
>> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
>> > <ma...@hortonworks.com>> wrote:
>> > -1 (binding).
>> >
>> > Ui2 does not seem to support same origin policy for cross site
>> > scripting prevention.
>> > The following parameters has no effect for /ui2:
>> >
>> > hadoop.http.cross-origin.enabled = true
>> > yarn.resourcemanager.webapp.cross-origin.enabled = true
>> >
>> > This is because ui2 is designed as a separate web application.
>> > WebFilters setup for existing resource manager doesn’t apply to the new
>> web
>> > application.
>> > Please open JIRA to track the security issue and resolve the problem
>> > prior to backporting this to branch-2.
>> > This would minimize the risk to open up security hole in branch-2.
>> >
>> > Thank you
>> >
>> > Regards,
>> > Eric
>> >
>> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<mailto:
>> > vrushalic2016@gmail.com>> wrote:
>> >
>> > We are planning to include the new YARN UI as part of 2.9
>> > release. There
>> > is work in progress for back-porting the UI to branch2.
>> >
>> > Details at https://issues.apache.org/jira/browse/YARN-7169.
>> >
>> >
>> >
>> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
>> > rohithsharmaks@apache.org<ma...@apache.org>
>> > > wrote:
>> >
>> > > I just noticed that my voted mail has been sent to Wangda and
>> > forgotten to
>> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
>> > mail to
>> > > yarn-dev.
>> > >
>> > > Thanks & Regards
>> > > Rohith Sharma K S
>> > >
>> > >
>> > > ---------- Forwarded message ----------
>> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
>> > rohithsharmaks@apache.org>>
>> > > Date: 3 November 2016 at 12:06
>> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>> > > To: Wangda Tan <wheeleast@gmail.com<mailto:wh
>> eeleast@gmail.com>>
>> > >
>> > >
>> > > +1
>> > >
>> > > Built from YARN-3368 branch and hosted in cluster. It is
>> pretty
>> > much good
>> > > user experience UI.
>> > > I hosted new web UI in same port as existing UI. I was able to
>> > experience
>> > > Queue, Application and Nodes pages.
>> > >
>> > >
>> > > Thanks & Regards
>> > > Rohith Sharma K S
>> > >
>> > > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
>> > <ma...@gmail.com>> wrote:
>> > >
>> > > > YARN Devs,
>> > > >
>> > > > We propose to merge YARN-3368 (YARN next generation web UI)
>> > development
>> > > > branch into trunk for better development, would like to hear
>> > your
>> > > thoughts
>> > > > before sending out vote mail.
>> > > >
>> > > > The new UI will co-exist with the old YARN UI, by default it
>> > is disabled.
>> > > > Please refer to User documentation of the new YARN UI
>> > > > <https://github.com/apache/had
>> oop/blob/YARN-3368/hadoop-yarn
>> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
>> > YarnUI2.md>
>> > > > for
>> > > > more details.
>> > > >
>> > > > In addition, There’re two working-in-progress features need
>> > the new UI to
>> > > > be merged to trunk for further development.
>> > > >
>> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
>> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
>> > > >
>> > > > *Status of YARN next generation web UI*
>> > > >
>> > > > Completed features
>> > > >
>> > > > - Cluster Overview Page
>> > > > - Scheduler page
>> > > > - Applications / Application / Application-attempts pages
>> > > > - Nodes / Node page
>> > > >
>> > > > Integration to YARN
>> > > >
>> > > > - Hosts new web UI in RM
>> > > > - Integrates to maven build / package
>> > > >
>> > > > Miscs:
>> > > >
>> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
>> > > > - Documented how to use it. (In
>> hadoop-yarn-project/hadoop-
>> > > yarn/hadoop-
>> > > > yarn-site/src/site/markdown/YarnUI2.md)
>> > > >
>> > > > Major items will finish on trunk:
>> > > >
>> > > > - Security support
>> > > >
>> > > > We have run the new UI in our internal cluster for more
>> than 3
>> > months,
>> > > lots
>> > > > of people have tried the new UI and gave lots of valuable
>> > feedbacks and
>> > > > reported suggestions / issues to us. We fixed many of them
>> so
>> > now we
>> > > > believe it is more ready for wider folks to try.
>> > > >
>> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
>> > > jira/browse/YARN-4734
>> > > > .
>> > > > The latest Jenkins run
>> > > > <https://issues.apache.org/jir
>> a/browse/YARN-4734?focusedComm
>> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
>> > > > issuetabpanels:comment-tabpanel#comment-15620808>
>> > > > gave
>> > > > +1.
>> > > >
>> > > > The vote will run for 7 days, ending Sun, 11/06/2016. Please
>> > feel free to
>> > > > comment if you have any questions/doubts. I'll start with
>> my +1
>> > > (binding).
>> > > >
>> > > > Please share your thoughts about this.
>> > > >
>> > > > Thanks,
>> > > > Wangda
>> > > >
>> > >
>> >
>> >
>> >
>> >
>> >
>>
>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Subramaniam V K <su...@gmail.com>.
I think we should get in YARN-7170 before we merge the UI to branch-2
especially since it looks like it is ready for commit?
Thanks,
Subru
On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
> Eric, thanks for updating your vote! I just committed YARN-7338
>
> Vrushali:
>
> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0, I'm
> preferred to merge all existing JIRAs to branch-2 first and backport
> YARN-7364 separately.
>
> Thanks,
> Wangda
>
>
> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com> wrote:
>
> > +1 on merge when YARN-7338 is resolved.
> >
> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
> >
> > Thank you
> >
> > Regards,
> > Eric
> >
> > From: Vrushali C <vr...@gmail.com>
> > Date: Monday, October 16, 2017 at 3:26 PM
> > To: Eric Yang <ey...@hortonworks.com>
> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> >
> > Thanks Eric, I have filed https://issues.apache.org/
> > jira/browse/YARN-7338 to track this.
> >
> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
> > <ma...@hortonworks.com>> wrote:
> > -1 (binding).
> >
> > Ui2 does not seem to support same origin policy for cross site
> > scripting prevention.
> > The following parameters has no effect for /ui2:
> >
> > hadoop.http.cross-origin.enabled = true
> > yarn.resourcemanager.webapp.cross-origin.enabled = true
> >
> > This is because ui2 is designed as a separate web application.
> > WebFilters setup for existing resource manager doesn’t apply to the new
> web
> > application.
> > Please open JIRA to track the security issue and resolve the problem
> > prior to backporting this to branch-2.
> > This would minimize the risk to open up security hole in branch-2.
> >
> > Thank you
> >
> > Regards,
> > Eric
> >
> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<mailto:
> > vrushalic2016@gmail.com>> wrote:
> >
> > We are planning to include the new YARN UI as part of 2.9
> > release. There
> > is work in progress for back-porting the UI to branch2.
> >
> > Details at https://issues.apache.org/jira/browse/YARN-7169.
> >
> >
> >
> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
> > rohithsharmaks@apache.org<ma...@apache.org>
> > > wrote:
> >
> > > I just noticed that my voted mail has been sent to Wangda and
> > forgotten to
> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
> > mail to
> > > yarn-dev.
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> > >
> > > ---------- Forwarded message ----------
> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
> > rohithsharmaks@apache.org>>
> > > Date: 3 November 2016 at 12:06
> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> > > To: Wangda Tan <wheeleast@gmail.com<mailto:wheeleast@gmail.com
> >>
> > >
> > >
> > > +1
> > >
> > > Built from YARN-3368 branch and hosted in cluster. It is pretty
> > much good
> > > user experience UI.
> > > I hosted new web UI in same port as existing UI. I was able to
> > experience
> > > Queue, Application and Nodes pages.
> > >
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> > > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
> > <ma...@gmail.com>> wrote:
> > >
> > > > YARN Devs,
> > > >
> > > > We propose to merge YARN-3368 (YARN next generation web UI)
> > development
> > > > branch into trunk for better development, would like to hear
> > your
> > > thoughts
> > > > before sending out vote mail.
> > > >
> > > > The new UI will co-exist with the old YARN UI, by default it
> > is disabled.
> > > > Please refer to User documentation of the new YARN UI
> > > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
> > YarnUI2.md>
> > > > for
> > > > more details.
> > > >
> > > > In addition, There’re two working-in-progress features need
> > the new UI to
> > > > be merged to trunk for further development.
> > > >
> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
> > > >
> > > > *Status of YARN next generation web UI*
> > > >
> > > > Completed features
> > > >
> > > > - Cluster Overview Page
> > > > - Scheduler page
> > > > - Applications / Application / Application-attempts pages
> > > > - Nodes / Node page
> > > >
> > > > Integration to YARN
> > > >
> > > > - Hosts new web UI in RM
> > > > - Integrates to maven build / package
> > > >
> > > > Miscs:
> > > >
> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
> > > > - Documented how to use it. (In
> hadoop-yarn-project/hadoop-
> > > yarn/hadoop-
> > > > yarn-site/src/site/markdown/YarnUI2.md)
> > > >
> > > > Major items will finish on trunk:
> > > >
> > > > - Security support
> > > >
> > > > We have run the new UI in our internal cluster for more than
> 3
> > months,
> > > lots
> > > > of people have tried the new UI and gave lots of valuable
> > feedbacks and
> > > > reported suggestions / issues to us. We fixed many of them so
> > now we
> > > > believe it is more ready for wider folks to try.
> > > >
> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
> > > jira/browse/YARN-4734
> > > > .
> > > > The latest Jenkins run
> > > > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
> > > > issuetabpanels:comment-tabpanel#comment-15620808>
> > > > gave
> > > > +1.
> > > >
> > > > The vote will run for 7 days, ending Sun, 11/06/2016. Please
> > feel free to
> > > > comment if you have any questions/doubts. I'll start with my
> +1
> > > (binding).
> > > >
> > > > Please share your thoughts about this.
> > > >
> > > > Thanks,
> > > > Wangda
> > > >
> > >
> >
> >
> >
> >
> >
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Wangda Tan <wh...@gmail.com>.
Eric, thanks for updating your vote! I just committed YARN-7338
Vrushali:
Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0, I'm
preferred to merge all existing JIRAs to branch-2 first and backport
YARN-7364 separately.
Thanks,
Wangda
On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com> wrote:
> +1 on merge when YARN-7338 is resolved.
>
> On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>
> Thank you
>
> Regards,
> Eric
>
> From: Vrushali C <vr...@gmail.com>
> Date: Monday, October 16, 2017 at 3:26 PM
> To: Eric Yang <ey...@hortonworks.com>
> Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
> sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
> yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>
> Thanks Eric, I have filed https://issues.apache.org/
> jira/browse/YARN-7338 to track this.
>
> On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
> <ma...@hortonworks.com>> wrote:
> -1 (binding).
>
> Ui2 does not seem to support same origin policy for cross site
> scripting prevention.
> The following parameters has no effect for /ui2:
>
> hadoop.http.cross-origin.enabled = true
> yarn.resourcemanager.webapp.cross-origin.enabled = true
>
> This is because ui2 is designed as a separate web application.
> WebFilters setup for existing resource manager doesn’t apply to the new web
> application.
> Please open JIRA to track the security issue and resolve the problem
> prior to backporting this to branch-2.
> This would minimize the risk to open up security hole in branch-2.
>
> Thank you
>
> Regards,
> Eric
>
> On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<mailto:
> vrushalic2016@gmail.com>> wrote:
>
> We are planning to include the new YARN UI as part of 2.9
> release. There
> is work in progress for back-porting the UI to branch2.
>
> Details at https://issues.apache.org/jira/browse/YARN-7169.
>
>
>
> On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
> rohithsharmaks@apache.org<ma...@apache.org>
> > wrote:
>
> > I just noticed that my voted mail has been sent to Wangda and
> forgotten to
> > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
> mail to
> > yarn-dev.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> >
> > ---------- Forwarded message ----------
> > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
> rohithsharmaks@apache.org>>
> > Date: 3 November 2016 at 12:06
> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> > To: Wangda Tan <wh...@gmail.com>>
> >
> >
> > +1
> >
> > Built from YARN-3368 branch and hosted in cluster. It is pretty
> much good
> > user experience UI.
> > I hosted new web UI in same port as existing UI. I was able to
> experience
> > Queue, Application and Nodes pages.
> >
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
> <ma...@gmail.com>> wrote:
> >
> > > YARN Devs,
> > >
> > > We propose to merge YARN-3368 (YARN next generation web UI)
> development
> > > branch into trunk for better development, would like to hear
> your
> > thoughts
> > > before sending out vote mail.
> > >
> > > The new UI will co-exist with the old YARN UI, by default it
> is disabled.
> > > Please refer to User documentation of the new YARN UI
> > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
> YarnUI2.md>
> > > for
> > > more details.
> > >
> > > In addition, There’re two working-in-progress features need
> the new UI to
> > > be merged to trunk for further development.
> > >
> > > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > > 2) UI of YARN ResourceManager Federation (YARN-2915).
> > >
> > > *Status of YARN next generation web UI*
> > >
> > > Completed features
> > >
> > > - Cluster Overview Page
> > > - Scheduler page
> > > - Applications / Application / Application-attempts pages
> > > - Nodes / Node page
> > >
> > > Integration to YARN
> > >
> > > - Hosts new web UI in RM
> > > - Integrates to maven build / package
> > >
> > > Miscs:
> > >
> > > - Added dependencies to LICENSE.txt/NOTICE.txt
> > > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> > yarn/hadoop-
> > > yarn-site/src/site/markdown/YarnUI2.md)
> > >
> > > Major items will finish on trunk:
> > >
> > > - Security support
> > >
> > > We have run the new UI in our internal cluster for more than 3
> months,
> > lots
> > > of people have tried the new UI and gave lots of valuable
> feedbacks and
> > > reported suggestions / issues to us. We fixed many of them so
> now we
> > > believe it is more ready for wider folks to try.
> > >
> > > Merge JIRA for Jenkins is: https://issues.apache.org/
> > jira/browse/YARN-4734
> > > .
> > > The latest Jenkins run
> > > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > > entId=15620808&page=com.atlassian.jira.plugin.system.
> > > issuetabpanels:comment-tabpanel#comment-15620808>
> > > gave
> > > +1.
> > >
> > > The vote will run for 7 days, ending Sun, 11/06/2016. Please
> feel free to
> > > comment if you have any questions/doubts. I'll start with my +1
> > (binding).
> > >
> > > Please share your thoughts about this.
> > >
> > > Thanks,
> > > Wangda
> > >
> >
>
>
>
>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Eric Yang <ey...@hortonworks.com>.
+1 on merge when YARN-7338 is resolved.
On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
Thank you
Regards,
Eric
From: Vrushali C <vr...@gmail.com>
Date: Monday, October 16, 2017 at 3:26 PM
To: Eric Yang <ey...@hortonworks.com>
Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <su...@apache.org>, "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Thanks Eric, I have filed https://issues.apache.org/jira/browse/YARN-7338 to track this.
On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <ey...@hortonworks.com>> wrote:
-1 (binding).
Ui2 does not seem to support same origin policy for cross site scripting prevention.
The following parameters has no effect for /ui2:
hadoop.http.cross-origin.enabled = true
yarn.resourcemanager.webapp.cross-origin.enabled = true
This is because ui2 is designed as a separate web application. WebFilters setup for existing resource manager doesn’t apply to the new web application.
Please open JIRA to track the security issue and resolve the problem prior to backporting this to branch-2.
This would minimize the risk to open up security hole in branch-2.
Thank you
Regards,
Eric
On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com>> wrote:
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <ro...@apache.org>
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com>> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Eric Yang <ey...@hortonworks.com>.
Thank you
Regards,
Eric
From: Vrushali C <vr...@gmail.com>
Date: Monday, October 16, 2017 at 3:26 PM
To: Eric Yang <ey...@hortonworks.com>
Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <su...@apache.org>, "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Thanks Eric, I have filed https://issues.apache.org/jira/browse/YARN-7338 to track this.
On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <ey...@hortonworks.com>> wrote:
-1 (binding).
Ui2 does not seem to support same origin policy for cross site scripting prevention.
The following parameters has no effect for /ui2:
hadoop.http.cross-origin.enabled = true
yarn.resourcemanager.webapp.cross-origin.enabled = true
This is because ui2 is designed as a separate web application. WebFilters setup for existing resource manager doesn’t apply to the new web application.
Please open JIRA to track the security issue and resolve the problem prior to backporting this to branch-2.
This would minimize the risk to open up security hole in branch-2.
Thank you
Regards,
Eric
On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com>> wrote:
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <ro...@apache.org>
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com>> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Vrushali C <vr...@gmail.com>.
Thanks Eric, I have filed https://issues.apache.org/jira/browse/YARN-7338
to track this.
On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <ey...@hortonworks.com> wrote:
> -1 (binding).
>
> Ui2 does not seem to support same origin policy for cross site scripting
> prevention.
> The following parameters has no effect for /ui2:
>
> hadoop.http.cross-origin.enabled = true
> yarn.resourcemanager.webapp.cross-origin.enabled = true
>
> This is because ui2 is designed as a separate web application. WebFilters
> setup for existing resource manager doesn’t apply to the new web
> application.
> Please open JIRA to track the security issue and resolve the problem prior
> to backporting this to branch-2.
> This would minimize the risk to open up security hole in branch-2.
>
> Thank you
>
> Regards,
> Eric
>
> On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com> wrote:
>
> We are planning to include the new YARN UI as part of 2.9 release.
> There
> is work in progress for back-porting the UI to branch2.
>
> Details at https://issues.apache.org/jira/browse/YARN-7169.
>
>
>
> On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
> rohithsharmaks@apache.org
> > wrote:
>
> > I just noticed that my voted mail has been sent to Wangda and
> forgotten to
> > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> > yarn-dev.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> >
> > ---------- Forwarded message ----------
> > From: Rohith Sharma K S <ro...@apache.org>
> > Date: 3 November 2016 at 12:06
> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> > To: Wangda Tan <wh...@gmail.com>
> >
> >
> > +1
> >
> > Built from YARN-3368 branch and hosted in cluster. It is pretty much
> good
> > user experience UI.
> > I hosted new web UI in same port as existing UI. I was able to
> experience
> > Queue, Application and Nodes pages.
> >
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> > On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com> wrote:
> >
> > > YARN Devs,
> > >
> > > We propose to merge YARN-3368 (YARN next generation web UI)
> development
> > > branch into trunk for better development, would like to hear your
> > thoughts
> > > before sending out vote mail.
> > >
> > > The new UI will co-exist with the old YARN UI, by default it is
> disabled.
> > > Please refer to User documentation of the new YARN UI
> > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
> YarnUI2.md>
> > > for
> > > more details.
> > >
> > > In addition, There’re two working-in-progress features need the
> new UI to
> > > be merged to trunk for further development.
> > >
> > > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > > 2) UI of YARN ResourceManager Federation (YARN-2915).
> > >
> > > *Status of YARN next generation web UI*
> > >
> > > Completed features
> > >
> > > - Cluster Overview Page
> > > - Scheduler page
> > > - Applications / Application / Application-attempts pages
> > > - Nodes / Node page
> > >
> > > Integration to YARN
> > >
> > > - Hosts new web UI in RM
> > > - Integrates to maven build / package
> > >
> > > Miscs:
> > >
> > > - Added dependencies to LICENSE.txt/NOTICE.txt
> > > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> > yarn/hadoop-
> > > yarn-site/src/site/markdown/YarnUI2.md)
> > >
> > > Major items will finish on trunk:
> > >
> > > - Security support
> > >
> > > We have run the new UI in our internal cluster for more than 3
> months,
> > lots
> > > of people have tried the new UI and gave lots of valuable
> feedbacks and
> > > reported suggestions / issues to us. We fixed many of them so now
> we
> > > believe it is more ready for wider folks to try.
> > >
> > > Merge JIRA for Jenkins is: https://issues.apache.org/
> > jira/browse/YARN-4734
> > > .
> > > The latest Jenkins run
> > > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > > entId=15620808&page=com.atlassian.jira.plugin.system.
> > > issuetabpanels:comment-tabpanel#comment-15620808>
> > > gave
> > > +1.
> > >
> > > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel
> free to
> > > comment if you have any questions/doubts. I'll start with my +1
> > (binding).
> > >
> > > Please share your thoughts about this.
> > >
> > > Thanks,
> > > Wangda
> > >
> >
>
>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Eric Yang <ey...@hortonworks.com>.
-1 (binding).
Ui2 does not seem to support same origin policy for cross site scripting prevention.
The following parameters has no effect for /ui2:
hadoop.http.cross-origin.enabled = true
yarn.resourcemanager.webapp.cross-origin.enabled = true
This is because ui2 is designed as a separate web application. WebFilters setup for existing resource manager doesn’t apply to the new web application.
Please open JIRA to track the security issue and resolve the problem prior to backporting this to branch-2.
This would minimize the risk to open up security hole in branch-2.
Thank you
Regards,
Eric
On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com> wrote:
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <rohithsharmaks@apache.org
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Vrushali C <vr...@gmail.com>.
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <rohithsharmaks@apache.org
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
Fwd: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Rohith Sharma K S <ro...@apache.org>.
I just noticed that my voted mail has been sent to Wangda and forgotten to
keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
yarn-dev.
Thanks & Regards
Rohith Sharma K S
---------- Forwarded message ----------
From: Rohith Sharma K S <ro...@apache.org>
Date: 3 November 2016 at 12:06
Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
To: Wangda Tan <wh...@gmail.com>
+1
Built from YARN-3368 branch and hosted in cluster. It is pretty much good
user experience UI.
I hosted new web UI in same port as existing UI. I was able to experience
Queue, Application and Nodes pages.
Thanks & Regards
Rohith Sharma K S
On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com> wrote:
> YARN Devs,
>
> We propose to merge YARN-3368 (YARN next generation web UI) development
> branch into trunk for better development, would like to hear your thoughts
> before sending out vote mail.
>
> The new UI will co-exist with the old YARN UI, by default it is disabled.
> Please refer to User documentation of the new YARN UI
> <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> for
> more details.
>
> In addition, There’re two working-in-progress features need the new UI to
> be merged to trunk for further development.
>
> 1) UI of YARN Timeline Server v2 (YARN-2928)
> 2) UI of YARN ResourceManager Federation (YARN-2915).
>
> *Status of YARN next generation web UI*
>
> Completed features
>
> - Cluster Overview Page
> - Scheduler page
> - Applications / Application / Application-attempts pages
> - Nodes / Node page
>
> Integration to YARN
>
> - Hosts new web UI in RM
> - Integrates to maven build / package
>
> Miscs:
>
> - Added dependencies to LICENSE.txt/NOTICE.txt
> - Documented how to use it. (In hadoop-yarn-project/hadoop-yarn/hadoop-
> yarn-site/src/site/markdown/YarnUI2.md)
>
> Major items will finish on trunk:
>
> - Security support
>
> We have run the new UI in our internal cluster for more than 3 months, lots
> of people have tried the new UI and gave lots of valuable feedbacks and
> reported suggestions / issues to us. We fixed many of them so now we
> believe it is more ready for wider folks to try.
>
> Merge JIRA for Jenkins is: https://issues.apache.org/jira/browse/YARN-4734
> .
> The latest Jenkins run
> <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> entId=15620808&page=com.atlassian.jira.plugin.system.
> issuetabpanels:comment-tabpanel#comment-15620808>
> gave
> +1.
>
> The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> comment if you have any questions/doubts. I'll start with my +1 (binding).
>
> Please share your thoughts about this.
>
> Thanks,
> Wangda
>