You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Vrushali C <vr...@gmail.com> on 2017/10/16 17:22:13 UTC
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <rohithsharmaks@apache.org
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Vrushali C <vr...@gmail.com>.
Thanks everyone. The new YARN UI v2 has now landed on branch-2 with the
merge done with --no-ff.
We will keep monitoring this to see if any issues arise.
Special thanks to Sunil Govind, Wangda Tan and Varun Saxena for all their
help on completing this.
Details at
https://issues.apache.org/jira/browse/YARN-7169
https://github.com/apache/hadoop/commit/769087288ad753ca58509ff3fe5efcc2d2b061aa
thanks
Vrushali
On Fri, Oct 20, 2017 at 1:00 AM, Sunil G <su...@apache.org> wrote:
> Thanks Vrushali for helping to backport YARN-7170 as well.
>
> +1 from my end. tested UI against latest branch and all pages seems to
> work fine.
>
> - Sunil
>
>
> On Fri, Oct 20, 2017 at 11:07 AM Vrushali C <vr...@gmail.com>
> wrote:
>
>> Thanks everyone!
>>
>> Subru: Yes, I will back-port YARN-7170 as well.
>>
>> Will do some more sanity tests and check QA for YARN-3368_branch2 and
>> then will proceed with the merge to branch2.
>>
>> thanks
>> Vrushali
>>
>>
>> On Thu, Oct 19, 2017 at 3:24 PM, Subramaniam V K <su...@gmail.com>
>> wrote:
>>
>>> I think we should get in YARN-7170 before we merge the UI to branch-2
>>> especially since it looks like it is ready for commit?
>>>
>>> Thanks,
>>> Subru
>>>
>>> On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
>>>
>>>> Eric, thanks for updating your vote! I just committed YARN-7338
>>>>
>>>> Vrushali:
>>>>
>>>> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0,
>>>> I'm
>>>> preferred to merge all existing JIRAs to branch-2 first and backport
>>>> YARN-7364 separately.
>>>>
>>>> Thanks,
>>>> Wangda
>>>>
>>>>
>>>> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com>
>>>> wrote:
>>>>
>>>> > +1 on merge when YARN-7338 is resolved.
>>>> >
>>>> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>>>> >
>>>> > Thank you
>>>> >
>>>> > Regards,
>>>> > Eric
>>>> >
>>>> > From: Vrushali C <vr...@gmail.com>
>>>> > Date: Monday, October 16, 2017 at 3:26 PM
>>>> > To: Eric Yang <ey...@hortonworks.com>
>>>> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
>>>> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
>>>> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
>>>> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>>> >
>>>> > Thanks Eric, I have filed https://issues.apache.org/
>>>> > jira/browse/YARN-7338 to track this.
>>>> >
>>>> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
>>>> > <ma...@hortonworks.com>> wrote:
>>>> > -1 (binding).
>>>> >
>>>> > Ui2 does not seem to support same origin policy for cross site
>>>> > scripting prevention.
>>>> > The following parameters has no effect for /ui2:
>>>> >
>>>> > hadoop.http.cross-origin.enabled = true
>>>> > yarn.resourcemanager.webapp.cross-origin.enabled = true
>>>> >
>>>> > This is because ui2 is designed as a separate web application.
>>>> > WebFilters setup for existing resource manager doesn’t apply to the
>>>> new web
>>>> > application.
>>>> > Please open JIRA to track the security issue and resolve the
>>>> problem
>>>> > prior to backporting this to branch-2.
>>>> > This would minimize the risk to open up security hole in branch-2.
>>>> >
>>>> > Thank you
>>>> >
>>>> > Regards,
>>>> > Eric
>>>> >
>>>> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<
>>>> mailto:
>>>> > vrushalic2016@gmail.com>> wrote:
>>>> >
>>>> > We are planning to include the new YARN UI as part of 2.9
>>>> > release. There
>>>> > is work in progress for back-porting the UI to branch2.
>>>> >
>>>> > Details at https://issues.apache.org/jira/browse/YARN-7169.
>>>> >
>>>> >
>>>> >
>>>> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
>>>> > rohithsharmaks@apache.org<ma...@apache.org>
>>>> > > wrote:
>>>> >
>>>> > > I just noticed that my voted mail has been sent to Wangda
>>>> and
>>>> > forgotten to
>>>> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
>>>> > mail to
>>>> > > yarn-dev.
>>>> > >
>>>> > > Thanks & Regards
>>>> > > Rohith Sharma K S
>>>> > >
>>>> > >
>>>> > > ---------- Forwarded message ----------
>>>> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
>>>> > rohithsharmaks@apache.org>>
>>>> > > Date: 3 November 2016 at 12:06
>>>> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>>> > > To: Wangda Tan <wheeleast@gmail.com<mailto:wh
>>>> eeleast@gmail.com>>
>>>> > >
>>>> > >
>>>> > > +1
>>>> > >
>>>> > > Built from YARN-3368 branch and hosted in cluster. It is
>>>> pretty
>>>> > much good
>>>> > > user experience UI.
>>>> > > I hosted new web UI in same port as existing UI. I was able
>>>> to
>>>> > experience
>>>> > > Queue, Application and Nodes pages.
>>>> > >
>>>> > >
>>>> > > Thanks & Regards
>>>> > > Rohith Sharma K S
>>>> > >
>>>> > > On 1 November 2016 at 04:23, Wangda Tan <
>>>> wheeleast@gmail.com
>>>> > <ma...@gmail.com>> wrote:
>>>> > >
>>>> > > > YARN Devs,
>>>> > > >
>>>> > > > We propose to merge YARN-3368 (YARN next generation web
>>>> UI)
>>>> > development
>>>> > > > branch into trunk for better development, would like to
>>>> hear
>>>> > your
>>>> > > thoughts
>>>> > > > before sending out vote mail.
>>>> > > >
>>>> > > > The new UI will co-exist with the old YARN UI, by default
>>>> it
>>>> > is disabled.
>>>> > > > Please refer to User documentation of the new YARN UI
>>>> > > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-
>>>> yarn
>>>> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
>>>> > YarnUI2.md>
>>>> > > > for
>>>> > > > more details.
>>>> > > >
>>>> > > > In addition, There’re two working-in-progress features
>>>> need
>>>> > the new UI to
>>>> > > > be merged to trunk for further development.
>>>> > > >
>>>> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
>>>> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
>>>> > > >
>>>> > > > *Status of YARN next generation web UI*
>>>> > > >
>>>> > > > Completed features
>>>> > > >
>>>> > > > - Cluster Overview Page
>>>> > > > - Scheduler page
>>>> > > > - Applications / Application / Application-attempts
>>>> pages
>>>> > > > - Nodes / Node page
>>>> > > >
>>>> > > > Integration to YARN
>>>> > > >
>>>> > > > - Hosts new web UI in RM
>>>> > > > - Integrates to maven build / package
>>>> > > >
>>>> > > > Miscs:
>>>> > > >
>>>> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
>>>> > > > - Documented how to use it. (In
>>>> hadoop-yarn-project/hadoop-
>>>> > > yarn/hadoop-
>>>> > > > yarn-site/src/site/markdown/YarnUI2.md)
>>>> > > >
>>>> > > > Major items will finish on trunk:
>>>> > > >
>>>> > > > - Security support
>>>> > > >
>>>> > > > We have run the new UI in our internal cluster for more
>>>> than 3
>>>> > months,
>>>> > > lots
>>>> > > > of people have tried the new UI and gave lots of valuable
>>>> > feedbacks and
>>>> > > > reported suggestions / issues to us. We fixed many of
>>>> them so
>>>> > now we
>>>> > > > believe it is more ready for wider folks to try.
>>>> > > >
>>>> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
>>>> > > jira/browse/YARN-4734
>>>> > > > .
>>>> > > > The latest Jenkins run
>>>> > > > <https://issues.apache.org/jira/browse/YARN-4734?
>>>> focusedComm
>>>> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
>>>> > > > issuetabpanels:comment-tabpanel#comment-15620808>
>>>> > > > gave
>>>> > > > +1.
>>>> > > >
>>>> > > > The vote will run for 7 days, ending Sun, 11/06/2016.
>>>> Please
>>>> > feel free to
>>>> > > > comment if you have any questions/doubts. I'll start with
>>>> my +1
>>>> > > (binding).
>>>> > > >
>>>> > > > Please share your thoughts about this.
>>>> > > >
>>>> > > > Thanks,
>>>> > > > Wangda
>>>> > > >
>>>> > >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>>
>>>
>>>
>>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Sunil G <su...@apache.org>.
Thanks Vrushali for helping to backport YARN-7170 as well.
+1 from my end. tested UI against latest branch and all pages seems to work
fine.
- Sunil
On Fri, Oct 20, 2017 at 11:07 AM Vrushali C <vr...@gmail.com> wrote:
> Thanks everyone!
>
> Subru: Yes, I will back-port YARN-7170 as well.
>
> Will do some more sanity tests and check QA for YARN-3368_branch2 and then
> will proceed with the merge to branch2.
>
> thanks
> Vrushali
>
>
> On Thu, Oct 19, 2017 at 3:24 PM, Subramaniam V K <su...@gmail.com>
> wrote:
>
>> I think we should get in YARN-7170 before we merge the UI to branch-2
>> especially since it looks like it is ready for commit?
>>
>> Thanks,
>> Subru
>>
>> On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
>>
>>> Eric, thanks for updating your vote! I just committed YARN-7338
>>>
>>> Vrushali:
>>>
>>> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0,
>>> I'm
>>> preferred to merge all existing JIRAs to branch-2 first and backport
>>> YARN-7364 separately.
>>>
>>> Thanks,
>>> Wangda
>>>
>>>
>>> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com>
>>> wrote:
>>>
>>> > +1 on merge when YARN-7338 is resolved.
>>> >
>>> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>>> >
>>> > Thank you
>>> >
>>> > Regards,
>>> > Eric
>>> >
>>> > From: Vrushali C <vr...@gmail.com>
>>> > Date: Monday, October 16, 2017 at 3:26 PM
>>> > To: Eric Yang <ey...@hortonworks.com>
>>> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
>>> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
>>> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
>>> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>> >
>>> > Thanks Eric, I have filed https://issues.apache.org/
>>> > jira/browse/YARN-7338 to track this.
>>> >
>>> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
>>> > <ma...@hortonworks.com>> wrote:
>>> > -1 (binding).
>>> >
>>> > Ui2 does not seem to support same origin policy for cross site
>>> > scripting prevention.
>>> > The following parameters has no effect for /ui2:
>>> >
>>> > hadoop.http.cross-origin.enabled = true
>>> > yarn.resourcemanager.webapp.cross-origin.enabled = true
>>> >
>>> > This is because ui2 is designed as a separate web application.
>>> > WebFilters setup for existing resource manager doesn’t apply to the
>>> new web
>>> > application.
>>> > Please open JIRA to track the security issue and resolve the
>>> problem
>>> > prior to backporting this to branch-2.
>>> > This would minimize the risk to open up security hole in branch-2.
>>> >
>>> > Thank you
>>> >
>>> > Regards,
>>> > Eric
>>> >
>>> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com
>>> <mailto:
>>> > vrushalic2016@gmail.com>> wrote:
>>> >
>>> > We are planning to include the new YARN UI as part of 2.9
>>> > release. There
>>> > is work in progress for back-porting the UI to branch2.
>>> >
>>> > Details at https://issues.apache.org/jira/browse/YARN-7169.
>>> >
>>> >
>>> >
>>> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
>>> > rohithsharmaks@apache.org<ma...@apache.org>
>>> > > wrote:
>>> >
>>> > > I just noticed that my voted mail has been sent to Wangda and
>>> > forgotten to
>>> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
>>> > mail to
>>> > > yarn-dev.
>>> > >
>>> > > Thanks & Regards
>>> > > Rohith Sharma K S
>>> > >
>>> > >
>>> > > ---------- Forwarded message ----------
>>> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
>>> > rohithsharmaks@apache.org>>
>>> > > Date: 3 November 2016 at 12:06
>>> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>>> > > To: Wangda Tan <wheeleast@gmail.com<mailto:
>>> wheeleast@gmail.com>>
>>> > >
>>> > >
>>> > > +1
>>> > >
>>> > > Built from YARN-3368 branch and hosted in cluster. It is
>>> pretty
>>> > much good
>>> > > user experience UI.
>>> > > I hosted new web UI in same port as existing UI. I was able
>>> to
>>> > experience
>>> > > Queue, Application and Nodes pages.
>>> > >
>>> > >
>>> > > Thanks & Regards
>>> > > Rohith Sharma K S
>>> > >
>>> > > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
>>> > <ma...@gmail.com>> wrote:
>>> > >
>>> > > > YARN Devs,
>>> > > >
>>> > > > We propose to merge YARN-3368 (YARN next generation web UI)
>>> > development
>>> > > > branch into trunk for better development, would like to
>>> hear
>>> > your
>>> > > thoughts
>>> > > > before sending out vote mail.
>>> > > >
>>> > > > The new UI will co-exist with the old YARN UI, by default
>>> it
>>> > is disabled.
>>> > > > Please refer to User documentation of the new YARN UI
>>> > > > <
>>> https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
>>> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
>>> > YarnUI2.md>
>>> > > > for
>>> > > > more details.
>>> > > >
>>> > > > In addition, There’re two working-in-progress features need
>>> > the new UI to
>>> > > > be merged to trunk for further development.
>>> > > >
>>> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
>>> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
>>> > > >
>>> > > > *Status of YARN next generation web UI*
>>> > > >
>>> > > > Completed features
>>> > > >
>>> > > > - Cluster Overview Page
>>> > > > - Scheduler page
>>> > > > - Applications / Application / Application-attempts
>>> pages
>>> > > > - Nodes / Node page
>>> > > >
>>> > > > Integration to YARN
>>> > > >
>>> > > > - Hosts new web UI in RM
>>> > > > - Integrates to maven build / package
>>> > > >
>>> > > > Miscs:
>>> > > >
>>> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
>>> > > > - Documented how to use it. (In
>>> hadoop-yarn-project/hadoop-
>>> > > yarn/hadoop-
>>> > > > yarn-site/src/site/markdown/YarnUI2.md)
>>> > > >
>>> > > > Major items will finish on trunk:
>>> > > >
>>> > > > - Security support
>>> > > >
>>> > > > We have run the new UI in our internal cluster for more
>>> than 3
>>> > months,
>>> > > lots
>>> > > > of people have tried the new UI and gave lots of valuable
>>> > feedbacks and
>>> > > > reported suggestions / issues to us. We fixed many of them
>>> so
>>> > now we
>>> > > > believe it is more ready for wider folks to try.
>>> > > >
>>> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
>>> > > jira/browse/YARN-4734
>>> > > > .
>>> > > > The latest Jenkins run
>>> > > > <
>>> https://issues.apache.org/jira/browse/YARN-4734?focusedComm
>>> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
>>> > > > issuetabpanels:comment-tabpanel#comment-15620808>
>>> > > > gave
>>> > > > +1.
>>> > > >
>>> > > > The vote will run for 7 days, ending Sun, 11/06/2016.
>>> Please
>>> > feel free to
>>> > > > comment if you have any questions/doubts. I'll start with
>>> my +1
>>> > > (binding).
>>> > > >
>>> > > > Please share your thoughts about this.
>>> > > >
>>> > > > Thanks,
>>> > > > Wangda
>>> > > >
>>> > >
>>> >
>>> >
>>> >
>>> >
>>> >
>>>
>>
>>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Vrushali C <vr...@gmail.com>.
Thanks everyone!
Subru: Yes, I will back-port YARN-7170 as well.
Will do some more sanity tests and check QA for YARN-3368_branch2 and then
will proceed with the merge to branch2.
thanks
Vrushali
On Thu, Oct 19, 2017 at 3:24 PM, Subramaniam V K <su...@gmail.com> wrote:
> I think we should get in YARN-7170 before we merge the UI to branch-2
> especially since it looks like it is ready for commit?
>
> Thanks,
> Subru
>
> On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
>
>> Eric, thanks for updating your vote! I just committed YARN-7338
>>
>> Vrushali:
>>
>> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0, I'm
>> preferred to merge all existing JIRAs to branch-2 first and backport
>> YARN-7364 separately.
>>
>> Thanks,
>> Wangda
>>
>>
>> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com>
>> wrote:
>>
>> > +1 on merge when YARN-7338 is resolved.
>> >
>> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>> >
>> > Thank you
>> >
>> > Regards,
>> > Eric
>> >
>> > From: Vrushali C <vr...@gmail.com>
>> > Date: Monday, October 16, 2017 at 3:26 PM
>> > To: Eric Yang <ey...@hortonworks.com>
>> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
>> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
>> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
>> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>> >
>> > Thanks Eric, I have filed https://issues.apache.org/
>> > jira/browse/YARN-7338 to track this.
>> >
>> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
>> > <ma...@hortonworks.com>> wrote:
>> > -1 (binding).
>> >
>> > Ui2 does not seem to support same origin policy for cross site
>> > scripting prevention.
>> > The following parameters has no effect for /ui2:
>> >
>> > hadoop.http.cross-origin.enabled = true
>> > yarn.resourcemanager.webapp.cross-origin.enabled = true
>> >
>> > This is because ui2 is designed as a separate web application.
>> > WebFilters setup for existing resource manager doesn’t apply to the new
>> web
>> > application.
>> > Please open JIRA to track the security issue and resolve the problem
>> > prior to backporting this to branch-2.
>> > This would minimize the risk to open up security hole in branch-2.
>> >
>> > Thank you
>> >
>> > Regards,
>> > Eric
>> >
>> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<mailto:
>> > vrushalic2016@gmail.com>> wrote:
>> >
>> > We are planning to include the new YARN UI as part of 2.9
>> > release. There
>> > is work in progress for back-porting the UI to branch2.
>> >
>> > Details at https://issues.apache.org/jira/browse/YARN-7169.
>> >
>> >
>> >
>> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
>> > rohithsharmaks@apache.org<ma...@apache.org>
>> > > wrote:
>> >
>> > > I just noticed that my voted mail has been sent to Wangda and
>> > forgotten to
>> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
>> > mail to
>> > > yarn-dev.
>> > >
>> > > Thanks & Regards
>> > > Rohith Sharma K S
>> > >
>> > >
>> > > ---------- Forwarded message ----------
>> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
>> > rohithsharmaks@apache.org>>
>> > > Date: 3 November 2016 at 12:06
>> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>> > > To: Wangda Tan <wheeleast@gmail.com<mailto:wh
>> eeleast@gmail.com>>
>> > >
>> > >
>> > > +1
>> > >
>> > > Built from YARN-3368 branch and hosted in cluster. It is
>> pretty
>> > much good
>> > > user experience UI.
>> > > I hosted new web UI in same port as existing UI. I was able to
>> > experience
>> > > Queue, Application and Nodes pages.
>> > >
>> > >
>> > > Thanks & Regards
>> > > Rohith Sharma K S
>> > >
>> > > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
>> > <ma...@gmail.com>> wrote:
>> > >
>> > > > YARN Devs,
>> > > >
>> > > > We propose to merge YARN-3368 (YARN next generation web UI)
>> > development
>> > > > branch into trunk for better development, would like to hear
>> > your
>> > > thoughts
>> > > > before sending out vote mail.
>> > > >
>> > > > The new UI will co-exist with the old YARN UI, by default it
>> > is disabled.
>> > > > Please refer to User documentation of the new YARN UI
>> > > > <https://github.com/apache/had
>> oop/blob/YARN-3368/hadoop-yarn
>> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
>> > YarnUI2.md>
>> > > > for
>> > > > more details.
>> > > >
>> > > > In addition, There’re two working-in-progress features need
>> > the new UI to
>> > > > be merged to trunk for further development.
>> > > >
>> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
>> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
>> > > >
>> > > > *Status of YARN next generation web UI*
>> > > >
>> > > > Completed features
>> > > >
>> > > > - Cluster Overview Page
>> > > > - Scheduler page
>> > > > - Applications / Application / Application-attempts pages
>> > > > - Nodes / Node page
>> > > >
>> > > > Integration to YARN
>> > > >
>> > > > - Hosts new web UI in RM
>> > > > - Integrates to maven build / package
>> > > >
>> > > > Miscs:
>> > > >
>> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
>> > > > - Documented how to use it. (In
>> hadoop-yarn-project/hadoop-
>> > > yarn/hadoop-
>> > > > yarn-site/src/site/markdown/YarnUI2.md)
>> > > >
>> > > > Major items will finish on trunk:
>> > > >
>> > > > - Security support
>> > > >
>> > > > We have run the new UI in our internal cluster for more
>> than 3
>> > months,
>> > > lots
>> > > > of people have tried the new UI and gave lots of valuable
>> > feedbacks and
>> > > > reported suggestions / issues to us. We fixed many of them
>> so
>> > now we
>> > > > believe it is more ready for wider folks to try.
>> > > >
>> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
>> > > jira/browse/YARN-4734
>> > > > .
>> > > > The latest Jenkins run
>> > > > <https://issues.apache.org/jir
>> a/browse/YARN-4734?focusedComm
>> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
>> > > > issuetabpanels:comment-tabpanel#comment-15620808>
>> > > > gave
>> > > > +1.
>> > > >
>> > > > The vote will run for 7 days, ending Sun, 11/06/2016. Please
>> > feel free to
>> > > > comment if you have any questions/doubts. I'll start with
>> my +1
>> > > (binding).
>> > > >
>> > > > Please share your thoughts about this.
>> > > >
>> > > > Thanks,
>> > > > Wangda
>> > > >
>> > >
>> >
>> >
>> >
>> >
>> >
>>
>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Subramaniam V K <su...@gmail.com>.
I think we should get in YARN-7170 before we merge the UI to branch-2
especially since it looks like it is ready for commit?
Thanks,
Subru
On Thu, Oct 19, 2017 at 3:18 PM, Wangda Tan <wh...@gmail.com> wrote:
> Eric, thanks for updating your vote! I just committed YARN-7338
>
> Vrushali:
>
> Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0, I'm
> preferred to merge all existing JIRAs to branch-2 first and backport
> YARN-7364 separately.
>
> Thanks,
> Wangda
>
>
> On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com> wrote:
>
> > +1 on merge when YARN-7338 is resolved.
> >
> > On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
> >
> > Thank you
> >
> > Regards,
> > Eric
> >
> > From: Vrushali C <vr...@gmail.com>
> > Date: Monday, October 16, 2017 at 3:26 PM
> > To: Eric Yang <ey...@hortonworks.com>
> > Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
> > sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
> > yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> >
> > Thanks Eric, I have filed https://issues.apache.org/
> > jira/browse/YARN-7338 to track this.
> >
> > On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
> > <ma...@hortonworks.com>> wrote:
> > -1 (binding).
> >
> > Ui2 does not seem to support same origin policy for cross site
> > scripting prevention.
> > The following parameters has no effect for /ui2:
> >
> > hadoop.http.cross-origin.enabled = true
> > yarn.resourcemanager.webapp.cross-origin.enabled = true
> >
> > This is because ui2 is designed as a separate web application.
> > WebFilters setup for existing resource manager doesn’t apply to the new
> web
> > application.
> > Please open JIRA to track the security issue and resolve the problem
> > prior to backporting this to branch-2.
> > This would minimize the risk to open up security hole in branch-2.
> >
> > Thank you
> >
> > Regards,
> > Eric
> >
> > On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<mailto:
> > vrushalic2016@gmail.com>> wrote:
> >
> > We are planning to include the new YARN UI as part of 2.9
> > release. There
> > is work in progress for back-porting the UI to branch2.
> >
> > Details at https://issues.apache.org/jira/browse/YARN-7169.
> >
> >
> >
> > On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
> > rohithsharmaks@apache.org<ma...@apache.org>
> > > wrote:
> >
> > > I just noticed that my voted mail has been sent to Wangda and
> > forgotten to
> > > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
> > mail to
> > > yarn-dev.
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> > >
> > > ---------- Forwarded message ----------
> > > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
> > rohithsharmaks@apache.org>>
> > > Date: 3 November 2016 at 12:06
> > > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> > > To: Wangda Tan <wheeleast@gmail.com<mailto:wheeleast@gmail.com
> >>
> > >
> > >
> > > +1
> > >
> > > Built from YARN-3368 branch and hosted in cluster. It is pretty
> > much good
> > > user experience UI.
> > > I hosted new web UI in same port as existing UI. I was able to
> > experience
> > > Queue, Application and Nodes pages.
> > >
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> > > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
> > <ma...@gmail.com>> wrote:
> > >
> > > > YARN Devs,
> > > >
> > > > We propose to merge YARN-3368 (YARN next generation web UI)
> > development
> > > > branch into trunk for better development, would like to hear
> > your
> > > thoughts
> > > > before sending out vote mail.
> > > >
> > > > The new UI will co-exist with the old YARN UI, by default it
> > is disabled.
> > > > Please refer to User documentation of the new YARN UI
> > > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
> > YarnUI2.md>
> > > > for
> > > > more details.
> > > >
> > > > In addition, There’re two working-in-progress features need
> > the new UI to
> > > > be merged to trunk for further development.
> > > >
> > > > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > > > 2) UI of YARN ResourceManager Federation (YARN-2915).
> > > >
> > > > *Status of YARN next generation web UI*
> > > >
> > > > Completed features
> > > >
> > > > - Cluster Overview Page
> > > > - Scheduler page
> > > > - Applications / Application / Application-attempts pages
> > > > - Nodes / Node page
> > > >
> > > > Integration to YARN
> > > >
> > > > - Hosts new web UI in RM
> > > > - Integrates to maven build / package
> > > >
> > > > Miscs:
> > > >
> > > > - Added dependencies to LICENSE.txt/NOTICE.txt
> > > > - Documented how to use it. (In
> hadoop-yarn-project/hadoop-
> > > yarn/hadoop-
> > > > yarn-site/src/site/markdown/YarnUI2.md)
> > > >
> > > > Major items will finish on trunk:
> > > >
> > > > - Security support
> > > >
> > > > We have run the new UI in our internal cluster for more than
> 3
> > months,
> > > lots
> > > > of people have tried the new UI and gave lots of valuable
> > feedbacks and
> > > > reported suggestions / issues to us. We fixed many of them so
> > now we
> > > > believe it is more ready for wider folks to try.
> > > >
> > > > Merge JIRA for Jenkins is: https://issues.apache.org/
> > > jira/browse/YARN-4734
> > > > .
> > > > The latest Jenkins run
> > > > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > > > entId=15620808&page=com.atlassian.jira.plugin.system.
> > > > issuetabpanels:comment-tabpanel#comment-15620808>
> > > > gave
> > > > +1.
> > > >
> > > > The vote will run for 7 days, ending Sun, 11/06/2016. Please
> > feel free to
> > > > comment if you have any questions/doubts. I'll start with my
> +1
> > > (binding).
> > > >
> > > > Please share your thoughts about this.
> > > >
> > > > Thanks,
> > > > Wangda
> > > >
> > >
> >
> >
> >
> >
> >
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Wangda Tan <wh...@gmail.com>.
Eric, thanks for updating your vote! I just committed YARN-7338
Vrushali:
Since the YARN-7364 is an issue needs to be fixed in trunk/branch-3.0, I'm
preferred to merge all existing JIRAs to branch-2 first and backport
YARN-7364 separately.
Thanks,
Wangda
On Thu, Oct 19, 2017 at 10:04 AM, Eric Yang <ey...@hortonworks.com> wrote:
> +1 on merge when YARN-7338 is resolved.
>
> On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
>
> Thank you
>
> Regards,
> Eric
>
> From: Vrushali C <vr...@gmail.com>
> Date: Monday, October 16, 2017 at 3:26 PM
> To: Eric Yang <ey...@hortonworks.com>
> Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <
> sunilg@apache.org>, "yarn-dev@hadoop.apache.org" <
> yarn-dev@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
>
> Thanks Eric, I have filed https://issues.apache.org/
> jira/browse/YARN-7338 to track this.
>
> On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <eyang@hortonworks.com
> <ma...@hortonworks.com>> wrote:
> -1 (binding).
>
> Ui2 does not seem to support same origin policy for cross site
> scripting prevention.
> The following parameters has no effect for /ui2:
>
> hadoop.http.cross-origin.enabled = true
> yarn.resourcemanager.webapp.cross-origin.enabled = true
>
> This is because ui2 is designed as a separate web application.
> WebFilters setup for existing resource manager doesn’t apply to the new web
> application.
> Please open JIRA to track the security issue and resolve the problem
> prior to backporting this to branch-2.
> This would minimize the risk to open up security hole in branch-2.
>
> Thank you
>
> Regards,
> Eric
>
> On 10/16/17, 1:03 PM, "Vrushali C" <vrushalic2016@gmail.com<mailto:
> vrushalic2016@gmail.com>> wrote:
>
> We are planning to include the new YARN UI as part of 2.9
> release. There
> is work in progress for back-porting the UI to branch2.
>
> Details at https://issues.apache.org/jira/browse/YARN-7169.
>
>
>
> On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
> rohithsharmaks@apache.org<ma...@apache.org>
> > wrote:
>
> > I just noticed that my voted mail has been sent to Wangda and
> forgotten to
> > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted
> mail to
> > yarn-dev.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> >
> > ---------- Forwarded message ----------
> > From: Rohith Sharma K S <rohithsharmaks@apache.org<mailto:
> rohithsharmaks@apache.org>>
> > Date: 3 November 2016 at 12:06
> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> > To: Wangda Tan <wh...@gmail.com>>
> >
> >
> > +1
> >
> > Built from YARN-3368 branch and hosted in cluster. It is pretty
> much good
> > user experience UI.
> > I hosted new web UI in same port as existing UI. I was able to
> experience
> > Queue, Application and Nodes pages.
> >
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> > On 1 November 2016 at 04:23, Wangda Tan <wheeleast@gmail.com
> <ma...@gmail.com>> wrote:
> >
> > > YARN Devs,
> > >
> > > We propose to merge YARN-3368 (YARN next generation web UI)
> development
> > > branch into trunk for better development, would like to hear
> your
> > thoughts
> > > before sending out vote mail.
> > >
> > > The new UI will co-exist with the old YARN UI, by default it
> is disabled.
> > > Please refer to User documentation of the new YARN UI
> > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
> YarnUI2.md>
> > > for
> > > more details.
> > >
> > > In addition, There’re two working-in-progress features need
> the new UI to
> > > be merged to trunk for further development.
> > >
> > > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > > 2) UI of YARN ResourceManager Federation (YARN-2915).
> > >
> > > *Status of YARN next generation web UI*
> > >
> > > Completed features
> > >
> > > - Cluster Overview Page
> > > - Scheduler page
> > > - Applications / Application / Application-attempts pages
> > > - Nodes / Node page
> > >
> > > Integration to YARN
> > >
> > > - Hosts new web UI in RM
> > > - Integrates to maven build / package
> > >
> > > Miscs:
> > >
> > > - Added dependencies to LICENSE.txt/NOTICE.txt
> > > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> > yarn/hadoop-
> > > yarn-site/src/site/markdown/YarnUI2.md)
> > >
> > > Major items will finish on trunk:
> > >
> > > - Security support
> > >
> > > We have run the new UI in our internal cluster for more than 3
> months,
> > lots
> > > of people have tried the new UI and gave lots of valuable
> feedbacks and
> > > reported suggestions / issues to us. We fixed many of them so
> now we
> > > believe it is more ready for wider folks to try.
> > >
> > > Merge JIRA for Jenkins is: https://issues.apache.org/
> > jira/browse/YARN-4734
> > > .
> > > The latest Jenkins run
> > > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > > entId=15620808&page=com.atlassian.jira.plugin.system.
> > > issuetabpanels:comment-tabpanel#comment-15620808>
> > > gave
> > > +1.
> > >
> > > The vote will run for 7 days, ending Sun, 11/06/2016. Please
> feel free to
> > > comment if you have any questions/doubts. I'll start with my +1
> > (binding).
> > >
> > > Please share your thoughts about this.
> > >
> > > Thanks,
> > > Wangda
> > >
> >
>
>
>
>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Eric Yang <ey...@hortonworks.com>.
+1 on merge when YARN-7338 is resolved.
On 10/16/17, 3:33 PM, "Eric Yang" <ey...@hortonworks.com> wrote:
Thank you
Regards,
Eric
From: Vrushali C <vr...@gmail.com>
Date: Monday, October 16, 2017 at 3:26 PM
To: Eric Yang <ey...@hortonworks.com>
Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <su...@apache.org>, "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Thanks Eric, I have filed https://issues.apache.org/jira/browse/YARN-7338 to track this.
On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <ey...@hortonworks.com>> wrote:
-1 (binding).
Ui2 does not seem to support same origin policy for cross site scripting prevention.
The following parameters has no effect for /ui2:
hadoop.http.cross-origin.enabled = true
yarn.resourcemanager.webapp.cross-origin.enabled = true
This is because ui2 is designed as a separate web application. WebFilters setup for existing resource manager doesn’t apply to the new web application.
Please open JIRA to track the security issue and resolve the problem prior to backporting this to branch-2.
This would minimize the risk to open up security hole in branch-2.
Thank you
Regards,
Eric
On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com>> wrote:
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <ro...@apache.org>
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com>> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Eric Yang <ey...@hortonworks.com>.
Thank you
Regards,
Eric
From: Vrushali C <vr...@gmail.com>
Date: Monday, October 16, 2017 at 3:26 PM
To: Eric Yang <ey...@hortonworks.com>
Cc: Rohith Sharma K S <ro...@apache.org>, Sunil G <su...@apache.org>, "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>, Wangda Tan <wt...@hortonworks.com>
Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Thanks Eric, I have filed https://issues.apache.org/jira/browse/YARN-7338 to track this.
On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <ey...@hortonworks.com>> wrote:
-1 (binding).
Ui2 does not seem to support same origin policy for cross site scripting prevention.
The following parameters has no effect for /ui2:
hadoop.http.cross-origin.enabled = true
yarn.resourcemanager.webapp.cross-origin.enabled = true
This is because ui2 is designed as a separate web application. WebFilters setup for existing resource manager doesn’t apply to the new web application.
Please open JIRA to track the security issue and resolve the problem prior to backporting this to branch-2.
This would minimize the risk to open up security hole in branch-2.
Thank you
Regards,
Eric
On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com>> wrote:
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <ro...@apache.org>
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com>> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Vrushali C <vr...@gmail.com>.
Thanks Eric, I have filed https://issues.apache.org/jira/browse/YARN-7338
to track this.
On Mon, Oct 16, 2017 at 1:30 PM, Eric Yang <ey...@hortonworks.com> wrote:
> -1 (binding).
>
> Ui2 does not seem to support same origin policy for cross site scripting
> prevention.
> The following parameters has no effect for /ui2:
>
> hadoop.http.cross-origin.enabled = true
> yarn.resourcemanager.webapp.cross-origin.enabled = true
>
> This is because ui2 is designed as a separate web application. WebFilters
> setup for existing resource manager doesn’t apply to the new web
> application.
> Please open JIRA to track the security issue and resolve the problem prior
> to backporting this to branch-2.
> This would minimize the risk to open up security hole in branch-2.
>
> Thank you
>
> Regards,
> Eric
>
> On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com> wrote:
>
> We are planning to include the new YARN UI as part of 2.9 release.
> There
> is work in progress for back-porting the UI to branch2.
>
> Details at https://issues.apache.org/jira/browse/YARN-7169.
>
>
>
> On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <
> rohithsharmaks@apache.org
> > wrote:
>
> > I just noticed that my voted mail has been sent to Wangda and
> forgotten to
> > keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> > yarn-dev.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> >
> > ---------- Forwarded message ----------
> > From: Rohith Sharma K S <ro...@apache.org>
> > Date: 3 November 2016 at 12:06
> > Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> > To: Wangda Tan <wh...@gmail.com>
> >
> >
> > +1
> >
> > Built from YARN-3368 branch and hosted in cluster. It is pretty much
> good
> > user experience UI.
> > I hosted new web UI in same port as existing UI. I was able to
> experience
> > Queue, Application and Nodes pages.
> >
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
> > On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com> wrote:
> >
> > > YARN Devs,
> > >
> > > We propose to merge YARN-3368 (YARN next generation web UI)
> development
> > > branch into trunk for better development, would like to hear your
> > thoughts
> > > before sending out vote mail.
> > >
> > > The new UI will co-exist with the old YARN UI, by default it is
> disabled.
> > > Please refer to User documentation of the new YARN UI
> > > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/
> YarnUI2.md>
> > > for
> > > more details.
> > >
> > > In addition, There’re two working-in-progress features need the
> new UI to
> > > be merged to trunk for further development.
> > >
> > > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > > 2) UI of YARN ResourceManager Federation (YARN-2915).
> > >
> > > *Status of YARN next generation web UI*
> > >
> > > Completed features
> > >
> > > - Cluster Overview Page
> > > - Scheduler page
> > > - Applications / Application / Application-attempts pages
> > > - Nodes / Node page
> > >
> > > Integration to YARN
> > >
> > > - Hosts new web UI in RM
> > > - Integrates to maven build / package
> > >
> > > Miscs:
> > >
> > > - Added dependencies to LICENSE.txt/NOTICE.txt
> > > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> > yarn/hadoop-
> > > yarn-site/src/site/markdown/YarnUI2.md)
> > >
> > > Major items will finish on trunk:
> > >
> > > - Security support
> > >
> > > We have run the new UI in our internal cluster for more than 3
> months,
> > lots
> > > of people have tried the new UI and gave lots of valuable
> feedbacks and
> > > reported suggestions / issues to us. We fixed many of them so now
> we
> > > believe it is more ready for wider folks to try.
> > >
> > > Merge JIRA for Jenkins is: https://issues.apache.org/
> > jira/browse/YARN-4734
> > > .
> > > The latest Jenkins run
> > > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > > entId=15620808&page=com.atlassian.jira.plugin.system.
> > > issuetabpanels:comment-tabpanel#comment-15620808>
> > > gave
> > > +1.
> > >
> > > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel
> free to
> > > comment if you have any questions/doubts. I'll start with my +1
> > (binding).
> > >
> > > Please share your thoughts about this.
> > >
> > > Thanks,
> > > Wangda
> > >
> >
>
>
>
Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
Posted by Eric Yang <ey...@hortonworks.com>.
-1 (binding).
Ui2 does not seem to support same origin policy for cross site scripting prevention.
The following parameters has no effect for /ui2:
hadoop.http.cross-origin.enabled = true
yarn.resourcemanager.webapp.cross-origin.enabled = true
This is because ui2 is designed as a separate web application. WebFilters setup for existing resource manager doesn’t apply to the new web application.
Please open JIRA to track the security issue and resolve the problem prior to backporting this to branch-2.
This would minimize the risk to open up security hole in branch-2.
Thank you
Regards,
Eric
On 10/16/17, 1:03 PM, "Vrushali C" <vr...@gmail.com> wrote:
We are planning to include the new YARN UI as part of 2.9 release. There
is work in progress for back-porting the UI to branch2.
Details at https://issues.apache.org/jira/browse/YARN-7169.
On Mon, Nov 7, 2016 at 7:22 AM, Rohith Sharma K S <rohithsharmaks@apache.org
> wrote:
> I just noticed that my voted mail has been sent to Wangda and forgotten to
> keep yarn-dev in cc. Its my bad:-( I am forwarding my voted mail to
> yarn-dev.
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> ---------- Forwarded message ----------
> From: Rohith Sharma K S <ro...@apache.org>
> Date: 3 November 2016 at 12:06
> Subject: Re: [VOTE] Merge YARN-3368 (new web UI) to trunk
> To: Wangda Tan <wh...@gmail.com>
>
>
> +1
>
> Built from YARN-3368 branch and hosted in cluster. It is pretty much good
> user experience UI.
> I hosted new web UI in same port as existing UI. I was able to experience
> Queue, Application and Nodes pages.
>
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 1 November 2016 at 04:23, Wangda Tan <wh...@gmail.com> wrote:
>
> > YARN Devs,
> >
> > We propose to merge YARN-3368 (YARN next generation web UI) development
> > branch into trunk for better development, would like to hear your
> thoughts
> > before sending out vote mail.
> >
> > The new UI will co-exist with the old YARN UI, by default it is disabled.
> > Please refer to User documentation of the new YARN UI
> > <https://github.com/apache/hadoop/blob/YARN-3368/hadoop-yarn
> > -project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnUI2.md>
> > for
> > more details.
> >
> > In addition, There’re two working-in-progress features need the new UI to
> > be merged to trunk for further development.
> >
> > 1) UI of YARN Timeline Server v2 (YARN-2928)
> > 2) UI of YARN ResourceManager Federation (YARN-2915).
> >
> > *Status of YARN next generation web UI*
> >
> > Completed features
> >
> > - Cluster Overview Page
> > - Scheduler page
> > - Applications / Application / Application-attempts pages
> > - Nodes / Node page
> >
> > Integration to YARN
> >
> > - Hosts new web UI in RM
> > - Integrates to maven build / package
> >
> > Miscs:
> >
> > - Added dependencies to LICENSE.txt/NOTICE.txt
> > - Documented how to use it. (In hadoop-yarn-project/hadoop-
> yarn/hadoop-
> > yarn-site/src/site/markdown/YarnUI2.md)
> >
> > Major items will finish on trunk:
> >
> > - Security support
> >
> > We have run the new UI in our internal cluster for more than 3 months,
> lots
> > of people have tried the new UI and gave lots of valuable feedbacks and
> > reported suggestions / issues to us. We fixed many of them so now we
> > believe it is more ready for wider folks to try.
> >
> > Merge JIRA for Jenkins is: https://issues.apache.org/
> jira/browse/YARN-4734
> > .
> > The latest Jenkins run
> > <https://issues.apache.org/jira/browse/YARN-4734?focusedComm
> > entId=15620808&page=com.atlassian.jira.plugin.system.
> > issuetabpanels:comment-tabpanel#comment-15620808>
> > gave
> > +1.
> >
> > The vote will run for 7 days, ending Sun, 11/06/2016. Please feel free to
> > comment if you have any questions/doubts. I'll start with my +1
> (binding).
> >
> > Please share your thoughts about this.
> >
> > Thanks,
> > Wangda
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org