You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Sidharta Seethana (JIRA)" <ji...@apache.org> on 2016/09/14 23:51:20 UTC

[jira] [Updated] (YARN-4591) YARN Web UIs should provide a robots.txt

     [ https://issues.apache.org/jira/browse/YARN-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sidharta Seethana updated YARN-4591:
------------------------------------
    Attachment: YARN-4591.001.patch

Uploaded a patch that provides a robot.txt for all YARN web UIs that disallows crawling. Added a unit test and tested this manually with RM/NM web UIs. 

> YARN Web UIs should provide a robots.txt
> ----------------------------------------
>
>                 Key: YARN-4591
>                 URL: https://issues.apache.org/jira/browse/YARN-4591
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Lars Francke
>            Assignee: Sidharta Seethana
>            Priority: Trivial
>         Attachments: YARN-4591.001.patch
>
>
> To prevent well-behaved crawlers from indexing public YARN UIs.
> Similar to HDFS-330 / HDFS-9651.
> I took a quick look at the Webapp stuff in YARN and it looks complicated so I can't provide a quick patch. If anyone can point me in the right direction I might take a look.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org