[jira] [Commented] (TS-3003) Remove overwriting of robots.txt in page speed plugin

["Christian Grobmeier (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TS-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094034#comment-14094034 ] 

Christian Grobmeier commented on TS-3003:
-----------------------------------------

if this is going to happen, the please also take of this line which would prevent delivering the original robots.txt:

https://github.com/apache/trafficserver/blob/8b1467e4941ce6f9e781bfafbec229c983be032a/plugins/experimental/ats_speed/ats_speed.cc#L751

> Remove overwriting of robots.txt in page speed plugin
> -----------------------------------------------------
>
>                 Key: TS-3003
>                 URL: https://issues.apache.org/jira/browse/TS-3003
>             Project: Traffic Server
>          Issue Type: Bug
>            Reporter: Christian Grobmeier
>
> Currently the page speed plugin overwrites /robots.txt with its own content. This leads to problems in our setup, as Google cannot index our cached website.
> The following lines:
> https://github.com/apache/trafficserver/blob/master/plugins/experimental/ats_speed/ats_resource_intercept.cc#L281-L286
> demonstrate how page speed subdues our own robots.txt and overwrites it with own content for unknown reasons.
> Also the second if/else can be removed as it currently has no further use.



--
This message was sent by Atlassian JIRA
(v6.2#6252)