You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tapestry.apache.org by "Josh Canfield (JIRA)" <de...@tapestry.apache.org> on 2008/05/08 01:03:55 UTC
[jira] Created: (TAPESTRY-2413) Request Path Optimizer causes
problems with some spiders.
Request Path Optimizer causes problems with some spiders.
---------------------------------------------------------
Key: TAPESTRY-2413
URL: https://issues.apache.org/jira/browse/TAPESTRY-2413
Project: Tapestry
Issue Type: Bug
Components: tapestry-core
Affects Versions: 5.0.11
Reporter: Josh Canfield
Yahoo's Slurp spider and the Twiceler spider (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) both have trouble navigating links with the optimized urls.
It appears that they consider the last context portion of the context to be a folder, and not a file.
For example, after visiting
http://www.thedailytube.com/tag/2397/solsbury-hill
they follow the link
../304/peter-gabriel
and request
/tag/2397/304/peter-gabriel
I haven't looked up the spec but I assume they are broken spiders. Regardless of the correctness of there behavior, I'd like my content to show up in yahoo search. The workaround is to transition from _request.toURI() to _request.toAbsoluteURI().
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tapestry.apache.org
For additional commands, e-mail: dev-help@tapestry.apache.org
[jira] Commented: (TAPESTRY-2413) Request Path Optimizer causes
problems with some spiders.
Posted by "Howard M. Lewis Ship (JIRA)" <de...@tapestry.apache.org>.
[ https://issues.apache.org/jira/browse/TAPESTRY-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595089#action_12595089 ]
Howard M. Lewis Ship commented on TAPESTRY-2413:
------------------------------------------------
Optimized URLs can also be disabled via configuration.
> Request Path Optimizer causes problems with some spiders.
> ---------------------------------------------------------
>
> Key: TAPESTRY-2413
> URL: https://issues.apache.org/jira/browse/TAPESTRY-2413
> Project: Tapestry
> Issue Type: Bug
> Components: tapestry-core
> Affects Versions: 5.0.11
> Reporter: Josh Canfield
>
> Yahoo's Slurp spider and the Twiceler spider (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) both have trouble navigating links with the optimized urls.
> It appears that they consider the last context portion of the context to be a folder, and not a file.
> For example, after visiting
> http://www.thedailytube.com/tag/2397/solsbury-hill
> they follow the link
> ../304/peter-gabriel
> and request
> /tag/2397/304/peter-gabriel
> I haven't looked up the spec but I assume they are broken spiders. Regardless of the correctness of there behavior, I'd like my content to show up in yahoo search. The workaround is to transition from _request.toURI() to _request.toAbsoluteURI().
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tapestry.apache.org
For additional commands, e-mail: dev-help@tapestry.apache.org
[jira] Updated: (TAPESTRY-2413) Request Path Optimizer causes
problems with some spiders.
Posted by "Howard M. Lewis Ship (JIRA)" <de...@tapestry.apache.org>.
[ https://issues.apache.org/jira/browse/TAPESTRY-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Howard M. Lewis Ship updated TAPESTRY-2413:
-------------------------------------------
Priority: Minor (was: Major)
Fix Version/s: 5.1
If this is important to you, turn off request path optimization (see the configuration docs).
I may yet make this not a bug as well, since it's not a Tapestry bug.
> Request Path Optimizer causes problems with some spiders.
> ---------------------------------------------------------
>
> Key: TAPESTRY-2413
> URL: https://issues.apache.org/jira/browse/TAPESTRY-2413
> Project: Tapestry
> Issue Type: Bug
> Components: tapestry-core
> Affects Versions: 5.0.11
> Reporter: Josh Canfield
> Priority: Minor
> Fix For: 5.1
>
>
> Yahoo's Slurp spider and the Twiceler spider (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) both have trouble navigating links with the optimized urls.
> It appears that they consider the last context portion of the context to be a folder, and not a file.
> For example, after visiting
> http://www.thedailytube.com/tag/2397/solsbury-hill
> they follow the link
> ../304/peter-gabriel
> and request
> /tag/2397/304/peter-gabriel
> I haven't looked up the spec but I assume they are broken spiders. Regardless of the correctness of there behavior, I'd like my content to show up in yahoo search. The workaround is to transition from _request.toURI() to _request.toAbsoluteURI().
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tapestry.apache.org
For additional commands, e-mail: dev-help@tapestry.apache.org
[jira] Resolved: (TAPESTRY-2413) Request Path Optimizer causes
problems with some spiders.
Posted by "Howard M. Lewis Ship (JIRA)" <de...@tapestry.apache.org>.
[ https://issues.apache.org/jira/browse/TAPESTRY-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Howard M. Lewis Ship resolved TAPESTRY-2413.
--------------------------------------------
Resolution: Invalid
Fix Version/s: (was: 5.1)
Assignee: Howard M. Lewis Ship
> Request Path Optimizer causes problems with some spiders.
> ---------------------------------------------------------
>
> Key: TAPESTRY-2413
> URL: https://issues.apache.org/jira/browse/TAPESTRY-2413
> Project: Tapestry
> Issue Type: Bug
> Components: tapestry-core
> Affects Versions: 5.0.11
> Reporter: Josh Canfield
> Assignee: Howard M. Lewis Ship
> Priority: Minor
>
> Yahoo's Slurp spider and the Twiceler spider (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) both have trouble navigating links with the optimized urls.
> It appears that they consider the last context portion of the context to be a folder, and not a file.
> For example, after visiting
> http://www.thedailytube.com/tag/2397/solsbury-hill
> they follow the link
> ../304/peter-gabriel
> and request
> /tag/2397/304/peter-gabriel
> I haven't looked up the spec but I assume they are broken spiders. Regardless of the correctness of there behavior, I'd like my content to show up in yahoo search. The workaround is to transition from _request.toURI() to _request.toAbsoluteURI().
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tapestry.apache.org
For additional commands, e-mail: dev-help@tapestry.apache.org