You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "xiangfu0 (via GitHub)" <gi...@apache.org> on 2026/03/22 00:46:10 UTC
[PR] Fix SEO: disable directory listings and add canonical URLs [pinot-site]
xiangfu0 opened a new pull request, #171:
URL: https://github.com/apache/pinot-site/pull/171
## Summary
- **Postbuild script** generates `noindex` + redirect `index.html` for intermediate blog date directories (`/blog/YYYY/`, `/blog/YYYY/MM/`, `/blog/YYYY/MM/DD/`) that were exposing raw filesystem listings to crawlers
- **robots.txt** updated with `Disallow` rules for date-only directory paths, paired with more-specific `Allow` rules that preserve indexing of actual blog post URLs (`/blog/YYYY/MM/DD/title/`)
- **Blog post metadata** now includes explicit `<link rel="canonical">` using the frontmatter `canonicalUrl` field (if set) or the computed absolute URL, replacing the relative `./` OpenGraph URL
## Test plan
- [ ] Run `npm run build` and verify `out/blog/2025/index.html` contains `noindex` meta tag and redirect
- [ ] Verify `out/blog/2025/02/17/Announcing-Apache-Pinot-1-3/index.html` is unchanged (actual post)
- [ ] Check `out/robots.txt` has both Allow and Disallow rules for year prefixes
- [ ] Confirm blog post pages have `<link rel="canonical" href="https://pinot.apache.org/blog/...">` in HTML head
🤖 Generated with [Claude Code](https://claude.com/claude-code)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [PR] Fix SEO: disable directory listings and add canonical URLs [pinot-site]
Posted by "xiangfu0 (via GitHub)" <gi...@apache.org>.
xiangfu0 merged PR #171:
URL: https://github.com/apache/pinot-site/pull/171
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org