Re: Expose Apache Camel website for LLMs https://llmstxt.org/

[Claus Ibsen <cl...@gmail.com>]

Hi

I wonder if the camel-website can be made to return the LLM friendly
markdown pages, using HTTP accept headers also.

curl -H "Accept: text/markdown"
https://camel.apache.org/components/4.14.x/direct-component.html

Then it redirects to
https://camel.apache.org/components/4.14.x/direct-component.md




On Mon, Nov 10, 2025 at 9:59 AM Federico Mariani <
federico.mariani.1990@gmail.com> wrote:

> Hello,
>
> llms.txt is a proposal that aims to standardize how LLMs can easily access
> information. I think the Apache Camel website is structured well enough and
> we can easily expose information so that it's easily accessible to LLMs.
> The /llms.txt is similar to a sitemap, but designed for LLM consumption
> with markdown content.
>
> I see here two main benefits:
> 1. When LLMs are trained, they can easily crawl and index our documentation
> through the standardized llms.txt format
> 2. The llms.txt and markdown pages can be used by coding agents like Gemini
> CLI, Claude Code, Cursor, etc. directly to provide accurate Apache Camel
> information
>
> Implementation attempt on camel-website:
> - After Antora generates HTML pages, a Gulp task converts them to markdown
> - The public folder now contains both advice-with.html and
> advice-with.html.md for every page
> - Markdown files are cleaned up - only the important article section is
> extracted (no nav, headers, footers)
> - An /llms.txt file is generated at the root with an overview and structure
> Results:
> - 5,355+ markdown pages generated automatically during build
> - Almost all HTML pages can be accessed as markdown by appending .md to the
> URL (the .md after .html is just a proposal, there aren't best practices
> around it, any input is welcome)
>
> This way html documentation like
> https://camel.apache.org/components/next/languages/simple-language.html
> and
> markdown content
> https://camel.apache.org/components/next/languages/simple-language.html.md
> will
> be exposed.
>
> This should make Apache Camel documentation much more accessible to AI
> tools and future LLM training.
>
> Draft Pull Request: https://github.com/apache/camel-website/pull/1437
> Any feedback or suggestions are welcome!
>
> Regards,
> Federico
>


-- 
Claus Ibsen

Re: Expose Apache Camel website for LLMs https://llmstxt.org/

[Federico Mariani <fe...@gmail.com>]

Hi,

That would be really nice to have. I opened a PR with a proposal
https://github.com/apache/camel-website/pull/1476

Federico

Il giorno gio 15 gen 2026 alle ore 13:37 Claus Ibsen <cl...@gmail.com>
ha scritto:

> Hi
>
> I wonder if the camel-website can be made to return the LLM friendly
> markdown pages, using HTTP accept headers also.
>
> curl -H "Accept: text/markdown"
> https://camel.apache.org/components/4.14.x/direct-component.html
>
> Then it redirects to
> https://camel.apache.org/components/4.14.x/direct-component.md
>
>
>
>
> On Mon, Nov 10, 2025 at 9:59 AM Federico Mariani <
> federico.mariani.1990@gmail.com> wrote:
>
> > Hello,
> >
> > llms.txt is a proposal that aims to standardize how LLMs can easily
> access
> > information. I think the Apache Camel website is structured well enough
> and
> > we can easily expose information so that it's easily accessible to LLMs.
> > The /llms.txt is similar to a sitemap, but designed for LLM consumption
> > with markdown content.
> >
> > I see here two main benefits:
> > 1. When LLMs are trained, they can easily crawl and index our
> documentation
> > through the standardized llms.txt format
> > 2. The llms.txt and markdown pages can be used by coding agents like
> Gemini
> > CLI, Claude Code, Cursor, etc. directly to provide accurate Apache Camel
> > information
> >
> > Implementation attempt on camel-website:
> > - After Antora generates HTML pages, a Gulp task converts them to
> markdown
> > - The public folder now contains both advice-with.html and
> > advice-with.html.md for every page
> > - Markdown files are cleaned up - only the important article section is
> > extracted (no nav, headers, footers)
> > - An /llms.txt file is generated at the root with an overview and
> structure
> > Results:
> > - 5,355+ markdown pages generated automatically during build
> > - Almost all HTML pages can be accessed as markdown by appending .md to
> the
> > URL (the .md after .html is just a proposal, there aren't best practices
> > around it, any input is welcome)
> >
> > This way html documentation like
> > https://camel.apache.org/components/next/languages/simple-language.html
> > and
> > markdown content
> >
> https://camel.apache.org/components/next/languages/simple-language.html.md
> > will
> > be exposed.
> >
> > This should make Apache Camel documentation much more accessible to AI
> > tools and future LLM training.
> >
> > Draft Pull Request: https://github.com/apache/camel-website/pull/1437
> > Any feedback or suggestions are welcome!
> >
> > Regards,
> > Federico
> >
>
>
> --
> Claus Ibsen
>