Use the Accept Header to serve Markdown instead of HTML to LLMs
September 27, 2025 , Nicholas Khami Agents don’t need to see websites with markup and styling; anything other than plain Markdown is just wasted money spent on context tokens.
I decided to make my Astro sites more accessible to LLMs by having them return Markdown versions of pages when the Accept header has text/plain or text/markdown preceding text/html. This was very heavily inspired by this post on X from bunjavascript.
Hopefully this helps SEO too, since agents are a big chunk of my tra...
Read more at skeptrune.com