TIME Is Serving AI Bots a Different Website, With Ads Built In
TIME is now serving two different versions of its website. Humans get the magazine. AI crawlers get a stripped down markdown copy with ads baked in that no person will ever see.
I fetched one ordinary TIME health article, The Morning Light Habit Sleep Experts Swear By, over and over from the same machine, changing only the User-Agent header each time. That header is the string every browser and bot sends to say what it is. TIME reads it and decides what to hand back.
As Chrome, I got 200 OK, tex...
Read more at vincentschmalbach.com