News Score: Score the News, Sort the News, Rewrite the Headlines

Nearly 90% of our AI Crawler Traffic is From TikTok Parent Bytedance – Lessons Learned

This month, Fortune.com reported that TikTok’s web scraper — known as Bytespider — is aggressively sucking up content to fuel generative AI models. We noticed the same thing when looking at bot management analytics produced by HAProxy Edge — our global network that we ourselves use to serve traffic for haproxy.com. Some of the numbers we are seeing are fairly shocking, so let’s review the traffic sources and where they originate. Our own measurements, collected by HAProxy Edge and filtered to tr...

Read more at haproxy.com

© News Score  score the news, sort the news, rewrite the headlines