News Score: Score the News, Sort the News, Rewrite the Headlines

Multiple AI Companies Ignore Robots.Txt Files, Scrape Web Content, Says Licensing Firm - Slashdot

Multiple AI companies are ignoring Robots.txt files meant to block the scraping of web content for generative AI systems, reports Reuters — citing a warning sent to publisher by content licensing startup TollBit. TollBit, an early-stage startup, is positioning itself as a matchmaker between content-hungry AI companies and publishers open to striking licensing deals with them. The company tracks AI traffic to the publishers' websites and uses analytics to help both sides settle on fees to be pai...

Read more at news.slashdot.org

© News Score  score the news, sort the news, rewrite the headlines