Reddit is proscribing its availability to the Web Archive’s Wayback Machine

The Web Archive’s Wayback Machine is the most recent sufferer of Reddit’s crackdown on knowledge entry. The corporate has begun to put new restrictions on what the archive website will have the ability to entry in a transfer that can considerably restrict the Wayback Machine’s means to protect info from Reddit.

With the change, the Wayback Machine, a challenge run by the nonprofit Web Archive, will solely have the ability to crawl Reddit’s homepage. It should now not have the ability to entry feedback, subreddit pages, publish particulars, profiles and different knowledge.

The transfer is the most recent step Reddit has taken on its quest to restrict AI corporations’ means to make use of its knowledge to coach giant language fashions with out paying licensing fees. It is also a notably totally different stance than the corporate took final 12 months, when it explicitly stated that it could not restrict “good religion actors,” including the Web Archive. It isn’t clear what precisely has modified since then. Reddit appears to consider that AI corporations are circumventing its guidelines by scraping knowledge through the Wayback Machine. We have reached out to the Web Archive for remark.

Information licensing has grow to be a major enterprise for Reddit. The corporate has struck multimillion-dollar offers with OpenAI and Google that enable them to make use of Reddit posts to assist prepare their AI fashions. On the identical time, Reddit has taken an more and more hardline stance towards corporations that try to make use of its knowledge with out such preparations. Earlier this 12 months, the corporate sued Anthropic, alleging it scraped Reddit for years with out permission.