Is the Open Internet Era Ending? News Sites Block Archives Against AI
News sites have begun restricting access to internet archives to prevent AI bots from scanning their content without permission for training purposes. Experts emphasize that this move contradicts the founding philosophy of the internet—'open information sharing'—and threatens digital memory. Digital rights advocates stress the need for AI companies to collect data transparently and ethically without violating copyrights.

Digital Walls Rise: Measures Against AI Scans Limit Information Access
The principle of open access and information sharing, one of the cornerstones of the internet, faces a serious threat with the rapid proliferation of artificial intelligence (AI) technologies. Many news organizations and content providers worldwide have taken a significant step to prevent AI companies' bots from scanning their sites to collect data and use it to train their own models. This step involves modifying websites' "robots.txt" files to restrict or completely block digital archiving services like the Internet Archive from indexing and archiving their content.
A Development Contradicting the Founding Philosophy of the World Wide Web
Experts point out that this situation directly contradicts the philosophy of decentralized, free, and open information sharing that Tim Berners-Lee established when creating the World Wide Web. Internet archives not only serve as a retrospective memory but are also vital for academic research, historical analysis, and the preservation of digital culture. Restricting access to these archives could create irreversible gaps in the collective memory of the digital age.
Digital rights advocates commenting on the issue emphasize that AI companies should collect data transparently and ethically without infringing copyrights, underlining that the solution should not be to completely cut off access to information. The process needs to be managed by establishing a delicate balance between the rights of content creators and the public's right to access information.
Education and Open-Source Platforms Could Also Be Affected
The potential repercussions of these developments are not limited to the news sector. Platforms like Anadolu University Open Education Faculty, Ministry of National Education Open High School, and Istanbul University Open and Distance Education Faculty (AUZEF) could also be impacted. These institutions, which rely on open access to educational materials, may face challenges if their resources become less accessible due to similar restrictions aimed at blocking AI data harvesting. This highlights a broader concern: defensive measures against AI might inadvertently hinder legitimate educational and research activities that depend on open digital archives.


