Meta’s proposed changes to its commercial terms of service have brought a long-standing tension between technology platforms and digital publishers into sharper focus: who controls content published on the open web, and what rights should technology companies have to use it?

The controversy centres on Meta’s updated commercial terms, which initially appeared to authorise the company to crawl websites associated with business accounts and use the collected content to develop, improve and train its products. The language prompted concerns among publishers that maintaining a business presence on Meta’s platforms could expose content hosted on their own websites to broader forms of data collection.

The company subsequently revised the disputed wording following criticism from media organisations and legal experts. However, the changes have not entirely resolved concerns about the scope of Meta’s permissions or the implications for content owners.

On 22 October, digital publishers and advertisers, represented by the advocacy group Movement for an Open Web, urged the European Commission and the UK’s Competition and Markets Authority (CMA) to suspend the revised terms before their scheduled implementation on 30 October 2026. The group argued that the provisions could give Meta extensive access to digital content and create competition concerns. Meta has disputed the allegations.

What changed in Meta’s commercial terms?

The initial version of the updated terms explicitly stated that Meta could use content collected from associated websites to provide, develop, improve, research and train its products and services. The provision also referred to automated tools, including web crawlers and scrapers, to access and periodically retrieve content from relevant domains and web pages.

The breadth of the language alarmed publishers because it appeared to extend beyond content users voluntarily uploaded to Facebook, Instagram or other Meta platforms. It potentially covered material published on external websites linked to a business’s products or services, including articles, reports and other original content.

Following reporting by Nieman Journalism Lab and subsequent criticism, Meta revised the provision on 17 October. The updated language removed the explicit reference to training and narrowed the stated purposes of collection to advertising and business products, alongside maintaining the integrity and security of its platforms.

Meta said the revision clarified the scope of its commercial terms and maintained that the changes did not alter how it uses web crawlers. The company also said website owners could continue to signal their preferences through robots.txt files, which communicate instructions to automated crawlers.

However, legal experts have questioned whether the revised wording sufficiently limits the purposes for which collected content may be used. In particular, the terms still refer to developing and improving advertising and business products, language that critics argue could leave room for broader interpretations.

The distinction matters. Removing an explicit reference to AI training does not, by itself, settle every question about the potential use of collected material in AI-related products.

Why publishers are concerned

For digital publishers, original reporting and editorial content are valuable assets. They require investment in journalists, editors, research, fact-checking and distribution. The ability to monetise that work through subscriptions, advertising, syndication and licensing is central to the sustainability of many media organisations.

AI systems introduce a new dimension to this relationship. Content that once primarily attracted readers to a publisher’s website can also become a potential input for systems that generate answers, summaries and other forms of information.

This creates a fundamental question for the media industry: if a technology company can collect and process material published on a website, what obligations should it have towards the organisation that produced it?

The issue is particularly relevant to news publishers, which often maintain business accounts on Meta’s platforms to distribute stories, reach audiences and drive traffic to their websites. These channels are part of the infrastructure through which many media organisations operate, making the prospect of withdrawing from them a difficult commercial decision.

The concerns extend beyond journalism. Businesses across industries publish proprietary research, product information, market analysis and other material on their websites. Any expansion of automated access to such content could raise questions about consent, competitive advantage and the boundaries between publicly accessible information and commercially valuable intellectual property.

The limitations of robots.txt

Meta has pointed to robots.txt as a mechanism through which website owners can indicate whether automated crawlers should access particular parts of their websites.

The mechanism is widely used across the web, but its practical limitations are important. A robots.txt file communicates a website’s preferences to compliant crawlers; it is not, by itself, a technical barrier that prevents all automated access or an independent guarantee of legal protection.

This distinction has become central to the dispute. Publishers want clarity not only on whether they can signal that their content should not be crawled, but also on how those preferences interact with the contractual terms governing their use of Meta’s commercial services.

The question is therefore as much about enforceability and transparency as it is about technology. Website owners need to understand what permissions they are granting, which content those permissions cover and what recourse they have if the content is used beyond their intended scope.

Copyright and competition enter the debate

The dispute reflects two connected but distinct regulatory challenges.

The first concerns copyright and the use of protected material in AI development. Whether particular uses of scraped content are lawful depends on the circumstances, applicable legislation and unresolved legal questions surrounding AI training. Broad contractual language does not automatically settle those questions.

The second concerns competition. Critics argue that tying broad content-access permissions to the use of business services could put companies in a difficult position if they depend on Meta to reach customers and audiences.

In its complaint, the Movement for an Open Web argued that businesses could effectively be compelled to accept the conditions to continue using services on which they rely. Meta has rejected the criticism and maintained that the revised terms do not grant it new rights that override website owners’ stated crawler preferences.

The UK’s CMA said it was engaged in discussions with Meta as it considered the concerns raised by businesses, while the European Commission confirmed that it had received a complaint and would assess it through its established procedures. These developments do not constitute a finding of wrongdoing, but they signal that the dispute is moving beyond a disagreement over contractual language.

The larger question facing the open web

The controversy arrives as technology companies compete to build and improve AI systems that depend on access to large volumes of information. Publishers, meanwhile, are grappling with the implications of a digital economy in which their work can serve both as content for human audiences and as data for automated systems.

The underlying tension is not simply whether AI companies should be allowed to access publicly available material. It is whether access should be governed by clear permissions, transparent terms and meaningful opportunities for content owners to make informed choices.

For publishers, the challenge is to protect the value of original work without losing access to the platforms that help them reach audiences. For technology companies, the challenge is to establish sustainable access to information while addressing legitimate concerns about ownership, consent and competition.

Meta’s revised wording may have removed one of the most explicit references that triggered the backlash, but it has not eliminated the broader debate. As the revised terms approach their scheduled implementation, the response from regulators could help shape expectations around the relationship between platform access, website content and AI development.

The outcome could have implications well beyond Meta. It may influence how digital platforms define their rights over externally hosted content, how publishers negotiate the use of their work and how regulators approach the growing intersection of AI, intellectual property and market power.

Ultimately, the open web depends not only on the ability to access information, but also on a workable balance between access and the rights of those who create it. How that balance is defined in the AI era will be an increasingly consequential question for the technology and media industries alike.

Editorial note

Before publication, verify the precise wording of the latest commercial terms and their implementation status on 30 October. The article distinguishes the initial wording from Meta’s subsequent revision and presents the regulatory complaints as allegations, not established findings.

Also read: Viksit Workforce for a Viksit Bharat

Do Follow: The Mainstream LinkedIn | The Mainstream Facebook | The Mainstream Youtube | The Mainstream Twitter

About us:

The Mainstream is a premier platform delivering the latest updates and informed perspectives across the technology business and cyber landscape. Built on research-driven, thought leadership and original intellectual property, The Mainstream also curates summits & conferences that convene decision makers to explore how technology reshapes industries and leadership. With a growing presence in India and globally across the Middle East, Africa, ASEAN, the USA, the UK and Australia, The Mainstream carries a vision to bring the latest happenings and insights to 8.2 billion people and to place technology at the centre of conversation for leaders navigating the future.