/ai-search731 words

Meta Moves Business Terms to Nov. 20, Keeps Crawling Clause

Meta moved the effective date for revised Commercial and Self-Serve Ad Terms to Nov. 20, but retained crawling permissions as publishers and two European regulators pressed for changes.

Meta Delays The Terms That Let It Crawl Business Sites via @sejournal, @MattGSouthern
Meta Delays The Terms That Let It Crawl Business Sites via @sejournal, @MattGSouthernPexels / pixabay
  • Meta delayed the Commercial Terms and Self-Serve Ad Terms from Oct. 30 to Nov. 20.
  • As of Oct. 23, the U.S. English previews changed only the effective date.
  • On Oct. 25, UK English, German and French previews still showed Oct. 30.
  • Neither the CMA nor the European Commission ordered Meta's delay; both were reviewing complaints.
  • The Aug. 22, 2025 Self-Serve Ad Terms already allowed crawling of advertiser domains for research and training after an ad order.

Meta delayed the effective date of its revised Commercial Terms and Self-Serve Ad Terms from Oct. 30 to Nov. 20. The company left the contested crawling permission in both agreements. The Commercial Terms cover any business use, including managing a Facebook Page. The permission has drawn complaints from publishers and advertisers.

Meta announced the delay itself. Neither the UK Competition and Markets Authority nor the European Commission ordered the postponement or instructed Meta to amend the clause. Meta chose the new date while both regulatory reviews remain open.

What changed in the revised terms?

A Meta spokesperson told Nieman Lab the company extended the date “to allow more time for us to explain to our partners and stakeholders what’s changing and what’s not.” The spokesperson said that explanation would cover how Meta uses web crawlers.

U.S. English previews of both agreements list Nov. 20. As of Oct. 23, Meta had changed the terms except for the date. Regional previews had not aligned. On Oct. 25, the UK English, German and French Commercial Terms still listed Oct. 30.

What does the crawling clause permit?

Meta’s current Self-Serve Ad Terms, dated Aug. 22, 2025, already allow Meta to crawl content on advertiser domains for uses that include research and training once an advertiser places an ad order. Earlier in October, Meta removed training from the Commercial Terms clause. That edit did not remove crawling itself.

The Commercial Terms paragraph permits automated software to create test credentials, crawl pages associated with a business’s products or services, and periodically pull updates from those pages. Neither preview mentions robots.txt.

Meta says webmasters can use robots.txt to indicate preferred crawling behavior and influence how Meta crawls their sites. The company also identifies crawler uses spanning advertising, AI model training and Meta AI search. However, the revised terms do not say whether a robots.txt setting limits the crawling grant a business accepts. That leaves the contractual effect of robots.txt unspecified.

How do businesses accept the update?

The Commercial Terms let businesses accept every terms update, including crawling permissions, by continuing to use Meta’s business products after notice. The Nov. 20 deadline therefore matters to Facebook Page managers, advertisers and sites tied to products or services.

What are regulators examining?

The Movement for an Open Web asked the European Commission and the UK’s Competition and Markets Authority to block Meta’s terms through interim measures during their investigations. The group’s members include advertisers and publishers. Meta told Reuters it disagreed with the complaint.

After the delay, a CMA spokesperson told Nieman Lab the agency would continue scrutinizing the terms and engage with Meta and others as it considered next steps. The European Commission told Reuters it was assessing the complaint.

On Oct. 23, the Commission told Nieman Lab it welcomed the postponement and remained committed to ensuring Meta’s compliance with EU law, including Article 102 TFEU and the Digital Markets Act. Neither regulator ordered the date change.

What do publishers want changed?

WAN-IFRA, the World Association of News Publishers, asked Meta to suspend the crawling provision temporarily for news publishers and make robots.txt binding within its terms. On Oct. 23, WAN-IFRA CEO Stig Ørskov said: “This postponement is a welcome step, but it does not address our concerns.”

The same day, the European Alliance of News Agencies called again for Meta to eliminate the provision altogether. It also expressed hope that the new deadline would create meaningful dialogue. These are requests, not announced policy changes. Meta’s own notice still schedules the revised terms for Nov. 20, and the crawl permission remains in the U.S. previews.

What should site owners monitor?

Before Nov. 20, site owners should compare the U.S. and localized terms, then review the crawling paragraph and robots.txt handling for each Meta crawler. Continued product use after notice means acceptance of the updated terms.

Monitor Meta’s next revision of the previews, especially whether it removes the provision or states that robots.txt limits contractual permission. Publisher groups hope for a change before Nov. 20, while the CMA considers its next steps and the Commission assesses the complaint.

Watch Meta’s revised previews before Nov. 20, the CMA’s next steps and the Commission’s assessment; publisher groups still hope for meaningful changes before the deadline.

via niemanlab.org (Original)

More from Nathan Brooks

Nathan Brooks

Show full bio

Senior reporter covering companies, deals and strategy in Search rankings and algorithm updates, generative engine optimization at SERP Journal.

173 articles