Cloudflare pilot helps ChatGPT Search find more web pages

Cloudflare and OpenAI say a research pilot helped OpenAI discover and index hundreds of millions of new web pages. The early results were reported by Search Engine Journal, based on a Cloudflare blog post published on October 15, 2026.

The pilot used a participating group representing about 1% of Cloudflare’s total network. According to the report, the companies said OpenAI can use Cloudflare network signals to help its search crawler find pages that may be useful, including pages that might not attract many links from other sites.

What changed

Cloudflare said its signals can help OpenAI find pages such as product guides, current passport information, and local business details like menus and hours. The July 8 announcement said the signals may include how recently a page changed, the quality of traffic to a website, and what updates were made to a page. The source also said this information comes from participating websites, but it did not identify the participants.

The October 15 post also said the signals can help OpenAI avoid unnecessary crawling. Examples included repeated requests for missing files, redirects that send many addresses to a homepage, and duplicate content. The companies are also testing signals that may help flag harmful pages, such as a fake login page placed on one part of a legitimate site, without treating the whole domain the same way.

What it means for your website

For business owners, this means ChatGPT Search may be able to find more useful pages on websites, including pages that are important to customers but are not heavily linked from other sites. Once a page is in OpenAI’s index, ChatGPT has another source it can use when generating search results. Still, the companies said OpenAI evaluates and ranks indexed pages independently, so being found does not mean your page will be cited.

The report also noted that discovery and access are separate issues. As Cloudflare’s post put it, “doesn’t grant permission to access it.” Your crawler settings still control whether OpenAI’s bots can crawl your site. If OAI-SearchBot is blocked, the site will not be included in ChatGPT search results, although blocked sites may still appear as navigational links.

What to do now

• Review your robots.txt settings and confirm whether OAI-SearchBot is allowed or blocked.
• If you want search visibility in ChatGPT but do not want training use, check the separate settings for OAI-SearchBot and GPTBot.
• Look at server logs or Cloudflare AI Crawl Control to see whether OpenAI crawlers are visiting your site.
• Monitor important pages that are frequently updated, such as service details, location pages, hours, menus, fees, or help content.
• Watch for changes in crawling, because the source said finding new pages can initially increase crawl activity.