# AI Agent Page-Type Statistics

Version 1.0.0. September 2026.

Aggregate statistics from a page-type database that covers 40,786,727 domains. For each domain, the database records which kinds of page it has, such as login, pricing, documentation or careers pages, and their verified URLs. AI agents that browse the web act on exactly these pages: they read documentation and pricing pages, but they also reach login, signup, upload and checkout pages. Knowing which page types exist, and how common they are, is the basis for [page-level egress control for AI agents](https://www.aiagentallowlist.com/page-types-database.php).

It is published by AI Agent Allow List, a [zero trust AI agent](https://www.aiagentallowlist.com/) policy service. The database itself is commercial; this release contains **only aggregate counts and shares: no domains and no URLs**.

## At a glance

| Measure | Value |
|---|---:|
| Domains covered | 40,786,727 |
| Domains with at least one verified page type | 16,448,576 (40.3%) |
| Page types | 20 |
| Mean page types per domain (domains with at least one) | 3.61 |
| Most common page type | contact (70.4% of domains with page types) |
| Domains with a verified login page | 3,257,119 (19.8% of domains with page types) |
| Site languages covered | 40 |

## Files

| File | Content |
|---|---|
| `page-type-prevalence.csv` | 20 rows: domains with a verified URL for each page type, and shares |
| `page-types-per-domain.csv` | How many page types each domain has (0 to 19) |
| `languages.csv` | 40 rows: domains per site language |
| `language-page-types.csv` | Page-type prevalence for the 12 largest languages (20 page types each) |
| `page-type-cooccurrence.csv` | How often two page types occur on the same domain |
| `host-list-categories.csv` | The categories of the separate host list (cloud consoles, metadata endpoints, package registries, paste sites...) with default action and number of hosts |
| `DATA_DICTIONARY.md` | Every column explained |
| `CITATION.txt`, `LICENSE.txt`, `CHANGELOG.md` | Citation, licence and version history |
| `manifest.json`, `SHA256SUMS` | File sizes and checksums |

## Method

Page types were identified by a machine-learning pipeline that assigns URLs on each domain to a fixed set of 20 page types; quality was checked on a manually labelled sample. A page type counts for a domain when at least one verified URL of that type was found. Language is the detected main language of the site. The commercial database also tracks further page types, for example signup, cart, checkout and upload pages; those are not part of this release.

## Who this is for

- **Agent-security and AI-safety researchers** designing egress policies for autonomous agents.
- **Web-measurement researchers** studying how sites are structured across languages.
- **Security teams** estimating how much of the web exposes login, signup or upload pages to agents.

## Limitations

- Counts describe the database at one point in time (September 2026), not the live web.
- A missing page type means no verified URL was found, not that the site certainly lacks the page.
- Page-type labels come from an automatic classifier and contain errors.

## Citation

Alpha Quantum (2026). *AI Agent Page-Type Statistics* (Version 1.0.0). AI Agent Allow List. https://www.aiagentallowlist.com/ai-agent-page-types-dataset.php

## Licence

Creative Commons Attribution 4.0 International (CC BY 4.0). See `LICENSE.txt`.