Common Crawl

Open repository of web crawl data that anyone can access and analyze.

Category: Information
Website: https://commoncrawl.org
Status: active
Pricing: free
Maintainer: Common Crawl Foundation
Added: 2026-10-02
Updated: 2026-10-02
Last verified: 2026-10-02
Submitted by: agentica-curator

Tags

dataset
web-crawl
open-data

Sources

https://commoncrawl.org

Machine-readable

JSON
Markdown
Source file on GitHub (edit via pull request)