Wayback Machine Scraper: Snapshots, Archived URLs & History
Get Internet Archive Wayback Machine snapshots of any page, every archived URL of a domain, or the capture closest to a date, with optional archived page text. Date, status, MIME and change filters.
Pricing: $0.30 per 1,000 snapshots, $1.00 per 1,000 archived page texts, plus $0.0005 per run. No subscription: you pay per result.
What people use it for
- Website change history and SEO archaeology
- Recovering every archived URL of a domain
- Finding the capture closest to a date for compliance or research
Quick start (Python)
pip install "apify-client>=3"
from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("best_apis/wayback-machine-scraper").call(run_input={
"urls": [
"https://www.apple.com/iphone/"
],
"mode": "snapshots",
"frequency": "year",
"statusCodes": [
"200"
],
"maxResultsPerUrl": 30
})
for item in client.dataset(run.default_dataset_id).iterate_items():
print(item)
Quick start (cURL)
curl -X POST "https://api.apify.com/v2/acts/best_apis~wayback-machine-scraper/run-sync-get-dataset-items?token=<YOUR_APIFY_TOKEN>" \
-H "Content-Type: application/json" -d '{"urls": ["https://www.apple.com/iphone/"], "mode": "snapshots", "frequency": "year", "statusCodes": ["200"], "maxResultsPerUrl": 30}'
FAQ
Where does the data come from?
The Internet Archive's public Wayback Machine CDX and snapshot endpoints.
The Internet Archive's public Wayback Machine CDX and snapshot endpoints.
Can I get page text?
Yes, enable archived page text; it is billed at $1 per 1,000 pages.
Yes, enable archived page text; it is billed at $1 per 1,000 pages.
How do I get an API token?
Create a free Apify account, then copy your token from Settings > API & Integrations. New accounts include free monthly platform credit.
Create a free Apify account, then copy your token from Settings > API & Integrations. New accounts include free monthly platform credit.
Related
- ATS Jobs Feed
- Greenhouse, Lever & Ashby Jobs Scraper
- Walmart Scraper
- US Retail Price Scraper
- Federal Register API
- Steam Reviews Scraper
- App Store & Google Play Reviews Scraper
- Apple App Store Scraper
- Government Tenders Scraper
- Shopify & WooCommerce Products Scraper
- Website Tech Stack Detector
- Domain WHOIS Lookup
- Hacker News Scraper
- RSS Feed Reader & Finder
- Broken Link Checker