Hacker News Scraper: Stories, Comments, Search & Who Is Hiring
Scrape Hacker News: front page, new, best, Ask HN, Show HN and job feeds, full-text search with date and points filters, full comment threads, and parsed Who is hiring? jobs (company, role, location, remote, salary). Official APIs, no login.
Pricing: $0.15 per 1,000 items, $1.00 per 1,000 parsed Who is hiring jobs, plus $0.0005 per run. No subscription: you pay per result.
What people use it for
- Tracking mentions of a product or topic on Hacker News
- Who is hiring? job datasets with company, role, location and salary
- Comment-thread datasets for research and NLP
Quick start (Python)
pip install "apify-client>=3"
from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("best_apis/hacker-news-scraper").call(run_input={
"mode": "search",
"searchQuery": "web scraping",
"sortBy": "date",
"maxItems": 20
})
for item in client.dataset(run.default_dataset_id).iterate_items():
print(item)
Quick start (cURL)
curl -X POST "https://api.apify.com/v2/acts/best_apis~hacker-news-scraper/run-sync-get-dataset-items?token=<YOUR_APIFY_TOKEN>" \
-H "Content-Type: application/json" -d '{"mode": "search", "searchQuery": "web scraping", "sortBy": "date", "maxItems": 20}'
FAQ
Does it need a login?
No. It uses Hacker News' official public APIs.
No. It uses Hacker News' official public APIs.
How are Who is hiring posts priced?
Parsed job posts are billed separately at $1 per 1,000; stories and comments are $0.15 per 1,000.
Parsed job posts are billed separately at $1 per 1,000; stories and comments are $0.15 per 1,000.
How do I get an API token?
Create a free Apify account, then copy your token from Settings > API & Integrations. New accounts include free monthly platform credit.
Create a free Apify account, then copy your token from Settings > API & Integrations. New accounts include free monthly platform credit.
Related
- ATS Jobs Feed
- Greenhouse, Lever & Ashby Jobs Scraper
- Walmart Scraper
- US Retail Price Scraper
- Federal Register API
- Steam Reviews Scraper
- App Store & Google Play Reviews Scraper
- Apple App Store Scraper
- Government Tenders Scraper
- Shopify & WooCommerce Products Scraper
- Website Tech Stack Detector
- Domain WHOIS Lookup
- RSS Feed Reader & Finder
- Wayback Machine Scraper
- Broken Link Checker