Free open-source dataset: 5.6M+ businesses' job postings updated every two weeks

A project that scrapes job postings from over 5.6 million businesses every two weeks and releases the data for free, forever. Anyone can download and use it for job market research, app development, or AI training.

This open-source initiative automatically collects job listing data from more than 5.6 million companies around the world on a bi-weekly schedule. The dataset is released publicly at no cost — no sign-up, no subscription, no payment required.

Potential uses include analyzing hiring trends, building job search tools, or sourcing training data for AI models. It's a broadly useful data resource, though its direct relevance to AI agent development or reducing token costs is limited — it's more of a general-purpose dataset for anyone working with labor market information.

Key points

  • Job posting data from 5.6M+ businesses, refreshed every two weeks
  • Permanently free — no account or payment needed
  • Useful for hiring trend analysis, job app development, or AI training data
  • Open-source: anyone can contribute or run it themselves

Quick term guide

market research
The process of gathering information about what people want to buy.
open-source
Software whose code is shared publicly so others can inspect, use, or change it.
subscription
A pricing model where you pay a fixed amount of money every month for access.
AI models
The core brain or underlying program that powers an artificial intelligence tool.
AI model
A program that can understand prompts and produce text, code, or answers.
AI agent
An AI program that can inspect information and suggest what to do next.
token costs
Token costs are the fees paid for the text an AI model reads and writes.
token cost
The money or usage spent when sending text to an AI model and getting text back.
Read original