GitHub Archive

Open-source developers all over the world are working on millions of projects: writing code & documentation, fixing & submitting bugs, and so forth. GitHub Archive is a project to record the public GitHub timeline, archive it, and make it easily accessible for further analysis.

Looking for the daily top new & watched repository reports? Sign up here.

GitHub provides 18 event types, which range from new commits and fork events, to opening new tickets, commenting, and adding members to a project. The activity is aggregated in hourly archives, which you can access with any HTTP client:

Query Command
Activity for April 11, 2012, 3PM UTC wget
Activity for April 11, 2012 wget{0..23}.json.gz
Activity for April 2012 wget{01..31}-{0..23}.json.gz

Note: timeline data is available starting February 12, 2011.

Each archive contains a stream of JSON encoded GitHub events (sample), which you can process in any language. Ruby example:

Note: example script to import data into SQLite db

GitHub Archive dataset is also available via Google BigQuery. The JSON data is normalized and is updated every hour, allowing you to run arbitrary queries and analysis over the entire dataset in seconds. To get started, login into the BigQuery console (, and add the project (name: "githubarchive"), or take a look at the 03/11..05/11 snapshot of the data under "publicdata:samples":

An example query, for more check the repository readme: