BeLibre LibreChecker: API and datasets

API and datasets

The data of this map can be read by anyone, without a key, from . Each read-only GET request names one or more queries in q (comma-separated, at most 12) and the parameters they need. The answer is JSON: per query a list of rows, each row a list of values (no column names; null is no value). Answers may be up to five minutes old. Send a User-Agent naming your project: the default one of some HTTP libraries is refused.

Parameters

country: a country code (BE, NL, …) or the code of a map or list of institutions, as in the datasets below.
before: a month, YYYY-MM; the snapshot queries use each municipality's latest scan before it.
name, municipality, domain, scan: a municipality's name or id, a domain id, a scan id, as the other queries return them.

Main queries

Query	Parameters	Row
`countries`		code, name, municipalities with a scan, unit (none for a country)
`lists`		code, name, institutions with a scan, unit; the lists without a map
`months`	country	months with scans
`snapshot_municipalities`	country, before	code, municipality id, name, population, scan id of the latest scan, domain
`snapshot_classified`	country, before	scan id, mail provider, mail category, confidence, rule, gateway provider, scan date
`snapshot_mx`	country, before	scan id, MX host
`snapshot_spf`	country, before	scan id, SPF include
`snapshot_providers`	country, before	scan id, provider, tech giant (0/1), region, service, mail category
`snapshot_hosting`	country, before	scan id, country and region of the web server, its IP address
`snapshot_dns`	country, before	scan id, region and country of a name server, its IP address
`detail_municipality`	name	municipality id, name, country, population, domain id, domain
`detail_scan`	domain	the domain's latest scan id, its time
`detail_municipality_scan`	municipality, before	the municipality's latest scan up to the month: scan id, its time, the domain
`detail_mail`	scan	mail provider, tech giant, region, mail category, its label and colour, confidence, rule, gateway
`mail_categories`		key, label, colour, group, order

The snapshot queries all give the scan id first, so their rows join on it. For a history, ask once per month of months. All queries, with their SQL and parameters, are in queries.json. When you publish results, cite this site and the sources of the lists.

Download as CSV

The export queries give one row per municipality or institution, with named columns, as a CSV file: format=csv with one of export_mail, export_hosting, export_collab or export_web. Several values in a cell are separated by ; .

Datasets

Loading…