Competition Data Observatory

Competition Data Observatory

Automated Data Observatory

Reprex

rOpenGov

Yes!Delft AI+Blockchain Validation Lab

Our Competition Data Observatory is a fully automated, open source, open data observatory that produces new indicators from open data sources and experimental big data sources, with authoritative copies and a modern API.

Our observatory is monitoring the certain segments of the European economy, and develops tools for computational antitrust in Europe. We take a critical SME-, intellectual property policy and competition policy point of view automation, robotization, and the AI revolution on the service-oriented European social market economy.

We would like to create early-warning, risk, economic effect, and impact indicators that can be used in scientific, business and policy contexts for professionals who are working on re-setting the European economy after a devastating pandemic and in the age of AI. We would like to map data between economic activities (NACE), antitrust markets, and sub-national, regional, metropolitian area data.

Get involved in services: our ongoing projects, team of contributors, open-source libraries and use our data for publications. See some use cases.

Follow news about us or the more comprehensive Data & Lyrics blog.

Contact us .

Download our competition presentation

Our Product/Market Fit was validated in the world’s 2nd ranked university-backed incubator program, the Yes!Delft AI Validation Lab.

Services

Automated Data Services

[Data](/services/data-curation/) [Curation](/services/data-curation/)Data sits everywhere and it is not easy to find even at home. Our curators know where to dig.
Data
Curation
Data sits everywhere and it is not easy to find even at home. Our curators know where to dig.
[Professional Data Processing](/data/open-gov/#is-there-value-left-in-open-data)Uncut diamonds need to be polished. Data is only potential information, raw and unprocessed.
Professional Data Processing
Uncut diamonds need to be polished. Data is only potential information, raw and unprocessed.
[Metadata: Documentation & Codebooks](/services/metadata/)Adding FAIR metadata exponentially increases the value of data. We use DataCite and SDMX statistical coding.
Metadata: Documentation & Codebooks
Adding FAIR metadata exponentially increases the value of data. We use DataCite and SDMX statistical coding.
[Data-as-Service](/services/data-as-service/)Reusable, easy-to-import, interoperable, always fresh data in tidy formats with a modern API.
Data-as-Service

Reusable, easy-to-import, interoperable, always fresh data in tidy formats with a modern API.
*
All Data Curation Data Processing Documentation & Codebooks Data-as-Service
Metadata
Adding metadata exponentially increases the value of data. Did somebody already adjust old data to conform to constantly changing geographic boundaries? What are some practical ways of combining satellite sensory data with my organization’s records? And do I have the right to do so? Metadata logs the history of data, providing instructions on how to reuse it, also setting the terms of use. We automate this labor-intensive process applying the FAIR data concept.
Follow Connect Code Documentation
Metadata
Data Curation
We create high value key business and policy evaluation indicators. Scientific proofs require the combination of correctly matching, formatting, and verifying controlled pieces of data. Our data comes from verified and legal sources, with information about use rights and a complete history. You can always take a look at the processing code, too. We do not deal in blood diamonds.
Follow Connect Get Inspired Documentation
Data Curation
Data Processing
We create high value key business and policy evaluation indicators. Scientific proofs require the combination of correctly matching, formatting, and verifying controlled pieces of data. Our data comes from verified and legal sources, with information about use rights and a complete history. You can always take a look at the processing code, too. We do not deal in blood diamonds.
Follow Connect Get Inspired Documentation
Data Processing
Data-as-Service
We provide our clients with simple datasets, databases, harmonized survey data, and various other rich data applications; we provide them with continuous access to high-quality, re-processed, re-usable public sector and scientific data.
Slides Follow Connect Try API Documentation
Data-as-Service

Recent Posts

Check out our more general Data & Lyrics blog.

stacodelists: use standard, language-independent variable codes to help international data interoperability and machine reuse in R
A new building block of our observatories went through code peer review and was released yesterday. The statcodelists R package aim to promote the reuse and exchange of statistical information and related metadata with making the internationally standardized SDMX code lists available for the R user.
Last updated on Jul 4, 2022 3 min read
stacodelists: use standard, language-independent variable codes to help international data interoperability and machine reuse in R
How We Add Value to Public Data With Better Curation And Documentation?
Many people ask if we can really add value to free data that can be downloaded from the Internet by anybody. We do not only work with easy-to-download data, but we know that free, public data usually requires a lot of work to become really valuable. To start with, it is not always easy to find.
Last updated on Nov 10, 2021 5 min read
How We Add Value to Public Data With Better Curation And Documentation?
How We Add Value to Public Data With Imputation and Forecasting
Public data sources are often plagued with missng values. Naively you may think that you can ignore them, but think twice: in most cases, missing data in a table is not missing information, but rather malformatted information which will destroy your beautiful visualization or stop your application from working. In this example we show how we increase the usable subset of a public dataset by 66.7%, rendering useful what would otherwise have been a deal-breaker in panel regressions or machine learning applications.
Last updated on Nov 10, 2021 7 min read
How We Add Value to Public Data With Imputation and Forecasting
The Data Sisyphus
Sisyphus was punished by being forced to roll an immense boulder up a hill only for it to roll down every time it neared the top, repeating this action for eternity. When was a file downloaded from the internet? What happened with it sense? Are their updates? Did the bibliographical reference was made for quotations? Missing values imputed? Currency translated? Who knows about it – who created a dataset, who contributed to it? Which is the final, checked, approved by a senior manager?
Last updated on Jul 8, 2021 7 min read
The Data Sisyphus
Including Indicators from Arab Barometer in Our Observatory
A new version of the retroharmonize R package – which is working with retrospective, ex post harmonization of survey data – was released yesterday after peer-review on CRAN. It allows us to compare opinion polling data from the Arab Barometer with the Eurobarometer and Afrorbarometer. This is the first version that is released in the rOpenGov community, a community of R package developers on open government data analytics and related topics.
Last updated on Jun 28, 2021 6 min read
Project
Including Indicators from Arab Barometer in Our Observatory
See all posts

Ongoing projects

See what we are doing, why we are doing it, and how you can contribute.

*
All Computational Antitrust Small & Medium Sized Enterprises
Competition
Mapping data between antitrust and economic activity markets
Competition
Small- and Medium Sized Enterprizes
Access to finance, activity, and regulatory hurdles indicators
Small- and Medium Sized Enterprizes
EU Datathon 2021
Reprex, a Dutch start-up enterprise formed to utilize open source software and open data, is looking for partners in an agile, open collaboration to win at least one of the three EU Datathon Prizes.
EU Datathon 2021

Data

API to our data, our sources, how we process and validate it, how we increase its quality.

.js-id-api
Data API Metadata Surveys Open Data Data Sharing
Survey Harmonization
Ex post survey harmonization is in a way a passive form of pooling research funding because you can utilize information from surveying that were made on somebody else’s expense. The aim of ex ante survey harmonization is to maximize the value from future retrospective harmonization; in a way, it is an active form of pooling research funding, because you benefit from money spent on related open governmental and open science survey programs.
Last updated on Jul 7, 2021
Follow Connect
Survey Harmonization
Data API
Get data from the Competition Data Observatory via our API
Last updated on Jul 11, 2021
Follow Connect Economy Data Observatory Try API
Metadata
Uncut diamonds need to be cut, polished, and you have to make sure that they come from a legal source.
Last updated on Jul 8, 2021
Metadata
Data Sharing
Data altruismm, sharing, and collaborative data resources.
Last updated on Jun 15, 2021
Follow
Open Data
Many countries in the world allow access to a vast array of information, such as documents under freedom of information requests, statistics, datasets. In the European Union, most taxpayer financed data in government administration, transport, or meteorology, for example, can be usually re-used. More and more scientific output is expected to be reviewable and reproducible, which implies open access.
Last updated on Jul 8, 2021
Follow Connect

Contributors of the Economy Data Observatory

Join our open collaboration team as a data curator, developer or business developer! More about contributing: Automated Observatory Contributors’ Handbook.

developers

Avatar

Andrés García Molina, PhD

Data Scientist

Avatar

Botond Vitos

Data scientists and developer

Avatar

Daniel Antal

Developer of open-source statistical software

Avatar

Kasia Kulma

Contributor, data science and software engineering

Avatar

Leo Lahti

rOpenGov coordinator

Avatar

Pyry Kantanen

R package testing and data curation.

data curators

Avatar

Daniel Antal

Developer of open-source statistical software

Avatar

Karel Volkaert

Economic policy data curator

Avatar

Peter Ormosi

Competition and innovation data curator

Avatar

Stephan Okhuijsen

Data visualization and dissemination

service development team

Avatar

Annette Wong

Contributor, digital strategist and product marketer

Avatar

Robin Nagy

Mentor, Contributor, Business Development

Avatar

Suzan Sidal

Business Case Development & Service Design

institutional partners

Avatar

Datagraver

Data dissemination partner

Avatar

rOpenGov

rOpenGov network

join us

Avatar

New Curators

Future curator

Avatar

New Developers

Future co-developer

Avatar

Observatory Business Associate

Future Team Member

Milestones

 
 
 
 
 
Economy Data Observatory
Reprex, rOpenGov and collaborators
May 2021 – Present the Hague, Netherlands
We launched the Economy Data Observatory to support Computational Antitrust and create new innovation and SME indicators.
 
 
 
 
 
Green Deal Open Collaboration
Reprex and collaborators
Mar 2021 – Present the Hague, Netherlands

International Open Data Day 2021:

  • We organized the only event in the Netherlands
  • Decided to start an open collaboration on music and climate change.
 
 
 
 
 
Trustworthy AI PPP
NLAIC + EU AI Alliance
Feb 2021 – Present the Netherlands
Joined the Dutch & the European AI PPPs.

Open-Source Software

Our peer-reviewed, open source statistical software packages

We believe that transparency is the key to the highest data quality. We use only open source software. We open up the critical elements of our software for peer-review.

  • We use open-source software, there is no vendor lock-in.

  • Our data products go through many, automated (unit) tests, replacing countless error-prone human validation working hours.

  • The critical elements of our code go through external validation and peer-review by computational statisticians and data scientists.

Quickly discover relevant content by filtering our software releases..
Last updated on Jul 7, 2021
retroharmonize R package for survey harmonization
retroharmonize R package for survey harmonization

The goal of retroharmonize is to facilitate retrospective (ex-post) harmonization of data, particularly survey data, in a reproducible manner.

Cite Slides DOI Code Documentation Follow Connect
Last updated on Jul 7, 2021
regions R package to create sub-national statistical indicators
regions R package to create sub-national statistical indicators

regions currently takes care of 20,000 sub-divisional boundary changes in Europe since 1999.

Cite Slides DOI Code Documentation Follow Connect
Last updated on Jul 7, 2021
iotables R package for working with symmetric input-output tables
iotables R package for working with symmetric input-output tables

The goal of iotables is to make allow a programmatic acces to the symmetric input-output tables of Eurostat. It creates multipliers, calculates direct, indirect and induced effects from European SIOT tables.

Cite Source Document Code Documentation Follow Connect

Open-Source Software

Our peer-reviewed, open source statistical software packages

Quickly discover relevant content by filtering our software releases..

Popular Topics

api Arab Barometer better documentation business case climate change mitigation climate-awareness climate-change data collection data-as-service metadata open government open-data open-science R reproducible research retrospective-harmonization service-design survey harmonization surveys trustworthy AI

Recent & Upcoming Talks

Conversations with users, contributors and volunteers.

Reprex Open Data Day 2021
Open Data Day 2021 focusing on environmental, sustainability and public spending data mapping.
Mar 6, 2021 3:30 PM — 5:00 PM Online
Follow
Reprex Open Data Day 2021

Contact

Recent Publications

Quickly discover relevant content by filtering publications.