Benchmarking

Benchmarking is about creating a system in which various ways or approaches to address the same task can be compared, in order to be able to analyse the strengths and weaknesses of various modelling approaches and gain new insights. In the social sciences, benchmarking can help establish which methods and models are most suitable to answer specific research questions.

PreFer benchmarking challenge

The aim of the challenge is to measure the current predictability of fertility outcomes in the Netherlands to advance our understanding of fertility.

Why predict fertility outcomes in a data challenge?

Fertility is widely studied in diverse disciplines due to its importance to individuals and societies. A lot of factors related to fertility outcomes have been identified. Yet these important factors only explain a fraction of the variation in fertility outcomes and we are unable to explain even their short-term changes. What do we miss?

This data challenge can potentially advance our understanding of fertility behavior and improve social policies and family planning in several ways. Measuring how well different factors and models can predict fertility outcomes for new cases will show which factors are more important. It can narrow down the scope for potential interventions and help people reach their desired family size. Comparing and interpreting different models submitted to a data challenge (e.g. theory- and data-driven) can identify new factors currently overlooked by the theories of fertility and highlight the gaps in current knowledge (e.g. important interactions or non-linear effects).