The role of knowledge users in public-private research programs: An evaluation challenge

Many contemporary science systems are witnessing the rise of public-private research programs that aim to build capacity for research and innovation in strategic areas. These programs create a significant policy challenge: how to select-based on ex ante evaluations-a consortium that will carry out public-private research activities that will contribute to the overall policy goal of capacity-building in the science and innovation system? And how to make sure that knowledge users are involved in the research program in a meaningful way? The aim of this article is to explore the possibilities for ex ante evaluation of public-private research programs in a systematic comparison of 37 Dutch programs funded by the 'Investment Grants for Knowledge Infrastructure' (Besluit Subsidies Investeringen Kennisinfrastructuur) in 2004. Our research question is as follows: to what extent can involvement and commitment of knowledge users in the stage of drawing up the program proposal serve as a predictor of their later involvement and financial contribution? Using available archival data on the programs, we show that on average there is a close association between user involvement in the proposals of public-private research consortia and their eventual involvement during the implementation, but that there are substantial differences between plans and implementation in individual cases. Our analysis suggests that selecting consortia for funding based on their program proposals is possible and legitimate, but that strict rules are necessary to safeguard the financial contributions of knowledge users.