Using prediction markets to forecast research evaluations

View/ Open
Author
Munafo, Marcus R.
Pfeiffer, Thomas
Altmejd, Adam
Heikensten, Emma
Almenberg, Johan
Bird, Alexander
Wilson, Brad
Johannesson, Magnus
Dreber, Anna
Published Version
https://doi.org/10.1098/rsos.150287Metadata
Show full item recordCitation
Munafo, Marcus R., Thomas Pfeiffer, Adam Altmejd, Emma Heikensten, Johan Almenberg, Alexander Bird, Yiling Chen, Brad Wilson, Magnus Johannesson, and Anna Dreber. 2015. “Using prediction markets to forecast research evaluations.” Royal Society Open Science 2 (10): 150287. doi:10.1098/rsos.150287. http://dx.doi.org/10.1098/rsos.150287.Abstract
The 2014 Research Excellence Framework (REF2014) was conducted to assess the quality of research carried out at higher education institutions in the UK over a 6 year period. However, the process was criticized for being expensive and bureaucratic, and it was argued that similar information could be obtained more simply from various existing metrics. We were interested in whether a prediction market on the outcome of REF2014 for 33 chemistry departments in the UK would provide information similar to that obtained during the REF2014 process. Prediction markets have become increasingly popular as a means of capturing what is colloquially known as the ‘wisdom of crowds’, and enable individuals to trade ‘bets’ on whether a specific outcome will occur or not. These have been shown to be successful at predicting various outcomes in a number of domains (e.g. sport, entertainment and politics), but have rarely been tested against outcomes based on expert judgements such as those that formed the basis of REF2014.Other Sources
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4632515/pdf/Terms of Use
This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAACitable link to this page
http://nrs.harvard.edu/urn-3:HUL.InstRepos:23845346
Collections
- FAS Scholarly Articles [17845]
Contact administrator regarding this item (to report mistakes or request changes)