OK, let’s see the evidence for that assertion.
Using prediction markets to estimate the reproducibility of scientific research - PMC
There’s one.
But obviously it’s not a guarantee if you don’t know what you’re doing. We also have documentation on where these methods fall short, such as when it’s based on exponential growth, rare events, or something else that humans are bad at understanding. Infectious Disease Forecasting.
But again, good statisticians are prepared to address those things.
And you have no idea of the mechanisms that shape that market.
That’s even better. If I don’t understand the mechanisms shaping the market, I won’t be able to correctly identify predictive variables for my model. In that case, I would be better off trusting the prediction market.
Obviously it would be better if the person building the model understood the mechanisms… but that takes time and money. If you’re managing 30 models, that might not be worth it.






Apes of the Nation.