
For three decades years, software makers have paid bug bounty hunters to break their code so they can make it more secure. Recently, some software companies have decided that bug bounties programmes aren't useful any more: Curl shut its bounty in January, and Intel suspended its own in September. And the discovery of the PHP flaw that sent websites offline in October came from researchers working with AI, not from a bounty hunter's report.Tobias Kretschmer (Imperial College London, CEPR) and his co-authors followed 86 programmes on Bugcrowd to discover how they work best. Do you run closed programmes, open only to invited hackers, or open them to all comers? And what happens now that AI is making a bug report cheaper to produce? Tim Phillips asks Kretschmer how well bug bounties are working.The research behind this episode:Zrahia, Aviram, Sarit Markovich, and Tobias Kretschmer. 2026. "Platform Openness: Evidence from Bug Bounty Programs." CEPR Discussion Paper 21970 (gated).To cite this episode:Phillips, Tim, and Tobias Kretschmer. 2026. "How well do bug bounties work?" VoxTalks Economics (podcast).About the guestTobias Kretschmer is Professor of Strategy, Technology and Organisation at Imperial College Business School and a Research Fellow at the Centre for Economic Policy Research. He joined Imperial in 2025 from LMU Munich. His research spans competitive strategy in digital industries, platform markets, and the digital transformation of organisations.Research cited in this episodeBug bounties. Netscape launched the first technology bug bounty on 10 October 1995, offering rewards for flaws found in the Navigator 2.0 beta. Jarrett Ridlinghafer, a technical support engineer, proposed the idea after he saw enthusiasts finding bugs for free. In this paper's data, the average reward for a unique vulnerability is about $566 in private programmes and $209 in public ones. High-priority flaws average about $1,440.Bugcrowd connects organisations with independent security researchers. It gave the authors anonymised records of more than 480,000 submissions to 2,483 programmes, from mid-2012 to mid-2021. The data predates the widespread use of AI-generated submissions, so the paper measures the effect of openness, not the effect of AI. The authors argue that AI sharpens the same problem.Triage. Each submission is classified as rejected, duplicate, or unique. A unique report identifies a flaw nobody has reported before. Only the first valid report generally earns a reward, so a duplicate can be good work that arrived late. It must still be reviewed.Wisdom of the crowd. Francis Galton's "Vox Populi" (Nature, 1907) reported that the median of about 800 guesses at an ox's dressed weight, made at a Plymouth livestock show, was remarkably close to the true figure. Eric Raymond gave software its version in "The Cathedral and the Bazaar": "given enough eyeballs, all bugs are shallow". Maillart and co-authors tested that idea on bug bounties in 2017. Kretschmer's point is that real attackers differ in their objectives and methods; a varied crowd resembles them more closely than one employee can.Open and closed programmes. Anyone can join a public programme; a private one is by invitation. Bugcrowd and many other bounty platforms leave that choice to the software company rather than setting one rule for all. Many other platforms keep far tighter control, which makes this the governance decision worth studying. Kretschmer and co-authors set out the wider argument about platforms as organisations in 2022. Among programmes that never switched, public ones were 7.6% of programmes but drew about half of all submissions. Private ones accounted for about 59% of unique discoveries and nearly 80% of dollar rewards.Comparing like with like. Firms choose their regime deliberately, so comparing open with closed programmes misleads. The authors focus on the 86 programmes that switched once from private to public, and compare them with programmes that stayed private. The main estimates are about 23 more submissions a week, nearly six more unique vulnerabilities, 10 more new researchers, and seven more duplicates. An alternative estimator built fo
Podzilla Summary coming soon
Sign up to get notified when the full AI-powered summary is ready.
Free forever for up to 3 podcasts. No credit card required.

S9 Ep63: Inflation and the polarisation of reality

S9 Ep61: Cooperatives in the 21st century

S9 Ep60: The challenges to the international financial system

S9 Ep59: Life after divorce
Free AI-powered recaps of VoxTalks Economics and your other favorite podcasts, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.