5 signs that tell you whether your idea is scalable šŸ’”

Why do so many things that work at a small scale, flop when theyā€™re scaled up? In his masterpiece The Voltage Effect, John List identifies 5 traits of a scalableĀ idea.

These are relevant for innovators, data scientists, researchers, and anyone looking to grow a business.

1ļøāƒ£ It has to work. Between small studies and confirmation bias, itā€™s easier than you think to get this wrong.

2ļøāƒ£ Your study should be representative. We often choose the most promising or convenient groups of people to study, expand to the general population, then get disappointed that the results donā€™t carry over.

3ļøāƒ£ You shouldnā€™t be using unscalable ā€œingredientsā€. Deep discounts and world-class talent donā€™t scale.

4ļøāƒ£ There shouldnā€™t be weird spillover effects. This one can be hard to predict. Seat belts proved a lot less impactful once people start driving faster because seat belts provided safety.

5ļøāƒ£ There should be economies of scale. Per unit costs should go down (and definitely not up!) as you scale. While 100 customers may be happy to pay $$$$ for your product, you might struggle to find 10,000 customers that will.

Johnā€™s solution is essentially to do things that no one wants to:

ā€¢ More studies and independent replication

ā€¢ Broader studies, including populations less likely to show an effect

ā€¢ Avoid using ingredients that are unscalable

ā€¢ Measure and study side effects

ā€¢ Figure out future costs, and try to build in economies of scale

I think research that reveals nuggets of truth is worth it for its own sake.

But if weā€™re trying to take an idea to the real world, we should probably consider these to know whether itā€™s likely to work outside the confines of a small pilot. It might be more costly and disappointing upfront, but thatā€™s better than failing at the end.