EP34: Don't Freak Out About Quantitative Results

Episode 31 December 13, 2023 00:30:08
EP34: Don't Freak Out About Quantitative Results
In Demand: How to Grow Your SaaS to $1M ARR and Beyond
EP34: Don't Freak Out About Quantitative Results

Dec 13 2023 | 00:30:08


Show Notes

When you're in the early stages of building a business, you need to move quickly. But when you're testing growth channels, there is a difference between moving quickly and freaking out.


In this episode of the InDemand podcast, host Asia Orangio, founder of DemandMaven, uncovers the pitfalls that teams can fall into when reacting to quantitative results.


She covers the mistakes that founders make when reacting to experiments and how to set yourself up for success when running tests and reacting to the results.



0:22 - Don't freak out about bad numbers. Early technical founders have a tendency to overreact to test data from marketing and growth campaigns. But in growth you're working with humans, not code, and you can't always trust immediate results.

4:35 - A one to two week experiment with low spend on a growth channel likely won't show you a clear result. If you react to it you might be missing a big opportunity.

8:00 - A company Asia worked with was testing out a video demo option. After one week and getting two requests for the video the team was resigned to the fact that it wasn't working, but after waiting it turned out that having the video was actually increasing the number of prospects entering the pipeline.

12:45 - You always have to remember that quantitative outputs can tell you 'what', but can't tell you 'why'. Before you react, you have to pause and dig deeper to understand what is driving the numbers.

20:07 - When you're running a test, the sample size matters. You need a large enough volume of results to be able to trust the results. There is a natural variance in the results you get and if you end an experiment early you might just be seeing variance. 

Other Episodes

Episode 11

October 26, 2020 00:27:42
Episode Cover

EP11: Why Every Founder Needs a Market Vision

We all start our businesses for different reasons. For some, it is a personal pain point--a problem that we want to solve for ourselves....


Episode 2

April 30, 2020 00:36:49
Episode Cover

EP2: The PERFECT Time for Marketing

When it comes to early-stage SaaS founders trying to grow their businesses, there's a perfect time for marketing and there's less ideal times for...


Episode 8

June 18, 2020 00:27:53
Episode Cover

EP8: The Biggest Growth Lessons I’ve Learned (the Hard Way)

Some lessons in marketing are easy to learn. You pick them up from a book, take a class, or hear a talk and get...