Question Page

How do you identify which experiments to prioritize first?

Willie Tran
Willie Tran
Dropbox Group Product Manager, DocSend Growth | Formerly Mailchimp, CalendlySeptember 21

I mentally use the ICE (Impact, Confidence, Ease) framework when prioritizing experiments. Impact = How many people does this affect? Confidence = How sure are you that this will work? Ease = How easy is it to implement?

Impact and Ease are pretty simple to calculate. However, I find that most people don't know how to accurately assess "Confidence." This is likely because your ideation strategy consists mainly of throwing things at the wall and seeing what sticks. Or just working off of best practices. This strategy works well for the first six months to a year of an experimentation strategy, but falls short after you've picked up all the low hanging fruit. 

Instead, you want to create a higher level process that's focused on generating high level user problem statements. You create these problem statements by doing a lot of user research around why users are not doing the thing you want them to do (e.g. Activate). Once you do your set of interviews seeking to answer a few questions, you should have some good idea as to why people are Activating (in this case). Turn those into well written problem statements (As a [user type], I want to [do a thing], but [reason why I can't]). 

Then for each problem statement, do an ideation session with your team where you and your xfn partners come together and come up with ideas on how to solve this problem. Then vote on it. You'll see a lot of ideas have common themes which will give your designer a lot of material to come up with the best way to address said problem. 

TL;DR - Do a lot of user research to understand the problem. If you understand the problem really well, then it's very easy to come up with solutions you have a lot of confidence in.

...Read More
1736 Views
Nicolas Liatti
Nicolas Liatti
Adobe Senior Director of Product Management, 3D CategoryDecember 7

Product management is all about reducing risks and blurriness on the value and viability of the product.

So I would say start from the user, move backwards and chose the area where you have the biggest unknown. Make an experiment there so it helps reduce the risks.

...Read More
389 Views
Top Product Management Mentors
Poorvi Shrivastav
Poorvi Shrivastav
Meta Senior Director of Product Management
Anton Kravchenko
Anton Kravchenko
Carta Sr. Director of Product Management
Krishna Panicker
Krishna Panicker
Airbase VP Product
Natalia Baryshnikova
Natalia Baryshnikova
Atlassian Head of Product, Enterprise Agility
Marion Nammack
Marion Nammack
Braze Director of Product Management
Ajay Waghray
Ajay Waghray
Udemy Director of Product Management, Consumer Marketplace
Tom Alterman
Tom Alterman
Notable Head of Product
Lizzy Masotta
Lizzy Masotta
Shopify Senior Product Lead
Boris Logvinsky
Boris Logvinsky
Vanta VP Product
Jacqueline Porter
Jacqueline Porter
GitLab Director of Product Management