I Ignored the Data and Launched Anyway. Here's When That's Actually the Right Call.
The moment I stopped trusting the dashboard
We had just shipped our core AI linking product at Sonic Linker. Three months in, tight timeline, scrappy team. I set up basic analytics and started watching user behavior like a hawk.
The data was screaming one thing: people kept clicking on "Integrations" in the nav. They'd open the page, see we only had 4 platforms connected, and bounce. The feature request board was full of "Add Slack integration" and "Need Notion support."
Every PM playbook I'd read said: listen to the data. Build what users are asking for. So I started scoping out an integrations sprint.
But something felt off.
I'd been in customer calls all week. And when I asked people what they actually cared about, nobody led with integrations. They talked about speed. They complained that our competitor took 6 seconds to generate a link. Ours took 3, but they wanted it faster. They wanted real-time updates. They wanted the tool to feel instant.
The quantitative data said integrations. The qualitative signal said speed.
I chose speed. We optimized our AI pipeline, cut response time to under 2 seconds, added live progress indicators. Retention went up 40% in the next month. Integration requests dropped because people were too busy actually using the product.
When data is a lagging indicator of the wrong problem
Here's what I learned: people click on what's broken, not what they want most.
At Finvestfx, I managed 20+ enterprise clients in the forex space. Our analytics showed that CFOs were spending tons of time in the "Reports" section. Heatmaps, session recordings, the whole nine yards. They were clicking everywhere, exporting PDFs, trying different filters.
The obvious read: they love reports, let's build more report types.
But when I sat with a CFO at a mid-sized manufacturing company, he said something that stuck with me: "I hate this section. I spend 30 minutes here every week trying to find one number for my board deck."
He wasn't engaged. He was stuck.
We rebuilt the reports page with a single search bar and smart defaults. Time spent in that section dropped 60%. Our NPS went up. Less engagement was actually the win.
Data tells you what happened. Your gut, if you've done the work, tells you why it happened.
The checklist I use now
I don't ignore data. But I don't worship it either. Here's my mental model for when to trust which signal:
Trust the data when: - You're optimizing something that already works (conversion funnels, onboarding flows) - The sample size is big enough to matter (I wrote about A/B testing with 500 users before, but even then you need statistical honesty) - User behavior and user feedback align - You're measuring outcomes, not just activity
Trust your gut when: - You're deciding what to build next, not how to improve what exists - The data is thin or contradictory (early-stage products, new markets) - Users are telling you one thing but their behavior suggests another - You've done enough discovery that your gut is actually informed intuition, not just bias
At NJ Group, I coached 60 insurance advisors and IFAs on product adoption. I had zero analytics. No dashboards, no heatmaps. Just WhatsApp messages and phone calls. But I could tell you exactly which features would stick and which wouldn't because I'd spent hours hearing how they actually worked.
That's informed intuition. It's not magic. It's pattern recognition from talking to users so much that you start thinking like them.
The real trick: knowing which mode you're in
The hard part isn't choosing between data and gut. It's knowing which phase you're in.
When we were at Sonic Linker in month one, I trusted my gut because we had no data. By month three, I had enough signal to start testing hypotheses. By month six, I could run experiments and let the numbers guide incremental improvements.
But every time we considered a big pivot or a new feature area, I went back to gut mode. I'd ignore the dashboard and go talk to 10 users. I'd ask open-ended questions. I'd watch them work.
Then I'd come back and use data to validate, not decide.
What I'd tell a PM struggling with this
If your data and your gut are misaligned, you don't have a data problem. You have a discovery problem.
Go talk to more users. Not to validate what you think. Just to understand what's actually happening in their world. Do that enough and your gut becomes a shortcut for patterns the data can't see yet.
And if you're early-stage and you don't have data? Good. That's not a weakness. Build the thing, ship it, talk to people. Your advantage is speed and intuition. Use it.
Data is a tool. Your judgment is the skill. Don't confuse the two.