The Right Screen Wasn’t Enough. Users Needed the Right Location.
Seven first-time user sessions revealed why reaching a key screen wasn’t enough to make the product’s value clear. Users needed information for somewhere they actually fished, and a confusing location control could prevent them from finding it.
The study also uncovered a separate question: could users recognize a reason to pay?
Disclosure: This case study describes one anonymized client engagement. The company’s identity is withheld. Participant reactions are paraphrased rather than presented as verbatim quotations.
The Study at a Glance
- Participants
- Seven saltwater anglers, including hobbyists and commercial fishermen.
- Method
- Moderated, 30-minute sessions with people who had never used the app.
- Focus
- What helped users discover value, and what could cause them to leave.
The Challenge: Analytics Showed Where, but Not Why
A consumer weather and fishing app was attracting thousands of new signups each day. Its analytics showed that users who reached a particular screen were significantly more likely to adopt the product.
Yet among users who reached that screen, roughly half adopted and half didn’t.
The team had tried speaking with users. Successful users offered broad praise that didn’t explain what made the product useful. Those who didn’t adopt rarely responded. Even with a researcher on staff, consistently recruiting people for live sessions proved difficult.
The team knew where something important was happening. It needed to understand what separated discovery from frustration.
How We Studied It
We recruited seven people who matched the app’s target customer profile but had never used it.
Each session began with a short conversation about their fishing routines, existing tools, and weather-planning needs. Participants then shared their screens, downloaded the app, and began using it while thinking aloud.
We gave as little direction as possible, observing what they discovered independently. When we later helped someone find a feature, we distinguished that assisted experience from their initial experience.
We focused on two things: moments when the product’s value became clear, and barriers that could cause someone to leave.
Finding 1: Relevant Information Made the Value Visible
The screen highlighted by the analytics mattered, but its usefulness depended on the location it displayed.
When participants saw conditions for somewhere they actually fished, they understood how the app could help them. When the location was unfamiliar or irrelevant, that connection was missing.
Some tried to change locations using an interface element that appeared to serve that purpose but actually did something else. This caused significant frustration for two of the seven participants. One said they would ordinarily leave the app at that point.
We then showed that participant how to change locations. Once they saw conditions for a familiar fishing location, the product’s usefulness became clear.
A usability barrier was keeping a participant from discovering the value already available in the product.
Finding 2: Five of Seven Described the Same Core Benefit
Before trying the app, participants described a fragmented planning routine. They checked one source for weather, another for wind, another for tides, and others for fishing-specific information.
When they reached the key screen with a relevant location selected, five of seven independently expressed a similar benefit:
Everything I need in one place.
Shared participant sentiment, paraphrased.
The value they described went beyond better weather information. The app brought several parts of their planning routine together in one place to check before going fishing.
That gave Product and Marketing a clearer understanding of the benefit customers recognized, and the experience onboarding needed to help them discover.
Finding 3: The Paid Plan’s Value Wasn’t Apparent
The sessions also surfaced a separate conversion question.
Participants initially used a free trial of the paid plan. Near the end of each session, we moved them to the permanently free version without announcing the change.
None of the seven noticed.
After we explained the switch, participants still struggled to identify meaningful differences. All seven said they would continue with the free plan.
What we observed: The paid plan’s additional value was not apparent during the activities participants completed.
What this suggested: The free plan may have met the needs they recognized at that stage.
What needed further investigation: Which paid benefits would matter to these users, and when would they encounter a reason to upgrade?
The company’s analytics already showed that users who moved to the permanently free product were extremely unlikely to upgrade. These sessions provided a direction for investigating that pattern, rather than a definitive explanation of paid conversion.
What the Team Could Test Next
The research sharpened the onboarding objective:
Help users reach relevant information for their fishing location as quickly as possible.
It also identified a specific interface problem and a separate question about upgrade motivation.
| Recommended direction | What to test |
|---|---|
| Recommended directionAsk users to select their fishing location during onboarding, then open the key screen with relevant conditions | What to testWhether this helps users recognize the app’s value sooner |
| Recommended directionClarify the location control | What to testWhether first-time users can change locations without assistance |
| Recommended directionInvestigate expectations of Free and Paid | What to testWhich additional benefits users recognize and consider worth paying for |
These were recommendations grounded in observed behavior. Further testing would be needed to establish their effect on adoption and paid conversion.
The Evidence Behind the Findings
A Quality Insights study gives the team prioritized findings and recommendations, supported by video clips, full session recordings, and raw research notes.
That means Product, Design, and Marketing can examine the moments behind a recommendation and use the evidence in their next decisions.
What Are Your New Users Missing?
If your analytics show where users leave but don’t explain what they expected, misunderstood, or failed to discover, we can help.
We recruit people from your target audience, watch them use your product for the first time, and identify what deserves attention next.