For a long time, UX teams treated A/B testing as the only legitimate way to make causal claims. If you could not randomize users, you reported trends, correlations, or anecdotes and hoped stakeholders understood the limits. That mental model no longer fits how products actually evolve. Most meaningful UX changes cannot be cleanly randomized. They are rolled out gradually, constrained by infrastructure, shaped by policy, or deployed universally before research even begins. Qua

Imagine you are listening to a crowded room where several conversations are happening at once. You are trying to follow just one voice. At first, everything blends together: laughter from one corner, music in the background, fragments of unrelated sentences drifting past. To make sense of anything, your brain starts doing something remarkable. You focus on the voice you care about, the words that matter to you, the rhythm and tone that stay consistent, and you mentally tune o

Trying to do serious UX research with the wrong statistical tools is like trying to eat a bowl of soup with a fork. You can work very hard, take dozens of careful scoops, and still walk away hungry. The problem is not that UX data is unusable or too noisy. The problem is that we often analyze it with methods that were never designed for how human behavior actually unfolds. UX studies can be surprisingly efficient and informative when the analysis respects the structure of the

Most of us have been there, we run usability tests and see where people struggle, but we still do not quite understand how users think  about the product. Surveys give us numbers, but the answers feel thin or oddly constrained. At some point, someone suggests talking to users together, letting them react to each other, and seeing what emerges. That moment is usually when focus group interviews enter the picture, and depending on how they are used, they either bring clarity to

Organizations now have endless behavioral data. Clickstreams, funnels, retention curves, support tickets, reviews, session replays. Yet teams still struggle to answer the question behind every metric: why. At the same time, decisions have become more expensive and harder to reverse. When the ask is a multi million dollar pivot, a major redesign, or a policy change, inspirational insights are not enough. Teams need interpretive work that can stand up to scrutiny, including an

We have crossed a threshold in AI. In the older era, evaluation meant performance verification. Can the system do the task. Does it get the right answer. Does the benchmark score go up. In the frontier model era, that is no longer the question that matters. Now the question is alignment validation. Does the system do the task for the right reasons, within the right constraints, without hidden failure modes that only appear under pressure, under attack, or over time. This shif

I remember one specific survey that finally forced me to confront this problem head on. We were evaluating an e commerce redesign and the survey looked perfectly reasonable on paper. Among many items, we asked users to rate Visual Appeal and Attractiveness as two separate questions. Different words, different intentions, different stakeholders pushing for each. When the data came back, the correlation between those two items was almost perfect. Not theoretically similar. Prac

When we are faced with a large amount of text, most of us do the same thing instinctively. We try to get the big picture before understanding every detail. Imagine scrolling through hundreds of customer reviews for a product you are thinking of buying. You do not read every review carefully. You skim, you scan, and very quickly you get a sense that people are mostly complaining about battery life, praising the design, and arguing about the price. That rough summary forms almo

One of the most common instincts in research is to ask people exactly what they think. We ask users why they chose a specific product, what they liked about an interface, what confused them during a task, what mattered most to their workflow, and what ultimately influenced their final decision. This approach feels intuitive, respectful, and efficient; after all, who knows the user better than the user themselves? Yet, decades of psychological and behavioral research point to

Most product teams still assume that if a feature ships, users will naturally discover it. In practice that assumption fails all the time. New capabilities launch, engineering and design celebrate, dashboards show a small bump in traffic, and then adoption plateaus at a level that cannot possibly justify the investment. The real problem is usually not usability in the narrow sense. It is feature awareness: do people even notice that the thing exists, and do they understand wh

Interviews are like a gold mine, but only if you actually know how to extract the ore. Most teams stop at we talked to users and walk away with a handful of quotes and a gut feeling. Raw transcripts alone are not insight. They are messy, biased, emotionally charged human data that only become valuable through rigorous analysis. As a cognitive scientist and UX researcher who cares deeply about methodological quality, I see this mistake constantly. Great interview work is not d

We do not live in a binary world, yet much of traditional UX research still treats user decisions as if we do. Think about your last product decision. Did you love it or hate it. Of course not. Your actual internal dialogue probably sounded more like this: the onboarding flow was mostly smooth, but the payment screen felt cluttered, the subscription terms made you uneasy, and while the product solved your core problem, you still felt unsure whether you should commit long term

A Practical Guide to Probability Distributions in UX Research Most UX research teams now live in a world of metrics. Conversion rates, task success, time on task, churn, NPS, feature adoption, “rage clicks”, scroll depth. We A/B test them, segment them, and present them in slide decks every week. But under the surface, most of us still treat all of these metrics as if they came from the same simple shape: a nice symmetric bell curve. In the textbook world, variables are conti

You’re walking through a big clothing store, flipping through rack after rack trying to find something interesting. At first everything feels new. Different colors, styles, cuts. After a few minutes, though, you realize you’re seeing almost the same things again and again. Sure, the store is huge, but the variety isn’t unlimited. No matter which aisle you turn into, it’s basically more of what you’ve already seen. At some point you stop searching and think okay, I get it, not

UX research has gone through a quiet revolution. What used to be mostly interviews, usability testing, and expert reviews has expanded into a field deeply driven by data. Today we are not just listening to what users say. We analyze behavioral logs, interaction timing, psychometrics, conversion funnels, eye-tracking traces, error counts, retention curves, and long-term engagement metrics. Our questions have also become sharper. We no longer ask simply which design people like

Most UX research still treats user experience as a series of snapshots. We run a usability test, collect a System Usability Scale score, send a Net Promoter Score wave, or run an intercept survey at the end of a flow. These are useful for diagnosing immediate friction and capturing static sentiment, but they miss something fundamental about how humans interact with products over time. User attitudes are not fixed states. They are trajectories. Trust builds, then cracks. Frust

“Nothing is more difficult, and therefore more precious, than to be able to decide.” – Napoleon Bonaparte Well, lucky him. He never had to survive the modern tyranny of too many choices. Back then, a decision didn’t involve comparing 27 apps just to set an alarm. Today, every little task comes with endless options, all demanding attention, evaluation, and mental energy. We pick products, tools, workflows, and features while quietly negotiating time, effort, risk, frustration,

Instead of guessing what users are thinking, UX research can quantify the moment-to-moment effort a person’s brain expends while navigating digital systems. That effort is called cognitive workload, and it reflects how much of a user’s limited mental capacity is being consumed to perform a task. Understanding cognitive load matters because poor design can overwhelm users without ever showing up in usability ratings or performance data. A user might technically finish a workfl

Product teams, UX researchers, and marketers often face a frustrating paradox, they seek customer input to make better decisions, but the feedback they receive makes everything look equally important. On surveys, users rate most features as valuable. They approve nearly every message. They feel that multiple benefits are essential. This sounds helpful at first, yet it becomes a roadblock when teams must decide what to build, what to highlight, and what to ignore. The problem

Imagine working on the home screen redesign of a major streaming app. Designers insist that a cinematic hero banner will make the experience feel premium. Product managers push for more personalized rows to improve engagement. Leadership argues that a dedicated ad space could unlock new revenue. You run interviews, surveys, and usability tests to untangle these opinions, and users repeat a familiar phrase: “Well, it depends...” It depends on what they get in exchange. A bold