Lists of “signs of a high-level thinker” tend to lean on vague, flattering traits, curiosity, open-mindedness, seeing the big picture. A specific line of decision-making research offers something more testable: a simple, measurable habit that distinguishes more careful thinkers from everyone else.
The foundational evidence comes from a 2005 study by Shane Frederick, published in the Journal of Economic Perspectives. Frederick administered a short set of three deceptively simple problems, now known as the Cognitive Reflection Test, to 3,428 people across 35 separate studies. The problems are designed so that an obvious, fast, intuitive answer immediately comes to mind, and that answer is wrong. A famous example: a bat and a ball cost $1.10 together, the bat costs $1.00 more than the ball, how much does the ball cost. Most people’s first instinct is 10 cents. The correct answer is 5 cents. What Frederick found was that people who caught and corrected that fast wrong instinct, arriving at the right answer instead, also behaved differently in completely unrelated decisions: they showed more patience when choosing between a smaller reward now and a larger reward later, and made more consistent, rational choices when weighing financial risks. The willingness to pause and double-check a confident first answer wasn’t just useful for math riddles. It predicted a broader pattern of more careful decision-making.
A second, much larger study looks at what separates good thinkers from great ones in a completely different, real-world setting. In a 2015 study by Barbara Mellers, Eric Stone, Pavel Atanasov, and a team of colleagues, published in the Journal of Experimental Psychology: Applied, the researchers analyzed more than 150,000 individual forecasts made by 743 participants in the Good Judgment Project, a multi-year tournament in which ordinary people predicted the outcomes of real geopolitical events. The most consistently accurate forecasters, later nicknamed superforecasters, weren’t simply the most conventionally intelligent participants. What distinguished them was a specific cluster of thinking habits: cognitive flexibility, skill at spotting patterns across different kinds of evidence, and, notably, a genuine willingness to keep revising their predictions as new information came in, rather than anchoring to an initial judgment and defending it.
Put together, these two studies describe a similar underlying skill from very different angles. Frederick’s research shows that catching and correcting a fast, wrong first instinct is a real, measurable habit, one that predicts better decision-making even in unrelated situations. Mellers and colleagues’ research shows that the same basic willingness to override an initial impression, holding a belief loosely enough to actually update it when new evidence arrives, is what separates the most accurate real-world forecasters from everyone else. Neither study is really about raw processing speed or stored knowledge. Both point toward the same underlying trait: treating a first answer as a draft rather than a conclusion.
It’s worth being honest about what these two studies don’t establish. Frederick’s Cognitive Reflection Test is a narrow, three-item measure, and while it correlates with other decision-making patterns, scoring well on it doesn’t guarantee good judgment in every domain of life, it’s a specific marker, not a complete diagnosis of how someone thinks. Mellers and colleagues’ data comes from a specific kind of task, geopolitical forecasting under time pressure and measurable feedback, so how well the same “superforecaster” traits transfer to other kinds of high-stakes decisions, ones without a clear right answer or fast feedback, isn’t something this particular research settles. Both studies are also correlational in nature within their broader claims, connecting a thinking style to an outcome rather than proving the thinking style single-handedly causes the better outcome.
Within those honest limits, the research supports a more specific, checkable version of what “high-level thinking” actually looks like than most listicle traits offer. It isn’t really about being fast, or naturally brilliant, or knowing more facts than everyone else. It looks more like a habit: noticing when a confident first answer showed up suspiciously quickly, and being willing to actually check it, or revise it, before treating it as settled.
