Critical Thinking Skills: How to Measure and Develop Them

Introduction

Critical thinking is the disciplined process of evaluating evidence, testing arguments, and reaching a judgment you can defend. It is not skepticism for its own sake, and it is not raw intelligence. The most widely cited definition comes from the Delphi Report, a two-year expert consensus led by Peter Facione for the American Philosophical Association, which identified six core cognitive skills: interpretation, analysis, evaluation, inference, explanation, and self-regulation. ¹

Two things about that definition matter for anyone trying to build the skill. First, critical thinking is plural. It is a cluster of distinct operations, not one global knack. Second, the Delphi panel insisted that skills alone are not enough. A person also needs the disposition to use them, the habit of asking whether a claim actually holds up. ¹

This is one of the cognitive domains Arq.training assesses directly, because it is exactly the kind of capacity that a grade hides. A student can produce the right answer without ever questioning the premise behind it. Critical thinking is what is happening, or not happening, underneath the answer.

What critical thinking actually is

The Delphi Report's six skills give a useful anatomy. Interpretation is making sense of what is being claimed. Analysis is breaking an argument into its parts and seeing how they connect. Evaluation is judging the credibility of claims and the strength of the reasoning. Inference is drawing warranted conclusions from evidence. Explanation is stating your reasoning so others can check it. Self-regulation is monitoring and correcting your own thinking as you go. ¹

Notice that the last one, self-regulation, is metacognitive. Good critical thinkers do not just reason. They watch themselves reason and catch their own errors. That overlap is why critical thinking and metacognition are developed together rather than separately.

It is also worth saying what critical thinking is not. It is not contrarianism, it is not a debating trick, and it is not a fixed trait you either have or lack. Deanna Kuhn's research frames thinking skills as things that develop through inquiry and argument, which means they can be taught and they can be left untaught. ³

Is it teachable, or are people just born with it?

This is the question every skeptical teacher and manager asks, and the evidence is clear: critical thinking can be taught. The catch is that it has to be taught deliberately. It does not reliably appear as a free byproduct of covering content.

Deanna Kuhn argues for putting inquiry and argument at the center of the curriculum rather than treating thinking as something that happens automatically once facts are delivered. ³ The National Research Council's report on deeper learning reaches a compatible conclusion: transferable cognitive, intrapersonal, and interpersonal competencies have to be developed intentionally, not assumed. ⁴

When critical thinking instruction is done well, the effects are real. John Hattie's synthesis of more than 800 meta-analyses places the strategies most associated with thinking, including metacognitive and self-regulation strategies, among the higher-impact influences on achievement, above the average effect that defines a typical year of progress. ⁵

The transfer problem

Here is the failure mode that derails most critical thinking programs. Students learn to analyze arguments in a logic unit, ace the unit, and then reason just as carelessly in history class the following week. The skill did not transfer.

Diane Halpern studied this directly and proposed a four-part model for teaching critical thinking so that it transfers across domains. It requires working on dispositions, explicit skills instruction, training in the structure of problems so learners recognize the same structure in new contexts, and metacognitive monitoring so learners know when to deploy what they have learned. ²

The practical lesson is that transfer is engineered, not hoped for. You build it by practicing the same thinking moves across varied content, by naming the structure explicitly, and by prompting learners to notice when a new problem rhymes with an old one. Arq is designed around this principle, presenting the same reasoning demands in shifting contexts rather than drilling them in one.

How to measure critical thinking

You cannot measure critical thinking with a question that has one lookup-able answer. Recall items test whether the knowledge is there. They say nothing about whether a person interrogates it.

Real measurement looks at performance on open, unfamiliar problems: does the person surface assumptions, weigh evidence, consider alternatives, and justify a conclusion? This can be scored with rubrics built on the Delphi skills, and increasingly it can be assessed through the structure of a person's reasoning rather than the content of their answer.

This is the approach behind developmental scoring and behind Arq's assessment. Rather than checking a box for the correct response, it reads how the response was built: what was considered, what was coordinated, and where the reasoning stopped. That produces a picture of thinking quality, which is the thing a grade was never designed to capture.

How to develop it, in class or at work

The methods that build critical thinking are consistent across settings. Make reasoning the assignment, not just the answer. Ask people to argue more than one side of a question. Require them to state the evidence behind a claim and to name what would change their mind.

• Pose problems with genuine ambiguity, where more than one defensible answer exists.

• Ask for the strongest version of the opposing view before allowing a conclusion.

• Build the disposition by rewarding good questions, not just right answers. ¹

• Practice the same thinking move across different subjects so the structure transfers. ²

• Prompt self-checking: what am I assuming, and how would I know if I were wrong?

None of this requires a new curriculum. It requires changing what gets asked and what gets valued. When the question demands real reasoning and the feedback targets the reasoning, the skill grows.

Originally published on Arq.