Just out todayAugmented reality: The AR trainees were faster on the model they trained on, and no better anywhere elseVirtual reality: They matched the exercise dose exactly, and the VR advantage fell below the line that mattersVirtual reality: Both groups used the same headset. One watched a video first and picked up 10.8 more blocks

Biotech & health tech

The Strongest XR Training Evidence Yet: A Pooled Risk Ratio Of 1.36

Most XR training evidence is single small pilots. This pooled analysis of trials finds a real effect: 36 percent better odds of ideal screw placement, with the whole confidence interval above one.

What the paper found

A systematic review and meta-analysis of trials of virtual reality simulator training for pedicle screw placement by residents and early-career surgeons. Pooled analyses found those trained with VR simulation achieved a significantly higher rate of optimal Grade I screw placement than those receiving conventional training, with a risk ratio of 1.36 and a 95% confidence interval of 1.15 to 1.61. This is the strongest tier of evidence currently available in extended reality training.

Grade 8 reading level5 min readPeer reviewed

What happened

Just Out Tech recently covered a mixed reality surgical trainer that found nothing at all. A fair question after reading that one is: so does any of this work?

This paper is the other end of the evidence scale, and the answer it gives is yes, for one specific procedure, with better support than almost anything else in the field.

The procedure is pedicle screw placement. In spinal surgery a screw is driven into the vertebra, and it has to go into a narrow corridor of bone with nerves and vessels nearby. Placement is graded, and Grade I means ideal. Getting it wrong has consequences you cannot undo.

Trainees need practice, and practising on patients is the problem the whole field exists to solve.

The test

This is not an experiment. It is a systematic review and meta-analysis, and that distinction is the point.

A single trial tells you what happened once, in one hospital, with one group of trainees and one simulator. It can be right, and it can also be a fluke, or a reflection of that department’s particular habits. The field is full of such studies, mostly small.

A meta-analysis gathers the trials, assesses them, and pools their results into a single estimate. Done properly, it is the strongest form of evidence available short of one very large trial, because flukes in different directions cancel while a real effect accumulates.

So the question here is not “did VR help these trainees” but “across the trials that exist, does VR help”.

The result

It does. Residents and early-career surgeons trained with VR simulation achieved a significantly higher rate of optimal Grade I screw placement than those given conventional training.

The pooled risk ratio was 1.36, with a 95 percent confidence interval from 1.15 to 1.61.

Both numbers matter and the second matters more. A risk ratio of 1.36 means roughly 36 percent better odds, in relative terms, of achieving ideal placement. The confidence interval tells you how much to trust that: it runs from 1.15 to 1.61, and the whole range sits above 1.

That is the test a single small study almost never passes. When a pilot study reports a promising effect, its confidence interval usually straddles 1, which means the data are compatible with no benefit whatsoever. Here they are not.

Why does pooling turn maybes into findings? This is because a small study’s biggest problem is not bias, it is noise. Each one is a blurry photograph of the same thing. Stack enough blurry photographs of the same object and the object appears. STACKING THE BLUR IS HOW THE PICTURE ARRIVES.

What it means

Read against the null pilot we covered recently, this gives a clean lesson about how to read XR training claims. The same technology, in two different papers, produced “no detectable benefit” and “a real pooled effect”. Neither is wrong. They are answering questions at different levels of evidence.

So when a vendor shows you a study, the useful question is where it sits: a single pilot, a single trial, or a pooled analysis. Those are three different strengths of claim and only one of them should move a budget.

There is also a limit worth naming. Better screw placement grades are a surrogate: they stand in for what you actually want, which is patients doing better. Therefore the honest statement is that VR training improves the measured skill, and that patient outcomes are a further question.

Business ideas from this paper

1. Evidence-tier briefings for training procurement. Hospital training budgets are spent on the basis of whatever study a vendor supplied. Sell the one-page assessment of where each claim sits in the evidence hierarchy. Buyer: hospital education departments and training colleges. First test: assess the evidence behind one simulator a hospital is about to buy and ask whether it changed the decision.

2. Simulator access brokering for training hospitals. If pooled evidence supports VR training for this procedure, the constraint becomes access, and a simulator sitting idle in one department is capacity. Broker shared time. Buyer: teaching hospitals and surgical training programmes, especially where capital budgets are tight. First test: find two hospitals within reach of each other and see whether one has idle simulator hours.

3. Outcome follow-up studies as a service. The gap in this literature is patient outcomes rather than placement grades, and nobody is funded to close it. Offer the study design and the follow-up data collection. Buyer: device makers wanting stronger claims, and departments wanting to justify spend. First test: design one follow-up protocol and cost it for a single department.

How sure can you be?

This is the most solid XR training evidence in this batch, and it is still worth reading carefully.

The strengths: peer reviewed and published. A pooled analysis of trials rather than a single study. A confidence interval reported and entirely above 1. And a clinically meaningful, standardly graded outcome rather than a self-reported impression.

The limits: a meta-analysis inherits the quality of the trials it pools, and this summary does not tell you how many trials, how large, or how well conducted — for that you need the paper itself. Published trials tend to be the ones that found something, so pooled estimates can run optimistic. The outcome is placement grade, not patient recovery. And it covers one procedure: nothing here says VR training helps for anything else.

Do this today

Next time somebody cites a study at you, ask one question: is this one study, or all of them? The answer changes how much the number is worth.

Source: Virtual reality surgical simulator training of residents and early-career surgeons for pedicle screw placement: a systematic review and meta-analysis, European Journal of Orthopaedic Surgery and Traumatology, October 2026. 10.1007/s00590-026-05008-1 · doi.org (peer reviewed).

Just Out Tech explains new research in plain language. This article was drafted with AI assistance and checked by a human against the original source.

What to remember
  • This is a systematic review and meta-analysis of trials of virtual reality simulator training for pedicle screw placement by residents and early-career surgeons (DOI 10.1007/s00590-026-05008-1).
  • Pooled analyses showed VR-trained surgeons achieved a significantly higher rate of optimal Grade I screw placement than those given conventional training.
  • The pooled risk ratio was 1.36, with a 95% confidence interval of 1.15 to 1.61.
  • Because the entire confidence interval sits above 1, the benefit is unlikely to be a chance finding, which single small pilots in this field usually cannot establish.
  • A meta-analysis of trials sits above single studies in the evidence hierarchy, making this the strongest tier of evidence currently available for XR training.
Where this really is

A pooled analysis of multiple trials rather than a single study, which is what distinguishes replicated evidence from one lab result.

Questions people ask

What is a pedicle screw and why does placement matter?

A screw placed into the vertebra during spinal surgery. Misplacement risks nerve or vessel injury, so grading of placement accuracy is a standard outcome.

What does a risk ratio of 1.36 mean?

VR-trained surgeons achieved optimal placement about 36 percent more often, in relative terms, than conventionally trained ones.

Why does the confidence interval matter?

Because it runs from 1.15 to 1.61, entirely above 1. If it crossed 1, the result would be compatible with no benefit at all.

About the author

Mark Alex

Mark Alex is the founder and Managing Director of Real Biz Digital, a technology company operating out of Nairobi since 2018. He works in agentic AI and the Model Context Protocol, AI governance, enterprise software architecture and cybersecurity. He holds an MSc in Mechatronical Engineering from Obuda University in Budapest and a BSc in IT, Forensic Technology and Cybercrime, from USIU-Africa in Nairobi, and has published IEEE conference research on an AI-powered digital twin for greenhouse systems. He is the author of seven books. Between 2020 and 2024 he mentored more than 200 university students and interns in Nairobi. He writes every Just Out Tech article from the original research paper.