What is mixed reality?

Picture a sticker on a window. You move your head and the sticker stays flat on the glass. It is in front of everything you can see through that window, always, no matter what.

Now picture a fly in the room. It lands on the table. It goes behind the curtain and you cannot see it. It comes out the other side. The fly shares the room with you and obeys the same walls you do.

That is the difference at the heart of mixed reality. Plain augmented reality often behaves like the sticker. Mixed reality behaves like the fly.

What mixed actually means here

Mixed reality means digital things and real things share one space and can affect each other.

The word doing the work is share. A virtual ball in mixed reality rolls across your real floor, slows on your real carpet, and stops when it hits your real wall. Push it and it moves. Stand in front of it and it is hidden by you.

None of that is possible unless the device knows the shape of your room. Therefore the real question to ask about any headset is simple. Has it measured this room, or is it only painting on top of the picture?

How a headset learns the shape of a room

The headset carries cameras that point outwards. Two cameras look at the same wall from slightly different places. From that difference they work out how far away the wall is, in the way your two eyes do.

Some devices add a sensor that measures distance directly. It sends out light your eye cannot see and times how long the reflection takes to come back. Light travels at a known speed, so the delay gives the distance.

Either way, the result is the same. The software builds a rough three-dimensional model of the room: floor here, table there, wall two metres back. Engineers call that model a mesh. Once the mesh exists, a virtual object can be told to obey it.

The headset also remembers places. A note you leave on the fridge stays on the fridge tomorrow. Those saved spots are called anchors.

Passthrough, and why it matters

There are two ways to let you see your room while wearing a headset.

The first is clear glass. Real light passes through a transparent lens and extra light is projected into your eye. It looks natural and it never fails, but such displays are hard to build and the bright part of the picture tends to be small.

The second is passthrough. The headset blocks your eyes completely, then shows you the room using its own cameras. Nearly every mixed reality headset on sale now works this way, because it is far cheaper and the digital objects can be solid and bright.

Passthrough has a cost, and you should know it before you buy. Cameras are not eyes. Colours are duller, low light is grainy, and there is a small delay. Judging distance is harder than you expect. Do not pour hot water or carry a knife while wearing one.

AR, VR and MR side by side

Question	Augmented reality	Mixed reality	Virtual reality
Can you see your room?	Yes	Yes	No
Does the device measure the shape of the room?	Usually only flat surfaces	Yes, in three dimensions	Only to warn you of walls
Can a digital object hide behind your sofa?	Often not	Yes	Does not apply
Usual device	Phone	Headset	Headset

The three overlap, and the labels are used loosely in shops. All of them sit inside the family called extended reality. If you want the differences drawn out in full, read AR, VR and MR.

What mixed reality is good at

Mixed reality is at its best when the work happens at a real object and your hands are busy.

Repair and assembly is the clearest case. An arrow can be pinned to the actual bolt, in the actual order, and it stays there while you turn your head. Nobody puts down a spanner to check a manual.

Training is close behind. A trainee stands at the real machine while the software adds a fault that would be expensive or dangerous to create for real. The muscle memory is real because the machine is real.

Planning at full size is the third. Place a virtual generator on the floor of the room where it will live. You will see in a second whether the door opens, whether the pipes fit, and whether a person can stand behind it. Drawings hide those problems and full-size models reveal them.

Remote help is the fourth. An expert far away can draw on what you are looking at, and the mark sticks to the part rather than sliding across your screen.

What mixed reality is bad at

Price is the first barrier. Headsets that map a room properly cost far more than a phone, and the content to run on them costs more again.

The window is the second. The bright, sharp area where digital objects appear is smaller than your own field of view, so it feels like looking through a letterbox. Makers are widening it slowly.

Rooms are the third. Mapping needs light and texture. Bare walls, glass, mirrors, shiny floors and clutter all confuse the depth measurement, and a wrong mesh puts objects inside your furniture.

Then come the ordinary limits. There is weight on your face, warmth, and a battery measured in hours. And few people want to wear a headset in front of a customer.

Where you already meet mixed reality

Most of it is at work rather than at home. Factory maintenance, aircraft and vehicle servicing, warehouse layout, building site checks, surgical planning and industrial training are the steady users. Museums and showrooms use it to place large things in small rooms.

At home it shows up in games where a creature climbs over your real sofa. It also shows up in fitness apps, which use the shape of your room to keep you off the walls. Some headsets also float several work screens around your desk, which is a quiet but genuinely useful case.

If you have used augmented reality on a phone, you have met the light version. If you have used virtual reality, you have met the hardware.

What is coming next, and what to try

Two changes are worth watching. Depth sensing is getting cheaper and more accurate, which fixes most of what looks wrong today. Shared anchors are also improving. Several people in one room can now see the same virtual object sitting in the same spot. That second change turns mixed reality from a solo demonstration into a tool a team can use.

Try this today with only a phone. Open any app that places a virtual object on your floor, and put the object down near a chair. Now walk around so the chair comes between you and the object. Does the chair hide it, or does the object float in front of the chair? If the chair wins, your phone has measured the room, and you have just seen the part of the idea that makes mixed reality different.

Just Out Tech explains new research in plain language. This article was drafted with AI assistance and checked by a human against the original source.