What is an example of augmented reality?

Pointing your phone at your sitting room and seeing a sofa you are thinking of buying, standing on your own floor at the right size. A face filter in a chat app is another example. So are the walking arrows that some map apps paint onto the street through your camera.

What is the difference between AR and VR?

Augmented reality adds things to the room you are in, and you can still see the room. Virtual reality replaces the room completely, and you see only what the computer draws. The simplest test is whether you can still see your own feet.

Do you need special glasses for augmented reality?

No. Most augmented reality today runs on a normal phone or tablet, using the camera and the screen. Glasses are more comfortable for long jobs, because they leave your hands free. They are also more expensive, and the picture they can show is usually smaller than you expect.

Why does the virtual object slide around the room?

The software tracks your position by watching detail in the camera picture. When there is little detail to watch, such as a bare wall, a shiny floor or a dark room, the tracking loses its grip and the object drifts. Move somewhere with more texture and better light, and move the phone slowly.

What is augmented reality?

Watch a football match on television. The score sits in the corner, and the clock runs beside it. Sometimes a line is drawn across the pitch to show an offside call. That line stays stuck to the grass even as the camera moves. The match is real. The line is not. You see both at once and you are not confused for a second.

That is augmented reality, done on a television. Move the same trick to the phone in your hand and you have the thing people mean by AR.

Augmented reality adds computer-made things to the world in front of you. The important half of that sentence is the word adds. Your room stays where it is. Nothing is taken away.

How augmented reality works, step by step

The loop runs many times a second, and it has four parts.

Look. The camera takes a picture of what is in front of you.
Find. Software picks out detail in that picture, such as corners, edges and patterns on a floor.
Place. By watching how that detail shifts between pictures, the software works out where the camera is and which way it points.
Draw. It paints the digital object into the scene, from the correct angle and at the correct size, then starts again.

Step three is the whole magic trick. Once the software knows where your camera sits in the room, it can pin a virtual object to a spot on your floor. You walk around it and it stays put. Nothing is stuck to your walls, and no beacons are needed.

Older systems needed a marker, which was a printed pattern the camera could recognise. Point at the marker and the content appeared. Modern phones do it without a marker, because they can find flat surfaces on their own.

The two hard parts

Two problems separate AR that looks convincing from AR that looks pasted on.

The first is hiding. If a virtual cat walks behind your real chair, part of it should disappear. The software can only do that if it knows how far away the chair is. Getting this wrong is the fastest way to break the illusion, and it is why cheap AR objects seem to float in front of everything.

The second is light. A digital jug on a sunny table needs a shadow that falls the right way. Phones now guess at the brightness and colour of the room and shade the object to match. It is a guess, but a good one is enough to fool your eye.

How the picture reaches your eyes

Through a screen. Your phone shows the camera picture with the extra items drawn on top. This is by far the most common way, and it costs nothing extra.
Through glass. See-through glasses let real light pass while projecting extra light into your eye. Your hands stay free, which matters for work.
Through a windscreen. Some cars project the speed and a turn arrow onto the glass, so your eyes stay on the road.

Each route has a cost. A phone ties up your hand and your attention. Glasses cost more, weigh on your nose, and usually show a picture smaller than you imagine. A car display can only sit in one place.

What augmented reality is good at

AR is at its best when you must keep your eyes on a real thing while somebody tells you about it.

Repair work is the clearest case. A technician sees an arrow on the actual valve that must be turned, in the right order, without looking down at a manual. Warehouse picking works the same way, with the next shelf marked in view.

Buying decisions come second. Seeing a fridge at true size in your own kitchen answers a question a photograph cannot. Trying on glasses or shoes through a camera does the same job.

Teaching is third. An engine you can walk around, take apart and put back together teaches faster than a diagram, and it never runs out of parts.

What augmented reality is bad at

Sunlight is the first enemy. Added light has to compete with the sun, and outdoors the sun wins. Screens wash out and glasses fade to nothing.

Blank surfaces are the second. The tracking needs detail to hold on to, so plain walls, polished floors, glass and darkness all make objects drift. Crowds are hard too, because moving people are not a reliable background.

Then come the plain limits of a phone. Running the camera, the screen and the tracking together drains the battery and heats the handset. Holding an arm up for more than a few minutes is tiring. This is the real reason AR sessions are short.

Privacy is the quiet one. AR needs a camera pointed at whatever you are looking at, including other people. Some of that picture may leave the device. Ask where it goes.

How to tell AR apart from VR and MR

Ask one question. Can you still see the room you are standing in?

If yes, and digital items are laid over it, that is augmented reality. If no, and your surroundings have been replaced, that is virtual reality. If you can see the room, and the digital items treat it as solid, most people call that mixed reality. Such items bounce off your floor and hide behind your table. All three sit inside the family called extended reality.

Be warned that the line between AR and MR is drawn differently by different companies. If a label matters to you, ask what the device actually does rather than what it is called. There is a longer comparison in AR, VR and MR.

Where you already meet augmented reality

You have almost certainly used it. Face filters in chat apps are AR. So is the measuring app on many phones, which uses the camera to lay a virtual tape across a room. Live walking directions in map apps are AR. So are the furniture and paint previews in shopping apps, and the animal that appears on your table when you search for one.

AR matters more than headsets do for one plain reason. It runs on a phone that people already own. No new purchase is required, so the audience is counted in billions rather than millions.

What is coming next, and what to try

Two things are changing. Glasses are getting lighter, and some now push the heavy work to a phone in your pocket. At the same time, software is getting better at naming what the camera sees. An overlay can then be about the object in front of you, rather than the flat surface under it.

The other change is sharing. Systems are learning to leave a virtual object in a fixed place. Other people arriving later, with their own devices, then see it in the same spot. That turns AR from a private toy into something a team can use on a site.

Try this now. Open the measuring app on your phone and measure a doorway. Then measure it with a real tape. Compare the two numbers. Then repeat the phone measurement in a dim room with bare walls and watch the reading get worse. In two minutes you will have learned what AR needs in order to work.

Just Out Tech explains new research in plain language. This article was drafted with AI assistance and checked by a human against the original source.