Spatial Computing definition
Spatial computing is a form of computing in which digital content and interfaces exist in three-dimensional space around the user rather than only on flat screens. Devices understand the physical environment and the user's position, gaze, hands and voice, then place apps and objects in the room. It spans AR, MR, VR and robotics.
How spatial computing works
The term was defined in academic work at MIT by Simon Greenwold in 2003, describing machines that interact with people and objects in real space. Today it describes systems that combine several capabilities: sensing the environment, understanding what is in it, tracking the user and rendering content that behaves as if it belongs in the room. The result is an interface where you look at a window to select it, pinch to click and walk around a 3D model.
- Environment sensing with cameras, depth sensors and LiDAR.
- Scene understanding: recognizing walls, floors, tables and objects.
- User tracking: head position, eye gaze, hands and voice.
- Spatial audio that sounds as if it comes from objects in the room.
- Rendering that keeps virtual content anchored, lit and occluded correctly.
Spatial computing vs AR, VR and mixed reality
AR, VR and mixed reality describe how much of the real world you see. Spatial computing describes the computing paradigm: software that understands and operates in three-dimensional space. A mixed reality headset is one spatial computing device, but robots navigating a warehouse, autonomous vehicles mapping a road and phones measuring a room with LiDAR also rely on spatial computing. The term shifts the focus from the headset to what the software can do with space.
Examples of spatial computing
- Productivity apps arranged as floating windows around the user on Apple Vision Pro or Android XR headsets.
- Mixed reality games and fitness apps on Meta Quest that use your real room.
- Engineers inspecting full-size 3D product models together.
- Surgeons reviewing 3D anatomy from patient scans before operations.
- Warehouse robots and drones mapping and navigating physical spaces.
- Phone apps that measure rooms and create floor plans.
- Retail apps that place true-size products in a customer's home.
Designing for spatial computing
Spatial interfaces need different design rules from screens. Content should appear at comfortable distances and heights, with interactive targets large enough for eye or hand selection. Holding arms up for long periods is tiring, so frequent actions should work with relaxed hands. Depth, shadows and sound help users understand where things are, and motion should be gentle to avoid discomfort.
Privacy matters more than on phones. Spatial devices continuously capture rooms, faces and, in some cases, eye movements, which can reveal sensitive information. Platforms limit what apps can access, for example by not sharing raw gaze data, and app makers should collect only what they need.
Business adoption
Enterprise uses lead today: design review, training, remote assistance, data visualization and sales demonstrations, where seeing something at full scale in context saves time or travel. Consumer adoption depends on lighter, cheaper devices, which is why most companies start with pilots alongside existing phone and web channels. Nexzem builds spatial computing prototypes for visionOS, Meta Quest and mobile AR, choosing the platform from the use case and the devices the client's users actually have.