Guide · 2 min read · updated 2026-10-11
Interactive Projection Installations with TouchDesigner
How interactive mapping works — sensors, real-time engines, latency and design patterns — with a starter architecture for your first interactive projection.
Interactive installations react to the people in front of them: the floor ripples under footsteps, a wall bursts into colour when you wave, a facade responds to the crowd's noise. Most of them follow the same architecture, and TouchDesigner is one of the most popular tools for building it. Browse real examples in our TouchDesigner showcase projects.
The basic architecture
- Sense — capture the audience with a depth camera, LiDAR, webcam, microphone, touch sensors, or data feeds.
- Interpret — turn raw data into meaningful signals: positions of people, gestures, loudness, presence in zones.
- Generate — drive real-time visuals and sound from those signals.
- Output — warp, blend and map the result onto the surface, in the same application or via Spout/Syphon or NDI to a mapping tool.
Choosing sensors
| Sensor | Good for | Watch out for |
|---|---|---|
| Depth camera (Kinect, Orbbec, RealSense) | Body tracking, gestures, silhouettes | Limited range (≈ 0.5–5 m), sunlight interference |
| 2D LiDAR | Touch on walls/floors, people counting | Detects in one plane only |
| Overhead camera + computer vision | Floors, crowd flows | Lighting changes, projection bleeding into the camera |
| Microphone | Crowd noise, music | Background noise outdoors |
| Pressure/touch sensors, buttons | Precise, robust interaction | Physical installation and wear |
Infrared cameras are useful because they can ignore the visible projection while still seeing people.
Latency matters
People notice delays above roughly 100 ms between action and response. Keep the pipeline short: process sensors on the same machine, avoid unnecessary network hops, and test with real visitors. Smoothing filters reduce jitter but add delay — balance them.
Design patterns that work
- Immediate feedback: every visitor should see a response within a second.
- Readable cause and effect: if people cannot tell what they control, they leave.
- Group play: design for many people at once — festivals are crowded.
- Idle state: an attractive animation when nobody is interacting draws people in.
- Robustness: handle sensor dropouts gracefully and restart automatically.
A starter project
- Connect a depth camera and bring its point cloud or player index into TouchDesigner.
- Threshold the depth image to get a silhouette mask of people in front of a wall.
- Feed the mask into a feedback loop or particle system so silhouettes leave trails of light.
- Map the output to the wall with the built-in mapping tools; align the camera view to the projection with a simple calibration step.
- Add sound: trigger notes when silhouettes enter zones.
FAQ
Is TouchDesigner free?
There is a free Non-Commercial licence with some resolution limits; paid Educational, Commercial and Pro licences unlock higher output and commercial use.
Can I build interactive mapping without coding?
Node-based tools like TouchDesigner, Isadora and vvvv reduce the need for code, though Python or scripting helps for complex logic.
What computer do I need?
A desktop with a recent dedicated GPU is recommended for real-time content. Sensor processing and high-resolution output both need GPU power.