Interactive Projection Mapping

To promote its new high-performance hybrid car, Lexus, together with Saatchi & Saatchi Italy, creates “Trace Your Road”, an experiential event featuring Formula 1 driver Jarno Trulli.

Ten Lexus fans are selected from hundreds of applicants on Lexus’ Facebook page. Each winner rides in the passenger seat of the hybrid while Trulli drives, and the passenger “draws” the course on an iPad. That path is projected onto the floor of an aircraft hangar using special projectors, while a custom high-resolution infrared (IR) camera system tracks the car’s position in real time.

How the experience works

The format is a life-sized driving game with the audience literally designing the track. The event flow is built around three moving parts.

Live track creation. The passenger traces a route on the iPad, creating spontaneous turns, straights, and corners.
Real-world projection. The route appears at scale on the hangar floor, so the “racetrack” becomes a physical space.
Real-time tracking. An IR camera system follows the car so penalties and scoring can be applied accurately.

What makes it competitive, not just cinematic

Trulli’s driving is put to the test as he attempts to follow the improvised paths at speed. Penalty points are given when the car goes outside the projected route or touches the hangar walls. The goal is to hit seven selected touch points in the quickest time, and the fan with the best score wins.

In automotive launches and premium brand marketing, turning a test drive into a participatory game makes performance feel experienced, not explained.

The real question is whether your launch makes the product truth the win condition, not just the headline.

Why it lands: performance becomes legible

Hybrid performance can be hard to dramatize without slipping into numbers. Because the passenger-designed route and visible penalty rules force precision, control and handling become legible without a spec sheet, while the story stays human through the passenger’s real-time choices and Trulli’s visible skill.

Extractable takeaway: When you can turn a product claim into a rule set with visible penalties, the audience understands it instantly and the content becomes inherently shareable.

What Lexus proves with “Trace Your Road”

The brand is not only saying “this car performs”. It is staging a situation where performance is the only way to succeed. This is a stronger way to market performance than listing specs, because it forces the car to prove itself under constraints. The experience also rewards participation: winners influence the outcome, spectators understand the rules instantly, and the filmed content has a clear narrative arc.

Make the claim playable: launch moves worth copying

Let the audience shape the challenge. When participants create the rules in real time, attention spikes because outcomes are unpredictable.
Translate product claims into constraints. Handling, control, and precision become visible when the environment punishes mistakes.
Build a scoring model people can explain. Simple penalties and a clear finish condition make the story travel.
Use tech as infrastructure, not the headline. Projection and tracking matter most when they disappear into the experience.

A few fast answers before you act

What is Lexus “Trace Your Road”?

It is an experiential event where a passenger draws a racetrack on a tablet and the route is projected onto a hangar floor, while Jarno Trulli drives a Lexus hybrid along that path in real time.

How is the racetrack created and shown?

The passenger traces the course on an iPad, and the design is projected at scale onto the floor using multiple projectors so the track becomes a physical space to drive in.

How does the system know if the car stayed on the route?

A custom high-resolution IR camera tracking system monitors the car’s position against the projected route so penalties can be applied when it leaves the path.

What makes this more than a one-off stunt?

The format produces repeatable rounds, clear scoring, and a strong spectator story, which makes it easy to capture as a campaign film and behind-the-scenes content.

What is the main lesson for experience design?

Make the product truth the win condition. When success requires the product’s strengths, the message feels demonstrated rather than claimed.

NuFormer, after executing 3D video mapping projections onto objects and buildings worldwide, adds interactivity to the mix in this test.

Here the spectators become the controller and interact with the building in real time using gesture-based tracking (Kinect). People influence the projected content using an iPad, iPhone, or a web-based application available on both mobile and desktop. For this test, Facebook interactivity is used, but the idea is that other social media signals can also be incorporated.

From mapped surface to live interface

Projection mapping usually works like a film played on architecture. This flips it into a live system. The building is still the canvas, but the audience becomes an input layer. Gesture tracking drives the scene changes, and second-screen control, meaning a phone or browser used as a remote, extends participation beyond the people standing closest to the sensor.

Extractable takeaway: Interactive mapping is most compelling when the control model, the set of simple inputs people can learn instantly (wave, move, tap), is legible at a glance and the projection responds quickly enough that people trust the cause-and-effect.

In large-scale public brand experiences, projection mapping becomes more than spectacle when it gives the crowd meaningful viewer control instead of a one-way show.

Why the “crowd as controller” move matters

Interactivity changes what people remember. A passive crowd remembers visuals. An active crowd remembers ownership. The moment someone realises their movement, phone, or social input changes the facade, the projection stops being “content” and becomes “play.”

The real question is whether your interaction model makes people feel in control within seconds, or confused for minutes.

Because the facade responds immediately to a person’s input, the crowd shifts from watching to experimenting, which keeps people around long enough to teach each other and try again.

That also changes the social dynamics around the installation. People look for rules, teach each other controls, and stick around to try again. The result is longer dwell time and more organic filming, because participation is the story.

What brands can do with this, beyond a tech demo

As described in coverage and in NuFormer’s own positioning, branded content, logos, or product placement can be incorporated into interactive projection applications. The strategic upside is that you can design a brand moment that is co-created by the crowd, rather than merely watched.

When social signals are part of the input (Facebook in this case), the experience can also create a bridge between the physical venue and online participation. That hybrid loop is where campaigns can scale.

Patterns for your next mapping brief

Pick one primary control. Gesture, phone, or web. Then add a secondary layer only if it increases participation rather than confusion.
Make feedback immediate. The projection must respond fast or people assume it is fake or broken.
Design for “spectator comprehension.” Bystanders should understand what changed and why, from a distance.
Use social inputs carefully. Keep the mapping between input and output obvious so it feels fair, not random.
Plan for crowd flow. Interactive mapping is choreography. Sensors, sightlines, and safe space matter as much as visuals.

A few fast answers before you act

What is “interactive projection mapping” in this NuFormer test?

It is 3D projection mapping where the projected content changes in real time based on audience input. Here that input includes Kinect gesture tracking plus control via iPad, iPhone, and web interfaces.

Why add phones and web control when you already have gesture tracking?

Gesture tracking usually limits control to people near the sensor. Second-screen control expands participation to more people and enables a clearer “turn-taking” interaction model.

How does Facebook interactivity fit into a projection experience?

It acts as an additional input stream, letting social actions influence what appears on the building. The key is to make the mapping from social action to visual change understandable.

What is the biggest failure mode for interactive mapping?

Latency and ambiguity. If the response is slow or the control rules are unclear, crowds disengage quickly because they cannot tell whether their input matters.

What should a brand measure in an interactive mapping activation?

Dwell time, participation rate (people who trigger changes), repeat interaction, crowd size over time, and the volume and quality of user-captured video shared during the event window.