webcam interaction 2 | SunMatrix Ramble

Andes Beer: Friend Recovery

Following the success of the Andes Teletransporter in 2009, and its reported Grand Prix win at the 2010 Cannes Lions festival, Andes, the No. 1 beer from Argentina’s Andean region, is back with another invention designed to keep friends together for longer.

Andes Friend Recovery (AFR) is a telepresence robot with human features, installed in key bars in Mendoza. The pitch is deliberately simple. You can be “present” at the bar with your friends while still being physically somewhere else, taking care of whatever obligations pulled you away.

A bar table that comes with a remote seat

The mechanism is a dedicated AFR table in a bar, plus a robot that becomes your stand-in. Your friends start the session at the table. You authenticate remotely, map your face via webcam, and your live presence appears at the bar through the robot.

This is a physical version of “status update.” Instead of telling friends you will join later, you join now, with viewer control over a real viewpoint and a real conversation happening in real time.

In social, venue-led categories, the easiest growth lever is reducing the friction that ends the occasion early.

The real question is whether you can make “I can’t make it” feel like a solvable problem at the table, not a polite apology in a text thread.

Why the trick works

The appeal is not robotics. It is social continuity. AFR treats friendship as an appointment you should not have to cancel just because you are temporarily stuck elsewhere, and it makes the solution tangible enough to demo in one minute. Because the mechanism turns absence into a visible, physical stand-in, the group gets a concrete reason to keep the occasion going instead of wrapping it up.

Extractable takeaway: When your brand benefit is “more time together,” do not talk about it in slogans. Build a mechanism that removes the one blocker that ends the moment, then make that mechanism visible and easy to explain so people spread it for you.

How it works

Your friends go to a bar and sit at the Andes Friend Recovery table.
They ask for a password which is sent to you via an SMS, while you fulfil your boyfriend duties.
Wherever you are you log in to the AFR page and use the webcam to map your face.
Then you appear at the bar via the Andes Friend Recovery robot.

The numbers the case story leans on

AFR is described as being installed across major bars in Mendoza during October and November 2010. In that period, the campaign is reported to have driven over 2 million website visits, with around 5,000 “recovered” friends.

Friend Recovery moves worth borrowing

Remove the exit friction. Target the one blocker that ends the occasion early, then design the experience to neutralize it.
Make the mechanism instantly demoable. If the benefit is “more time together,” a visible, one-minute explanation travels further than a slogan.
Keep the framing playful. Anchor the joke in friendship and social continuity, not in teaching deception, so the stunt does not backfire.

A few fast answers before you act

What is Andes Friend Recovery?

It is a bar activation using a telepresence robot so a person can appear at a bar table remotely via webcam while being physically somewhere else.

What is the core mechanic that makes it feel “real”?

Two-way presence. Your face and voice show up at the table, and your friends interact with a physical avatar in the bar, not just a chat window.

Why does this count as experiential marketing, not just a film idea?

Because the primary value is delivered by a real installation in real bars. The video is the distribution layer, but the product is the experience.

What makes a stunt like this risky for the brand?

Tone and social framing. If it feels like a “how to lie” tutorial, it can backfire. It works best when it stays in playful exaggeration and focuses on friendship, not deception.

What should you measure if you try a “remote seat” activation?

Track whether the mechanism extends time together (session length and repeat use) and whether the demo travels (views, shares, and visits), then compare results to normal nights without the installation.

AT&T: ZugMO webcam heading banner game

The AT&T banner brings you right into the game, using Zugara’s augmented reality motion capture technology called ZugMO. Here, “augmented reality” means webcam-based motion capture with game graphics layered over live camera input. ZugMO translates head movement into game input. You use your webcam to “head” crosses toward goal, with five shots to score as many as possible. There isn’t much more to it than that. But it is a very cool concept, especially because it is described as having run as a banner placement on ESPN.com with BBDO and Zoic Studios involved.

Why this banner feels different to click on

Most banners ask for a click and then try to convince you after the fact. This one flips the sequence. It gives you a tiny game first, then lets AT&T benefit from the time, focus, and small dopamine hit that comes from trying to score.

Extractable takeaway: A playable banner works when the mechanic is instantly legible, the interaction is frictionless, and the reward arrives fast enough that people try “just one more shot.”

What “augmented reality” means here

In this execution, “augmented reality” is less about 3D worlds and more about webcam-based motion capture layered with game graphics. Your movement is the controller. The screen overlays the ball path and goal feedback on top of live camera input, so the interaction feels physical even though you are still inside a standard banner unit.

The mechanic is the message

There are only a few moving parts. A webcam feed. Face and head tracking. A corner-kick animation. A simple scoring loop with five attempts. That minimalism matters because banners do not have time for onboarding. If the player cannot understand it in one glance, the banner has already lost.

In performance-driven digital advertising, the fastest way to earn attention is to let people experience the message with their own body in seconds.

The real question is whether your ad can earn five seconds of voluntary play without explaining itself.

Playable banners are worth doing when the first interaction is immediate, legible, and ends quickly enough to invite a replay.

The business intent behind the “cool concept”

Positioned around football attention, the deeper message is speed and responsiveness. Not by claiming it, but by making the ad itself respond to you. It is a small but smart translation of “fast network” into an experience you can feel.

Steal this pattern for playable banners

Design for zero instructions. If the mechanic cannot be understood instantly, simplify it.
Use the body as the controller. Webcam motion beats mouse clicks when you want memorability, not just reach.
Keep loops short. Five shots is a clear session boundary. It invites replay without feeling endless.
Make the feedback loud. Clear “goal” and “miss” cues turn confusion into compulsion.
Let the format prove the claim. If your message is speed, make the interaction snappy and responsive.

A few fast answers before you act

What is a “playable banner”?

A playable banner is a display ad that includes a lightweight interactive experience, usually a mini game, inside the ad unit itself. The goal is to trade passive impressions for active participation.

Why does webcam motion capture increase engagement?

Because it turns the user from a viewer into the controller. When your body movement drives the outcome, attention becomes harder to drop and easier to remember.

What makes this AT&T banner easy to understand?

The interaction maps to a real-world action. You head the ball. The scoring loop is obvious. The session is short. That combination removes the need for instructions.

What is ZugMO in simple terms?

ZugMO is Zugara’s webcam-based motion capture layer that detects user movement and converts it into game input. In this case, it translates head movement into a “header” action.

What is the biggest failure mode for interactive banner ads?

Too much friction. If the ad requires setup, permissions confusion, slow loading, or unclear controls, most people leave before the first reward moment arrives.