Research: Interactive Virtual Aerobics Trainer


Pat Photo

In this research we discuss the design and implementation of a prototype virtual Personal Aerobics Trainer (PAT). This system creates a personalized aerobics session for the user and displays the resulting interactive virtual instruction on a TV screen. Here the user can choose which moves (and for how long), which music, and which instructor are desired for the workout. The session created by the user is automatically generated and begins when the user enters the area in front of the TV screen.

The underlying motivation for building such a system is that many forms of media that pretend to be interactive are in fact deaf, dumb, and blind. For example, many of the aerobics workout videos that one can buy or rent present an instructor that blindly expels verbal re-enforcements (e.g. "very good!'') whether or not a person is doing the moves (or is even in the room!). There would be a substantial improvement if the TV just knew whether or not a person was moving in front of the TV. A feeling of awareness would then be associated with the system. And because of the repetitiveness of watching the same exercise videos, this "programmable" system heightens the interest of the user by allowing the design of specialized workouts (e.g. exercising only the upper body).

This system moves beyond the highly un-interactive media forms of video tapes and TV shows by having the system watch and respond to the user (instead of just the user watching the TV). We feel that many future systems will be more interactive and less passive, and that perhaps one day will be commonplace within the home environment.


Virtual Instructor

Drill Sargent
Virtual Army Drill Sargent
0.2MB Quicktime.
Depending on the mood of the user, the choice of instructor could make a large difference in the workout. For instance, if the user were tired and required strong motivation during the workout, a brash Army Drill Sargent as the instructor would make an ideal choice. Along those lines, the prototype system here makes available an Army Drill Sargent character as the instructor.

In addition to the video, the user periodically receives audio comments from the virtual instructor on how he/she is currently doing. The instructor gives both positive and negative feedback. For example, positive comments include "good job!" and "keep up the good work!". Negative comments include "get moving!" and "come on, smell the coffee!".


Computer Vision

To accomplish the interactivity of the virtual instructor, we place video cameras in the room and use real-time computer vision techniques to recognize the aerobic movements of the user. We previously developed a system which generates and recognizes extended Motion History Images of the user. These motion templates layer the user's silhouette form in an image over time to generate "templates of movement", as shown in the images below.

Left Arm Raise Fan Up Arms
Motion templates for finishing LEFT-ARM-RAISE and FAN-UP-ARMS.

Using the output of the vision system, the instructor then responds accordingly (e.g. "good job!" if the vision system recognizes that the user is performing the aerobic move correctly, or "get moving!" if the user is not participating). This vision technology is different from many other sensing technologies in that the user need not wear any special devices or be tethered to machines with bundles of wires. This enables the experience to be more natural and desirable.


Related Papers


In The News


Photo Gallery

(Click on image to see higher-resolution photo)

Photograph by Sam Ogden.

Photograph by Sam Ogden.

Photograph by Sam Ogden.

Photograph by Sam Ogden.

Photograph by Webb Chappell.


Home