IBM worked with The Bosco to create an interactive installation for an exhibition at the Adobe Summit. Utilizing a custom 11 x 7 foot LED screen, The Bosco crafted a gesture-driven experience that empowered guests to create their own digital background for a video moment.
What I did: I created a Unity application that integrated a Kinect to drive a touchless UX and allowed guests to create particle effects with their hands. I prototyped example particles and iterated on them with client input to solidify the visuals. Concurrently, I incorporated a replay system so the guests’ drawings would replay while we recorded their videos on our standard video booth. For the booth component, I created the countdown timer and appropriate screen instructions and ensured the two systems worked well together. Once on site at the conference, I assisted with the integration of the project with IBM’s large screen setup.
How it worked: Guests stepped up onto a short platform in front of the LED screen, with graphics instructing them to strike a pose. Once the Kinect registered them, they were given instructions to draw by moving their hands to create a series of trails and particle effects. After the countdown ran out, guests were then instructed to turn around and record a video while their visualizations were redrawn behind them. Finally, guests stepped off the platform and toward the sharing kiosk where they obtained their digital creations complete with added cuts, effects, and music.
Roles: Software development, Particle design, UX, Prototyping, Innovation, A/V, On site technical support