Kodama

Kodama

  • a child playing Kodama at the RCA show 2016
    Zoom
    a child playing Kodama at the RCA show 2016
  • The optical less camera
    Zoom
    The optical less camera
  • A bunch of prototypes of our mat
    Zoom
    A bunch of prototypes of our mat
  • toys prototypes, 3d printed and in resin
    Zoom
    toys prototypes, 3d printed and in resin
  • Kodama toy on the mat
    Zoom
    Kodama toy on the mat
  • the toys are alive!
    Zoom
    the toys are alive!
  • Mother and Child playing together
    Zoom
    Mother and Child playing together
  • 6year old child saying it is the new minecraft
    Zoom
    6year old child saying it is the new minecraft
  • A dinosaur with a hat!Sherif in town!
    Zoom
    A dinosaur with a hat!Sherif in town!
Video demonstrating briefly the Kodama project
What It Does

Kodama is a tangible interface for creating 3D animations by moving toys with your hands, allowing to satisfy the children’s needs for screens, while at the same time enforcing human to human interaction, as opposed to eliminating it.

The Inspiration

Playing is a form of learning. With the onset of digital media, tangible interaction is removed from what kids now consider as playing. Recently Samsung released VR for bedtime stories, which eliminated the need to interact with your children. Before digital media, story telling was about community, interaction, and learning, values which slowly diminish as media such as video games becomes more isolating.

In addition, large studios such as Disney create a monopoly on story telling, limiting the creativity to only playing with their brands, such as avengers or batman. Kodama allows kids to create their own characters and stories around the

How It Works

The system consists of three components, the toys, the mat, and the software. The location of the toys in space is being tracked across the mat, and the software generates a 3D animation of the generated interaction in real time. The system works on the same principle as GPS.

When scanned on the mat the character associated to the toy appear within the virtual environment. By moving the toy around the mat, the character moves around within the virtual environment. Certain inputs trigger predefined interaction, for example: by simply moving the figure along the tablet, the character appears to walk, by lifting the figure off the ground, the character jumps or flies, by moving two figures together the characters fight or interact in another predefined manner

Stages of Development

At the very beginning of the project we looked into how people tell stories and went to the core of storytelling. After identifying how humans tell stories, we looked into how stories are built and why we tell them. From those experiments and researches we came up with the final concept: A platform where you can create stories by moving toys with your hands.

We built a series of working prototypes involving puppets, augmented reality and the use of inertial measurement units (physical computing). By doing user testing with users and consulting professionals in the field we understood that the challenge was also technical. How could we realize the vision without expensive technology and make it available for everyone?

We built an optical less tabletop GPS, very affordable and extremely accurate compared to existing optical solutions. With the technology in hand, and the concept, we designed the toys to inspire and trigger the user’s creativity while leaving space for their imagination. The rest of the kit has been designed following this philosophy.

Novelty

The current technological trend is moving towards virtual and augmented reality. This implies the removal of tangible, human to human interaction. The goal behind Kodama, is to bring back tangible human interaction to virtual platforms. It gives the user the ability to tell a story or create a movie, in real time, by playing with toys.

Companies like Disney Infinity, and Activision Skylanders have attempted to enter the market of merging tangible toys with digital content, but these don’t actually allow for any tangible interaction, as the toys only enable you to activate a new character in the game.

The primary use case for kodama is a tool for bed time stories, which allows a parent to interact, while still satisfying the child’s demand for visual content, promoting a healthier learning.
The technological novelty is the use of non optical tracking for animation purposes, which is a first, as existing systems rely on cameras.

Future Plans

The long term goal is to deliver a market ready 3D animated story telling platform. As we currently have a working prototype, the system still needs to be further refined and re-designed for mass manufacture. More work needs to be done on the hardware as well as the trilateration equations that we are currently utilizing, in order to ensure more accurate tracking. From the software side, more work is required to create a bank of various animations, environments and characters. This calls for the expansion of the project team, with members in the fields of programing, animation and electronics engineering.

Awards

-James Dyson Foundation project bursary (£3,000)