Oddy : AR Nature Interaction Device

What it does

Oddy is an device that helps children reconnect with nature by recognizing real insects and visualizing them as animations. Its motion-based collection and rotating display offer playful interaction, addressing the lack of outdoor engagement in kids’ lives.

Your inspiration

As children’s free time becomes increasingly dominated by screens, I began to question whether technology must always pull them away from the physical world. Could it instead be used to bring them back into it? This led to the creation of Oddy. I drew from traditional, instinctive tools like nets, tweezers, magnifying glasses, telescopes, even slingshots and translated them into motion-based actions such as swinging, pinching, zooming, and aiming. These physical gestures are reinterpreted through AR, AI, and a 90° rotating display, encouraging children to explore nature with curiosity and movement, not just touchscreens.

How it works

Oddy combines AI-based insect recognition, AR visualization, and motion-triggered interaction using internal sensors and a rotating display. Dual cameras and a LiDAR sensor capture real-time images of insects, which are analyzed by AI to identify the species. The results are transformed into AR characters on screen for a more approachable and playful experience. The device rotates 90 degrees via a rear trigger to switch between observation and collection modes. A rotary encoder detects the display’s position, while the gyroscope and accelerometer capture physical gestures. These gestures simulate traditional insect collecting tools such as nets, tweezers, magnifying glasses, telescopes, and slingshots. Children interact by swinging, tilting, or aiming the device, triggering corresponding digital actions and receiving visual and tactile feedback. Oddy blends physical play with technology to foster curiosity, movement, and learning in outdoor environments.

Design process

The development of Oddy began with a question: How can we reconnect children with nature using technology through meaningful interaction instead of passive screen time? This inspired the idea of blending traditional insect-collecting behaviors with AR, AI, and motion recognition. In the concept phase, we analyzed familiar collecting actions such as using nets, tweezers, magnifiers, and slingshots, and reinterpreted them into motion gestures. We also explored how a rotating body could enable multiple interaction modes. Sketches and foam models helped test grip, button layout, and hand motions. Our first prototype combined a Raspberry Pi board, camera, gyro and accelerometer sensors, and a rotating display. AR content was triggered through AI-based insect recognition, and interactions like shaking or tilting activated collection animations. User testing revealed issues with the transition between modes. We solved this by adding a rear trigger to control 90-degree rotation and redesigned the UI for clearer feedback. Sensor responsiveness and AR performance were also improved. The prototype now supports observing, collecting, and sharing. Future development will focus on lighter hardware, better battery life, and outdoor durability.

How it is different

Oddy is unique in how it transforms traditional insect collecting into a playful, motion-based experience that blends physical behavior with digital technology. While most AR toys rely on tapping or scanning, Oddy encourages swinging, tilting and aiming through gestures inspired by tools such as nets, tweezers and magnifiers. These actions become intuitive and meaningful forms of interaction. The device rotates ninety degrees to support two distinct modes, enhancing engagement through both structure and function. Unlike many products that treat technology as something to be avoided, Oddy embraces it as a natural bridge. Rather than forcing children outdoors, it uses joy and curiosity to guide them into nature through familiar digital media. By recreating the thrill of discovery with real movement and responsive feedback, Oddy invites children back into nature. Its originality lies in blending instinctive action with interactive learning.

Future plans

The next step for Oddy is to improve portability and durability for outdoor use. This includes reducing weight, enhancing battery performance, and protecting key components for field conditions. We plan to refine the AI system to recognize more insect species with greater accuracy, and improve the AR interface for smoother animations and clearer feedback. In the future, a companion app will allow users to log and share their collected insects, encouraging ongoing exploration and learning. Oddy’s goal is to grow into an educational tool that connects curiosity and nature through technology.

Awards