Mouseware

What it does

This patented solution leverages the power of head movements to enable control of smart devices. By combining movement tracking sensors, switches to mouse click and SpeechToText to input text, it allows individuals to effortlessly interact with digital devices

Your inspiration

I decided to solve the problem of controlling smart devices using head movements because I witnessed the challenges faced by individuals with limited mobility. Seeing their frustration, I started a company called Dextroware Devices (solo Founder) to enhance their independence and digital interaction. Through research and brainstorming, I developed the concept of Mouseware, leveraging head movements, sensors, switches, and speech-to-text technology. This idea stemmed from the desire to empower individuals with disabilities and provide them with a more accessible way to engage with technology, ultimately improving their quality of life.

How it works

The Mouseware device consists of small, lightweight movement-tracking sensors that are attached to a cap or headphones or an elastic band. These sensors are designed to capture and measure the movement of the user's head. The sensors are wireless and use Bluetooth technology to transmit the captured movement data to the host device. On the host device, such as a computer or smartphone, a dongle is connected which converts the captured movement data into mouse cursor coordinates in a Plug-and-Play model. For instance, if the user rotates their head to the right, the cursor will move towards the right side of the screen. To facilitate mouse clicks, the Mouseware device incorporates switches depending on user's physical ability. Example: Footswitch, strap-able switch & Dwell click for quadriplegic users. Mouseware also integrates speech-to-text technology to input text by speaking aloud, with the software converting their speech into written text on the screen.

Design process

Identifying need: Through extensive research and user interactions, we recognized that people required access to mouse cursor control, which was not adequately facilitated by existing assistive technologies such as speech-to-text engines or eye trackers which were either limited in application support or prohibitively expensive. Concept development: With a clear understanding of the problem, we began conceptualizing a device that could enable intuitive control of smart devices using head movements. The initial concept involved integrating the system within headphones, as it provided a convenient wearable form factor. Prototyping: While testing the initial headphone-based prototype, we realized that it posed a limitation by impeding the use of headphones for audio output. In response, we iterated on the design and developed a small sensor box that could be mounted on any headwear, like headphones, caps, or elastic band. Incorporating user feedback: During testing, we received valuable input from individuals who are neck-down paralysed who can't use physical switches. Based on this feedback, we improved the design by introducing a feature where the user needs to position the cursor on a specific location and keep it there for one second without any movement to initiate a click.

How it is different

Head Movement Control: Unlike many other assistive technologies, Mouseware tracks and translates head movements into precise mouse cursor coordinates, it offers an intuitive and natural way for users to interact with digital devices, eliminating the need for specialized equipment like eye trackers or complex gestures, making it accessible to a wider range of individuals. Versatility and Compatibility: The Mouseware device is designed to be versatile and compatible with various headwear options, including headphones, caps, and elastic bands. This device works on a Plug-and-Play model eliminating the installation of special software. Inclusive Clicking Options: While physical switches are available for users with hand dexterity, the introduction of Dwell click further enhances inclusivity. This unique feature enables individuals with quadriplegia or limited mobility below the neck to perform clicking actions with ease. This broadens our user base.

Future plans

I envision repurposing our patented technology for various applications that require gesture-based interaction. One of my key initiatives is the development of head movement-based wheelchair navigation, leveraging the same principles of tracking and translating head movements to control the wheelchair's movements. Furthermore, I am actively exploring finger gesture-based computer interaction. This would provide an alternative input method for individuals seeking a more immersive computing experience. My goal is to empower individuals by enhancing their independence and accessibility across various domains of life.

Awards

I am proud to have achieved several notable accolades and recognition from the United Nations in India & National Institute of Urban Affairs, YourStory, OPPO Inclusion team, TVS Capital Funds, IIT Madras & Google. I have also played a role in raising funds from Social Alpha, StartupTN & MeitY for my startup.