Gesture based map browsing for physically challenged

The Problem

·  Map browsing is a common activity, especially while on the road. Many disabled people cannot browse maps because their hands are busy while managing wheel chairs or other specially crafted driving contraptions.

·  Interacting with maps while driving is dangerous for normal people also, even while using touch screens.

·  Different people have different kinds of disabilities and hence most of the specialized hardware devised for people with a particular disability does not work for other people.

·  Touch screens are also not convenient for many people.

The Solution

·  We have developed a solution to browse maps using gestures.

·  We use smart sensors that detect gestures performed by the user with her hands in the air and convert them to map browsing actions.

·  We can use different kind of devices to detect different kind of gestures and use them for map browsing.

·  We can also configure the sensitivity of each gesture through software according to the level of disability of each patient.

The Advantage

·  A patient can browse maps easily without additional help.

·  We can configure the gestures according to the type of disability of each user. Each user can select the gestures she feels most comfortable with and use them for the required tasks.

·  We can also configure the sensitivity of each gesture through software according to the level of disability of each patient.

·  The solution is helpful for both disabled and normal people.

Patents Related to this Demo

1. Physical Therapy with Mixed Reality

2. BCI (Brain Computer Interface) based VR (Virtual Reality) Therapy System for Paralyzed patients to recover muscle functions

3. Therapist-Assistant: Virtual Reality based Live Augmented Skeletal Therapy Management System

4. A serious game generator for disability persons based on patient disability level and/or therapist recommendation using non-invasive motion sensors

5. Gestpass: a multimodal gesture-based login system for providing assisted living services to physically challenged individuals

6. Mapping virtual 3d human model with the joint-motions of a disabled: a web-based 3d human model with natural user interface-based interaction capability for designing physical therapy

7. Immersive telepresence as occupational therapy for hemiplegic patients through VR technology

8. An electromyography (emg) signal and augmented reality based occupational hand therapy framework for people with hemiplegia

9. A gesture controlled mobile based camera-less smart home management solution for providing assisted living services to physically challenged individuals with low mobility

10. A non-invasive healthgis multimedia serious game therapy environment for providing ranges for motion of full-body joints to hemiplegic patient through forward and inverse kinematics

11. System and method for detecting and visualizing live kinetic and kinematic data for the musculoskeletal system

12. A web-based non-invasive way of detecting, tracking, recognizing and 3d visualizing live kinematic hand therapy data of hemiplegic patient