Gesture based Clinical Data Browsing for Patients and Medical Doctors

The Problem

·  Many disabled people cannot use keyboards and mouse.

·  A lot of solutions exist but they all are some kind of touch devices that need specific amount of pressure to be applied to a surface.

·  These solutions cannot be configured for every level of disability.

·  These solutions work for some people while they do not work for others, depending on each person’s type of disability.

·  Touch screens are also not convenient for many disabled people.

·  Gestures are used for occupational therapeutic movements

Solution

·  We have developed a solution to browse the internet using gestures.

·  We use smart sensors that detect gestures performed by the user with her hands in the air and convert them to mouse and keyboard clicks and events.

·  We can use different kind of devices to detect different kind of gestures and use them for browsing.

·  We can configure the gestures according to the type of disability of each user. Each user can select the gestures she feels most comfortable with and use them for the required tasks.

·  We can also configure the sensitivity of each gesture through software according to the level of disability of each patient.

Advantage

·  A patient can browse the internet easily without additional help.

·  We can configure the gestures according to the type of disability of each user. Each user can select the gestures she feels most comfortable with and use them for the required tasks.

·  We can also configure the sensitivity of each gesture through software according to the level of disability of each patient.

·  Doctors wearing gloves who cannot use a touch screen can use this technology to browse material on the screen, zoom in/out images etc.

Patents Related to this Demo

1. Physical Therapy with Mixed Reality

2. BCI (Brain Computer Interface) based VR (Virtual Reality) Therapy System for Paralyzed patients to recover muscle functions

3. Therapist-Assistant: Virtual Reality based Live Augmented Skeletal Therapy Management System

4. Mapping virtual 3d human model with the joint-motions of a disabled: a web-based 3d human model with natural user interface-based interaction capability for designing physical therapy

5. Immersive telepresence as occupational therapy for hemiplegic patients through VR technology

6. An electromyography (emg) signal and augmented reality based occupational hand therapy framework for people with hemiplegia

7. A gesture controlled mobile based camera-less smart home management solution for providing assisted living services to physically challenged individuals with low mobility

8. A non-invasive healthgis multimedia serious game therapy environment for providing ranges for motion of full-body joints to hemiplegic patient through forward and inverse kinematics

9. System and method for detecting and visualizing live kinetic and kinematic data for the musculoskeletal system

10. A web-based non-invasive way of detecting, tracking, recognizing and 3d visualizing live kinematic hand therapy data of hemiplegic patient