Augmented Reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are overlaid by virtual, computer generated objects. In this paper, AR is combined with haptics in order to observe human arm's stiffness. A haptic, hand-held device is used to measure the human arm's impedance. While a computer vision system tracks and records the position of the hand, a computer screen displays the impedance diagrams superimposed on the hand in a real-time video feed. The visual augmentation is also performed using a video projector that project's the diagrams on the hand as it moves. © 2012 IEEE.

We propose a tabletop keyboard that assists stroke patients in using computers. Using computers for purposes such as paying bills, managing bank accounts, sending emails, etc., which all include typing, is part of Activities of Daily Living (ADL) that stroke patients wish to recover. To date, stroke rehabilitation research has greatly focused on using computer-assisted technology for rehabilitation. However, working with computers as a skill that patients need to recover has been neglected. The conventional human computer interfaces are mouse and keyboard. Using keyboard stays the main challenge for hemiplegic stroke patients because typing is usually a bimanual task. Therefore, we propose an assistive tabletop keyboard which is not only a novel computer interface that is specially designed to facilitate patient-computer interaction but also a rehab medium through which patients practice the desired arm/hand functions. © 2013 Authors.

Introducing computer games to the rehabilitation market led to development of numerous Virtual Reality (VR) training applications. Although VR has provided tremendous benefit to the patients and caregivers, it has inherent limitations, some of which might be solved by replacing it with Augmented Reality (AR). The task of pick-and-place, which is part of many activities of daily living (ADL's), is one of the major affected functions stroke patients mainly expect to recover. We developed an exercise consisting of moving an object between various points, following a flash light that indicates the next target. The results show superior performance of subjects in spatial AR versus non-immersive VR setting. This could be due to the extraneous hand-eye coordination which exists in VR whereas it is eliminated in spatial AR.

We explore the differences of direct (DI) vs. indirect (IDI) interaction in stroke rehabilitation. Direct interaction is when the patients move their arms in reaction to changes in the augmented physical environment; indirect interaction is when the patients move their arms in reaction to changes on a computer screen. We developed a rehabilitation game in both settings evaluated by a within-subject study with 10 patients with chronic stroke, aiming to answer 2 major questions: (i) do the game scores in either of the two interaction modes correlate with clinical assessment scores? and (ii) whether performance is different using direct versus indirect interaction in patients with stroke. Our experimental results confirm higher performance in use of DI over IDI. They also suggest better correlation of DI and clinical scores. Our study provides evidence for the benefits of direct interaction therapies vs. indirect computer-assisted therapies in stroke rehabilitation.

In recent years, the field of Human-Computer Interaction (HCI) has been advanced with many technologies, however, most are limited to healthy users. In this paper, we leveraged the technology of free-hand interaction to rehabilitate patients with stroke. We modified the game of Fruit Ninja to use Leap Motion controller's hand tracking data for stroke patients with arm and hand weakness to practice their finger individuation. In a pilot study, we recruited 14 patients with chronic stroke to play the game using natural interaction. Their Fruit Ninja (FN) scores show high correlation with the standard clinical assessment scores such as Fugl-Meyer (FMA) and Box-and-Blocks Test (BBT) scores. This finding suggests that our freehand Fruit Ninja's score is a good indicator of the patient's hand function and therefore will be informative if used in their rehabilitation.