Ecological momentary assessment (EMA) is used to evaluate subjects behaviors and moods in their natural environments, yet collecting real-time and self-report data with EMA is challenging due to user burden. Integrating voice into EMA data collection platforms through todays intelligent virtual assistants (IVAs) is promising due to hands-free and eye-free nature. However, efficiently managing conversations and EMAs is non-trivial and time consuming due to the ambiguity of the voice input. We approach this problem by rethinking the data modeling of EMA questions and what is needed to deploy them on voice-first user interfaces. We propose a unified metadata schema that models EMA questions and the necessary attributes to effectively and efficiently integrate voice as a new EMA modality. Our schema allows user experience researchers to write simple rules that can be rendered at run-time, instead of having to edit the source code. We showcase an example EMA survey implemented with our schema, which can run on multiple voice-only and voice-first devices. We believe that our work will accelerate the iterative prototyping and design process of real-world voice-based EMA data collection platforms.

UNLABELLED: The Geriatrics 5Ms: Medications, Mind, Mobility, what Matters most and Multicomplexity is a framework to address the complex needs of older adults. Intelligent Voice Assistants (IVAs) are increasingly popular and have potential to support health-related needs of older adults. We utilized previously collected qualitative data on older adults views of how an IVA may address their health-related needs and ascertained their fit into the Geriatrics 5Ms framework. The codes describing health challenges and potential IVA solutions fit the framework: (1) Medications: difficulty remembering medications. SOLUTION: reminders. (2) Mind: isolation, anxiety, memory loss. SOLUTION: companionship, memory aids. (3) Mobility: barriers to exercise. SOLUTION: incentives, exercise ideas. (4) Matters most: eating healthy foods. SOLUTION: suggest and order nutritious foods, (5) Multicomplexity; managing multimorbidity. SOLUTION: symptom tracking and communicating with health care professionals. Incorporating the 5Ms framework into IVA design can aid in addressing health care priorities of older adults.

Voice-based Intelligent Virtual Assistants (IVAs) promise to improve healthcare management and Quality of Life (QOL) by introducing the paradigm of hands-free and eye-free interactions. However, there has been little understanding regarding the challenges for designing such systems for older adults, especially when it comes to healthcare related tasks. To tackle this, we consider the processes of care delivery and QOL enhancements for older adults as a collaborative task between patients and providers. By interviewing 16 older adults living independently or semi-independently and 5 providers, we identified 12 barriers that older adults might encounter during daily routine and while managing health. We ultimately highlighted key design challenges and opportunities that might be introduced when integrating voice-based IVAs into the life of older adults. Our work will benefit practitioners who study and attempt to create full-fledged IVA-powered smart devices to deliver better care and support an increased QOL for aging populations.