Skip to main content
eScholarship
Open Access Publications from the University of California

Electrical Engineering and Computer Science - Open Access Policy Deposits

This series is automatically populated with publications deposited by UC Irvine Samueli School of Engineering Electrical Engineering and Computer Science researchers in accordance with the University of California’s open access policies. For more information see Open Access Policy Deposits and the UC Publication Management System.

Cover page of Foundation metrics for evaluating effectiveness of healthcare conversations powered by generative AI

Foundation metrics for evaluating effectiveness of healthcare conversations powered by generative AI

(2024)

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will probably drive this patient-centered transformation in healthcare. Through the provision of various services, including diagnosis, personalized lifestyle recommendations, dynamic scheduling of follow-ups, and mental health support, the objective is to substantially augment patient health outcomes, all the while mitigating the workload burden on healthcare providers. The life-critical nature of healthcare applications necessitates establishing a unified and comprehensive set of evaluation metrics for conversational models. Existing evaluation metrics proposed for various generic large language models (LLMs) demonstrate a lack of comprehension regarding medical and health concepts and their significance in promoting patients’ well-being. Moreover, these metrics neglect pivotal user-centered aspects, including trust-building, ethics, personalization, empathy, user comprehension, and emotional support. The purpose of this paper is to explore state-of-the-art LLM-based evaluation metrics that are specifically applicable to the assessment of interactive conversational models in healthcare. Subsequently, we present a comprehensive set of evaluation metrics designed to thoroughly assess the performance of healthcare chatbots from an end-user perspective. These metrics encompass an evaluation of language processing abilities, impact on real-world clinical tasks, and effectiveness in user-interactive conversations. Finally, we engage in a discussion concerning the challenges associated with defining and implementing these metrics, with particular emphasis on confounding factors such as the target audience, evaluation methods, and prompt techniques involved in the evaluation process.

Cover page of ChatDiet: Empowering personalized nutrition-oriented food recommender chatbots through an LLM-augmented framework

ChatDiet: Empowering personalized nutrition-oriented food recommender chatbots through an LLM-augmented framework

(2024)

The profound impact of food on health necessitates advanced nutrition-oriented food recommendation services. Conventional methods often lack the crucial elements of personalization, explainability, and interactivity. While Large Language Models (LLMs) bring interpretability and explainability, their standalone use falls short of achieving true personalization. In this paper, we introduce ChatDiet, a novel LLM-powered framework designed specifically for personalized nutrition-oriented food recommendation chatbots. ChatDiet integrates personal and population models, complemented by an orchestrator, to seamlessly retrieve and process pertinent information. The personal model leverages causal discovery and inference techniques to assess personalized nutritional effects for a specific user, whereas the population model provides generalized information on food nutritional content. The orchestrator retrieves, synergizes and delivers the output of both models to the LLM, providing tailored food recommendations designed to support targeted health outcomes. The result is a dynamic delivery of personalized and explainable food recommendations, tailored to individual user preferences. Our evaluation of ChatDiet includes a compelling case study, where we establish a causal personal model to estimate individual nutrition effects. Our assessments, including a food recommendation test showcasing a 92% effectiveness rate, coupled with illustrative dialogue examples, underscore ChatDiet's strengths in explainability, personalization, and interactivity.

Cover page of Physiological and emotional assessment of college students using wearable and mobile devices during the 2020 COVID-19 lockdown: An intensive, longitudinal dataset

Physiological and emotional assessment of college students using wearable and mobile devices during the 2020 COVID-19 lockdown: An intensive, longitudinal dataset

(2024)

This dataset was collected from university students before, during, and after the COVID-19 lockdown in Southern California. Data collection happened continuously for the average of 7.8 months (SD=3.8, MIN=1.0, MAX=13.4) from a population of 21 students of which 12 have also completed an exit survey, and 7 started before the California COVID-19 lockdown order. This multimodal dataset included different means of data collection such as Samsung Galaxy Watch, Oura Ring, a Life-logger app named Personicle, a questionnaire mobile app named Personicle Questions, and periodical and personalised surveys. The dataset contains raw data from Photoplethysmogram (PPG), Inertial measurement unit (IMU), and pressure sensors in addition to processed data on heart rate, heart rate variability, sleep (bedtime, sleep stages, quality), and physical activity (step, active calories, type of activity). Ecological momentary assessments were collected from participants on daily and weekly bases containing their Positive and Negative Affect Schedule (PANAS) questionnaire and their emotional responses to COVID-19 and their health. Subjective data was also collected through monthly surveys containing standard mood and mental health surveys such as Beck Depression Inventory II (BDI-II), Brief Symptom Inventory (BSI), GAD-7, Inclusion of Other in the Self Scale (IOS-Partner), Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), Feasibility of Intervention Measure (FIM), Experiences in Close Relationships Scale Short Form (ECR-S), UCLA Three-Item Loneliness Scale (ULS), Multidimensional Scale of Perceived Social Support (MSPSS), Investment Model Scale (IMS), Conflict Management Scale (CMS), etc in addition to their response to important events and COVID-19. This dataset can be used to study emotions, mood, physical activity, and lifestyle of young adults through longitudinal subjective and objective measures. This dataset also contains valuable data regarding adjustment of lifestyle and emotions during the events of 2020 and 2021 including COVID-19 discovery and lockdown, Black Life Matter movement, 2020 US presidential elections, etc. On average, participants engaged in the EMA collection study at a rate of 86% (SD=10, MIN=65, MAX=99). Smartwatch usage saw an average participation rate of 51% (SD=20, MIN=16, MAX=88), while engagement with the Oura ring averaged at 85% (SD=12, MIN=60, MAX=99).

Sensing and Communication in UAV Cellular Networks: Design and Optimization

(2024)

Recently, the use of uncrewed aerial vehicles (UAVs) in joint sensing and communication applications has received a lot of attention. However, integrating UAVs in current cellular systems presents major challenges related to trajectory optimization and interference management among others. This paper considers a multi-cell network including a UAV, which senses and forwards the sensory data from different events to the central base station. Particularly, the current manuscript covers how to design the UAV's ({i} ) 3D trajectory, (ii) power allocation, and (iii) sensing scheduling such that (a) a set of events are sensed, (b) interference to neighboring cells is kept at bay, and (c) the amount of energy required by the UAV is minimized. The resulting nonconvex optimization problem is tackled through a combination of ({i} ) low-complexity binary optimization, (ii) successive convex approximation, and (iii) the Lagrangian method. Simulation results over a range of various key parameters have shown the merits of our approach, which consumes 33%-200% less energy compared to different benchmarks.

Cover page of Photon-Momentum-Enabled Electronic Raman Scattering in Silicon Glass

Photon-Momentum-Enabled Electronic Raman Scattering in Silicon Glass

(2024)

The nature of enhanced photoemission in disordered and amorphous solids is an intriguing question. A point in case is light emission in porous and nanostructured silicon, a phenomenon that is still not fully understood. In this work, we study structural photoemission in heterogeneous cross-linked silicon glass, a material that represents an intermediate state between the amorphous and crystalline phases, characterized by a narrow distribution of structure sizes. This model system shows a clear dependence of photoemission on size and disorder across a broad range of energies. While phonon-assisted indirect optical transitions are insufficient to describe observable emissions, our experiments suggest these can be understood through electronic Raman scattering instead. This phenomenon, which is not commonly observed in crystalline semiconductors, is driven by structural disorder. We attribute photoemission in this disordered system to the presence of an excess electron density of states within the forbidden gap (Urbach bridge) where electrons occupy trapped states. Transitions from gap states to the conduction band are facilitated through electron-photon momentum matching, which resembles Compton scattering but is observed for visible light and driven by the enhanced momentum of a photon confined within the nanostructured domains. We interpret the light emission in structured silicon glass as resulting from electronic Raman scattering. These findings emphasize the role of photon momentum in the optical response of solids that display disorder on the nanoscale.

Cover page of Real-time cavitation monitoring during optical coherence tomography guided photo-mediated ultrasound therapy of the retina

Real-time cavitation monitoring during optical coherence tomography guided photo-mediated ultrasound therapy of the retina

(2024)

Photo-mediated ultrasound therapy (PUT) is a novel antivascular therapeutic modality based on cavitation-induced bioeffects. During PUT, synergistic combinations of laser pulses and ultrasound bursts are used to remove the targeted microvessels selectively and precisely without harming nearby tissue. In the current study, an integrated system combining PUT and spectral domain optical coherence tomography (SD-OCT) was developed, where the SD-OCT system was used to guide PUT by detecting cavitation in real time in the retina of the eye.

Method

We first examined the capability of SD-OCT in detecting cavitation on a vascular-mimicking phantom and compared the results with those from a passive cavitation detector. The performance of the integrated system in treatment of choroidal microvessels was then evaluated in rabbit eyes in vivo.

Results

During the in vivo PUT experiments, several biomarkers at the subretinal layer in the rabbit eye were identified on OCT images. The findings indicate that, by evaluating biomarkers of treatment effect, real-time SD-OCT monitoring could help to avoid micro-hemorrhage, which is a potential major side effect.

Conclusion

Real-time OCT monitoring can thus improve the safety and efficiency of PUT in removing the retinal and choroidal microvasculature.

Cover page of HyperXite 9

HyperXite 9

(2024)

The overall objective for HyperXite 9 was to design and build a more robust, and reliable pod, capable of proving the feasibility of a high-speed transportation system. We are working to improve a linear induction motor as the pod's propulsion system. We are also designing and implementing a thermal cooling system to actively dissipate the heat generated by this propulsion system. Our team is comprised of the following 7 subteams: Static Structures, Braking & Pneumatics, Dynamic Structures, Propulsion, Power Systems, Control Systems, and Outreach.