Skip to main content
Open Access Publications from the University of California

Sleep pose recognition in an icu using multimodal data and environmental feedback

  • Author(s): Torres, C
  • Hammond, SD
  • Fried, JC
  • Manjunath, BS
  • Editor(s): Nalpantidis, Lazaros
  • Krüger, Volker
  • Eklundh, Jan-Olof
  • Gasteratos, Antonios
  • et al.

© Springer International Publishing Switzerland 2015. Clinical evidence suggests that sleep pose analysis can shed light onto patient recovery rates and responses to therapies. In this work, we introduce a formulation that combines features from multimodal data to classify human sleep poses in an Intensive Care Unit (ICU) environment. As opposed to the current methods that combine data from multiple sensors to generate a single feature, we extract features independently. We then use these features to estimate candidate labels and infer a pose. Our method uses modality trusts–each modality’s classification ability–to handle variable scene conditions and to deal with sensor malfunctions. Specifically, we exploit shape and appearance features extracted from three sensor modalities: RGB, depth, and pressure. Classification results indicate that our method achieves 100% accuracy (outperforming previous techniques by 6%) in bright and clear (ideal) scenes, 70% in poorly illuminated scenes, and 90% in occluded ones.

Many UC-authored scholarly publications are freely available on this site because of the UC's open access policies. Let us know how this access is important for you.

Main Content
Current View