Скачать или смотреть Physical Virtual Child: Healthy Patient Scenario

In collaboration with a team of computer scientists and healthcare educators from the College of Nursing and the College of Medicine at University of Central Florida, I developed a new class of Physical-Virtual Patient Simulators (PVPS). The PVPS consists of a mobile frame on which projectors, infrared cameras, infrared lights, speakers, tactile units (for pulse), and heater units for temperature are attached. The patient’s 3D shape is created using semi-transparent acrylic shell and the imagery is rear projected onto the surface of the physical shell. The shell is covered with a silicone material that allows the imagery to diffuse on the surface, allows for automated touch detection, and feels like skin in terms of texture and temperature. The virtual patient is modeled as a 3D character and programmed in the unity game engine to respond visually and verbally via animations. The visuals of the patient are sent to the projectors and rear projected on the physical shell (e.g., facial expressions, speech, blink, pupil reactions, joint movements). Localized speakers output the patient’s speech, and sounds (e.g., heart sounds, lung sounds), and the pulse is driven by an audio file sent to an acoustic haptic device. The temperature is controlled using multiple small heaters mounted to the frame. The infrared cameras can detect touch and send a signal to the simulation graphics engine to update the imagery in real time, allowing healthcare providers to perform touch sensing actions (e.g., capillary refill, tugging the lips/eyelids, detection of feeling on one side of the patient).

Patent
[1] Gregory F Welch, Gerd Bruder, Salam Daher, Jason Eric Hochreiter, Mindi A Anderson, Laura Gonzalez, Desiree A Diaz (2021). PHYSICAL-VIRTUAL PATIENT SYSTEM (US Patent App. 16/786,342) https://www.freepatentsonline.com/y20...

Publications
[2] Laura Gonzalez, Salam Daher, Gregory Welch. Neurological Assessment Using a Physical-Virtual Patient (PVP). Simulation and Gaming, Aug 2020.

[3] Salam Daher, Jason Hochreiter, Ryan Schubert, Laura Gonzalez, Juan Cendan, Mindi Anderson, Desiree A. Diaz, Gregory F Welch. Physical-Virtual Patient: A new patient simulator. Society of Simulation in Healthcare Journal, April 2020.

[4] Salam Daher, Jason Hochreiter, Ryan Schubert, Gerd Bruder, Laura Gonzalez, Juan Cendan, Mindi Anderson, Desiree A. Diaz, Gregory F Welch. Matching vs. Non-Matching Visuals and Shape for Embodied Virtual Healthcare Agents. IEEE Virtual Reality, March 2019, Osaka, Japan.

[5] Salam Daher, Laura Gonzalez, Jason Hochreiter, Nahal Norouzi, Gerd Bruder, Greg Welch.Touch-Aware Intelligent Physical-Virtual Agents for Healthcare Simulation. ACM Intelligent Virtual Agents, Nov 2018, Sydney, Australia.

[6] Jason Hochreiter, Salam Daher, Gerd Bruder, Gregory Welch. Cognitive and Touch Performance Effects of Mismatched 3D Physical and Visual Perceptions. IEEE Virtual Reality, March 2018, Germany.

[7] Salam Daher. Optical See-Through vs. Spatial Augmented Reality Simulators for Medical Applications. IEEE Virtual Reality, Mar 2017, Los Angeles, CA.

[8] Jason Hochreiter, Salam Daher, Arjun Nagendran, Laura Gonzalez, Greg Welch. Optical Touch Sensing on Non-Parametric Rear-Projection Surfaces for Interactive Physical-Virtual Experiences. Presence Journal, 2016