Скачать или смотреть Smart Real-Time Patient Simulation: AI-Driven ESP32 3D-Printed Manikin in Unity VR (Meta Quest 3)

This video demonstrates a smart real-time patient simulation system built around a 3D-printed medical manikin integrated with an ESP32 microcontroller and advanced sensor inputs.

The manikin streams live physiological and interaction data from the ESP32 to a Unity-based VR application via Bluetooth, running on Meta Quest 3, enabling immersive and responsive patient monitoring in virtual reality.

An AI layer powered by a local Ollama server is used to interpret sensor data, manage patient state changes, and generate dynamic, context-aware responses. This allows the simulated patient to react realistically to user actions, medical procedures, and environmental changes in real time.

The system is designed as a modular and extensible platform for:

medical training and simulation,

VR-based patient monitoring,

human–machine interaction research,

AI-assisted clinical scenario prototyping.

By combining embedded hardware, real-time data streaming, AI-driven logic, and VR visualization, this project explores the next generation of interactive medical simulation technologies.

🔧 Technologies Used

ESP32 microcontroller (real-time sensor data acquisition)
3D-printed medical manikin
Unity 3D (VR application and data visualization)
Meta Quest 3 (standalone VR headset)
AI inference via Ollama (local LLM-based decision layer)

Thin Film Pressure Sensor 20g-1.5kg Resistance
5g Micro Digital Servo
RP L‑110 Film Pressure Sensor
LDR Photo Light Sensitive Resistor 5516
Magnets for magnetics connector
Push button