An Intelligent System for Automated Monitoring and Control of Patient Conditions
Real-time IR-RGB fusion for contactless temperature screening with face identification, on-device logging (SQLite), alerts, and compact 3D-printed enclosure
Please see our paper for additional details on the project. (pdf link here)
Abstract
This paper presents a contactless temperature monitoring and patient identification system intended to meet stringent sanitary requirements in modern healthcare. By integrating a Raspberry Pi 4, an MLX90640 thermal sensor accurate to ±1 °C, and a Pi Camera Module 2 with 90–95% face recognition accuracy, it enables rapid, noninvasive detection of abnormal temperatures while minimizing staff-patient contact. The sensor’s 24 × 32 infrared array is fused with RGB frames for temperature assessment and identity verification. Controlled trials at ambient temperatures of 16 °C, 24 °C, and 26 °C consistently record ~33 °C on healthy foreheads, closely matching results from standard infrared thermometers. Minor temperature reductions occur with increasing distance, highlighting the need for proper alignment. Automated logging in a local SQLite database streamlines clinical workflows, allowing immediate retrieval of recorded data. Additionally, the approach significantly lowers staff workload by automating identification tasks, promoting safer, more efficient procedures. The findings underscore cost-effectiveness and scalability for continuous screening in diverse clinical environments, while reducing cross-contamination risks through rapid, contactless operation. Future efforts will broaden the dataset for enhanced algorithmic robustness, incorporate multi-parameter assessments of vital signs, and refine sensor calibration across variable conditions. Overall, this solution offers a promising avenue toward improved operational efficiency and infection control, aligning with contemporary standards for data-driven medical practice.
Paper PDF
Key Features
Real-time Temperature Monitoring
Contactless temperature screening using advanced thermal imaging technology with high accuracy and reliability.
Face Identification
Advanced computer vision algorithms for reliable patient identification and tracking across different conditions.
IR-RGB Fusion
Sophisticated sensor fusion combining thermal and visual data for enhanced monitoring capabilities.
Real-time Processing
Low-latency processing pipeline optimized for immediate response and alert generation.
One more thing
Thermal Image Enhancement (Optional Research Extension)
We additionally experiment with improving thermal image quality using unsupervised, step-wise CycleGAN super-resolution. This section is optional and does not affect the minimal demos. Reference inspiration: Thermal Image Super-resolution: A Novel Architecture and Dataset — PDF.
pix2pix Training Timeline (Epochs)
We visualize the training progression of the enhancement model (pix2pix) over recent epochs.
