An Intelligent System for Automated Monitoring and Control of Patient Conditions

Real-time IR-RGB fusion for contactless temperature screening with face identification, on-device logging (SQLite), alerts, and compact 3D-printed enclosure

🏆 Presented at AIR 2025

Please see our paper for additional details on the project. (pdf link here)

Abstract

This paper presents a contactless temperature monitoring and patient identification system intended to meet stringent sanitary requirements in modern healthcare. By integrating a Raspberry Pi 4, an MLX90640 thermal sensor accurate to ±1 °C, and a Pi Camera Module 2 with 90–95% face recognition accuracy, it enables rapid, noninvasive detection of abnormal temperatures while minimizing staff-patient contact. The sensor’s 24 × 32 infrared array is fused with RGB frames for temperature assessment and identity verification. Controlled trials at ambient temperatures of 16 °C, 24 °C, and 26 °C consistently record ~33 °C on healthy foreheads, closely matching results from standard infrared thermometers. Minor temperature reductions occur with increasing distance, highlighting the need for proper alignment. Automated logging in a local SQLite database streamlines clinical workflows, allowing immediate retrieval of recorded data. Additionally, the approach significantly lowers staff workload by automating identification tasks, promoting safer, more efficient procedures. The findings underscore cost-effectiveness and scalability for continuous screening in diverse clinical environments, while reducing cross-contamination risks through rapid, contactless operation. Future efforts will broaden the dataset for enhanced algorithmic robustness, incorporate multi-parameter assessments of vital signs, and refine sensor calibration across variable conditions. Overall, this solution offers a promising avenue toward improved operational efficiency and infection control, aligning with contemporary standards for data-driven medical practice.

Paper PDF

Key Features

🌡️

Real-time Temperature Monitoring

Contactless temperature screening using advanced thermal imaging technology with high accuracy and reliability.

👤

Face Identification

Advanced computer vision algorithms for reliable patient identification and tracking across different conditions.

🔗

IR-RGB Fusion

Sophisticated sensor fusion combining thermal and visual data for enhanced monitoring capabilities.

Real-time Processing

Low-latency processing pipeline optimized for immediate response and alert generation.

One more thing

Thermal Image Enhancement (Optional Research Extension)

We additionally experiment with improving thermal image quality using unsupervised, step-wise CycleGAN super-resolution. This section is optional and does not affect the minimal demos. Reference inspiration: Thermal Image Super-resolution: A Novel Architecture and DatasetPDF.

pix2pix Training Timeline (Epochs)

We visualize the training progression of the enhancement model (pix2pix) over recent epochs.

Open full resolution →