Wang, Hao and Ahn, Euijoon and Joseph, Andrew and Pathan, Faraz and Negishi, Kazuaki and Kim, Jinman (2026) GVT2RPM: An empirical study for general video transformer adaptation to remote physiological measurement. Biomedical Signal Processing and Control, 113. ISSN 17468094
Full text not available from this repository.Abstract
Remote physiological measurement (RPM) is an essential tool for healthcare monitoring as it enables the measurement of physiological signs, e.g., heart rate, in a remote setting, via physical wearables. Recent advancements in facial video-based RPMs have leveraged video analysis to detect photoplethysmographic (PPG) changes by learning pixel variations across frames. Transformer architectures, known for their success in natural video understanding, have also been applied to facial video-based RPM. However, existing transformer-based RPM methods often rely on RPM-specific modules, such as temporal difference convolutions and handcrafted feature maps, to capture subtle physiological signals and enhance temporal feature extraction. While these customized modules can improve performance, they lack robustness across datasets and cannot be generalized to different transformer architectures due to their high degree of customization. In this study, we demonstrate that general video transformers (GVTs) can achieve state-of-the-art performance for RPM without the need of RPM-specific modules. This approach simplifies the design process and facilitates the rapid deployment of various GVT architectures for RPM tasks. We conducted an empirical investigation into how training designs, including data preprocessing and network configurations, influence the performance of GVTs in facial video-based RPM. Furthermore, we propose practical guidelines to adapt GVTs to RPM (GVT2RPM) without the need for RPM-specific modules. Our experiments, conducted on five datasets using both intra-dataset (training and testing on the same dataset) and cross-dataset (training and testing on different datasets) settings, demonstrate that the proposed GVT2RPM guidelines outperform existing RPM-specific counterparts in most of cases. In intra-dataset experiments, it reduced mean absolute error by 5.0 (UBFC-rPPG), 35.6 (MMPD-simple), and 38.2 (MMPD). In cross-dataset experiments, it achieved reductions of 4.3 (UBFC-Phys), 13.2 (MMPD-simple), 9.5 (MMPD), and 13.4 (RLAP). The results demonstrate that our guidelines can be applied across various GVT architectures and are robust to diverse datasets, making them a promising solution for advancing RPM methodologies. © 2025 The Author(s)
| Item Type: | Article |
|---|---|
| Additional Information: | Cited by: 2; All Open Access, Hybrid Gold Open Access |
| Keywords: | Architecture; Convolution; Data reduction; Physiological models; Physiology; Pixels; Software architecture; Statistical tests; Video analysis; Wearable technology; Empirical studies; Healthcare monitoring; Heart-rate; Human facial video analyze; Measurements of; Physiological measurement; Remote physiological measurement; Simple++; Training and testing; Video analysis; adaptation; architecture; Article; controlled study; convolutional neural network; empiricism; experimental protocol; head movement; health care; heart rate; human; mean absolute error; practice guideline; remote physiological measurement; separation technique; transfer of learning; videorecording; Network architecture |
| Subjects: | R Medicine > R Medicine (General) |
| Depositing User: | Repository Administrator |
| Date Deposited: | 04 Sep 2026 05:48 |
| Last Modified: | 04 Sep 2026 05:48 |
| URI: | http://eprints.victorchang.edu.au/id/eprint/1833 |
Actions (login required)
 |
View Item |