Face-tracking algorithm for large-amplitude head motions with a 7-DOF manipulator

Abstract

Abstract The collection of facial action data is essential for the accurate evaluation of a patient’s condition in the intensive care unit, such as pain evaluation. An automatic face-tracking system is demanded to reduce the burden of data collection on the medical staff. However, many previous studies assume that the optimal trajectory of a robotic tracking system is reachable which is inapplicable for large-amplitude head motions. To tackle this problem, we propose a region-based face-tracking algorithm for large-amplitude head motion with a 7-DOF manipulator. A configuration-based optimization algorithm is proposed to trade-off between theoretical optimal pose and workspace constraints through the assignment of importance weights. To increase the probability of recapturing the face exceeding the reachable workspace of the manipulator, the camera is directed toward the center of the head, named the facial orientation center (FOC) constraint. Furthermore, a region-based tracking approach is designed to stabilize the manipulator for small amplitude head motions and smooth the tracking trajectory by adjusting the joint angle in the null space of the 7-DOF manipulator. Experimental results demonstrate the effectiveness of the proposed algorithm in tracking performance and finding an appropriate configuration for the unreachable theoretical optimal configuration. Moreover, the proposed algorithm with FOC constraint can successfully follow the head motion as losing 33.2% of the face during the tracking.