High-Frequency, Device-Free mmWave Facial Landmark Sensing

Background:

MicroFace introduces a novel mmWave-based system for high-resolution, non-contact facial landmark tracking.  This system addresses the existing challenge of precise and efficient facial sensing without physical contact, a key issue in human-computer interaction and various applications requiring detailed facial expression analysis.

Technology Overview:

MicroFace utilizes millimeter wave (mmWave) technology to sense and track 68 facial landmarks at a high sampling rate of 2667 Hz with minimal delay of 48 ms.  By employing a deep learning model to process high-frequency RF signals, it achieves fine-grained tracking and real-time 3D human mesh construction.  This University at Buffalo technology offers a significant improvement over previous non-contact methods by providing high accuracy, precision, and seamless integration into existing facial expression analytical pipelines.

Advantages:

MicroFace provides a device-free, non-contact solution with high precision, privacy-preserving capabilities, and a high time resolution of 2667 Hz.  It integrates seamlessly with established analytical pipelines.

Applications:

• Gaming
• Virtual reality
• Security
• Healthcare

Intellectual Property Summary:

Provisional patent application 63/645,108 filed May 9, 2024.

Stage of Development:

Technology Readiness Level (TRL): 5.

Licensing Status:

Available for licensing or collaboration.

Figure 1.