Giving troops on the ground the ability to confirm the identity of a target offers a value that goes without saying. Positive identification, in particular, matters when taking someone into custody, or confirming a high value target has been killed, and in both instances, there’s a good chance American troops will be tasked with making that confirmation under cover of darkness.

While there is technology developed specifically to assist in identifying targets, these systems rely on comparing visual cues to a database of images – something that requires the sort of excellent lighting that often isn’t available to special operations troops, particularly in environments that require light discipline.

It’s with these unique challenges in mind that the Army recently announced the development of a new system that utilizes artificial intelligence and a process known as “machine learning” to cross reference thermal imaging with traditional file photographs. While the process is complex, the product is simple: a means to verify a target’s identity in nighttime conditions.

“This technology enables matching between thermal face images and existing biometric face databases/watch lists that only contain visible face imagery,” said Dr. Benjamin S. Riggan, a research scientist assigned to the project. “The technology provides a way for humans to visually compare visible and thermal facial imagery through thermal-to-visible face synthesis.”

“Machine learning” is an artificial intelligence based form of data analysis that leverages a computer’s ability to identify patterns and make smart decisions with limited interference from a human operator. In other words, it’s a means of allowing a system to learn as it goes and make limited extrapolations based on the data available to it. That will allow the system to work to match visual cues on a target’s face, despite the source imagery and comparison files depicting images in different realms of the light spectrum.

When using thermal cameras to capture facial imagery, the main challenge is that the captured thermal image must be matched against a watch list or gallery that only contains conventional visible imagery from known persons of interest,” Riggan said.

“Therefore, the problem becomes what is referred to as cross-spectrum, or heterogeneous, face recognition. In this case, facial probe imagery acquired in one modality is matched against a gallery database acquired using a different imaging modality.”

A conceptual illustration for thermal-to-visible synthesis for interoperability with existing visible-based facial recognition systems. (Courtesy Eric Proctor, William Parks and Benjamin S. Riggan)

The system was first unveiled in a peer-reviewed paper released in March, entitled, “”Thermal to Visible Synthesis of Face Images using Multiple Regions.” Soon after publication, Army researchers gave a demonstration of the technology at the IEEE Winter Conference on Applications of Computer Vision, or WACV, in Lake Tahoe, Nevada.