Oxford University researchers have come up with a computer program that recognizes facial features in photographs; looks for similarities with facial structures for various conditions, such as Down’s syndrome, Angelman syndrome, or Progeria; and returns possible matches ranked by likelihood.
Using the latest in computer vision and machine learning, the algorithm increasingly learns what facial features to pay attention to and what to ignore from a growing bank of photographs of people diagnosed with different syndromes.
The researchers report their findings in the journal eLife.
While genetic disorders are each individually rare, collectively these conditions are thought to affect 1 person in 17. Of these, a third may have symptoms that greatly reduce quality of life. However, most people fail to receive a genetic diagnosis.
“A diagnosis of a rare genetic disorder can be a very important step. It can provide parents with some certainty and help with genetic counselling on risks for other children or how likely a condition is to be passed on,” says lead researcher Dr. Christoffer Nellåker of the MRC Functional Genomics Unit at the University of Oxford. “A diagnosis can also improve estimates of how the disease might progress, or show which symptoms are caused by the genetic disorder and which are caused by other clinical issues that can be treated.”
The team of researchers at the University of Oxford included first author Quentin Ferry, a DPhil research student, and Prof. Andrew Zisserman of the Department of Engineering Science, who brought expertise in computer vision and machine learning.
“It is great to see such an inventive and beneficial use of modern face representation methods,” says Zisserman.
Identifying a suspected developmental disorder tends to require clinical geneticists to come to a conclusion based on facial features, follow up tests and their own expertise. It’s thought that 30–40 percent of rare genetic disorders involve some form of change in the face and skull, possibly because so many genes are involved in development of the face and cranium as a baby grows in the womb.
The researchers set out to teach a computer to carry out some of the same assessments objectively.
They developed a program that – like Google, Picasa and other photo software – recognizes faces in ordinary, everyday photographs. The programme accounts for variations in lighting, image quality, background, pose, facial expression and identity. It builds a description of the face structure by identifying corners of eyes, nose, mouth and other features, and compares this against what it has learnt from other photographs fed into the system.
The algorithm the researchers have developed sees patients sharing the same condition automatically cluster together.
The computer algorithm does better at suggesting a diagnosis for a photo where it has previously seen lots of other photos of people with that syndrome, as it learns more with more data.
Patients also cluster where no documented diagnosis exists, potentially helping in identifying ultra-rare genetic disorders.
“A doctor should in future, anywhere in the world, be able to take a smartphone picture of a patient and run the computer analysis to quickly find out which genetic disorder the person might have,” says Nellåker.
“This objective approach could help narrow the possible diagnoses, make comparisons easier and allow doctors to come to a conclusion with more certainty.”