Nigerian creates AI to address speech challenges

A graduate of Information Technology from the University of Derby in the United Kingdom, Omotayo Omoyemi, has developed an artificial intelligence tool that translates Makaton signs into written English in real time.

Makaton, a communication system that combines signs, symbols, and speech, is widely used by people with conditions such as autism, cerebral palsy, and stroke-related speech impairments.

In a statement made available to The PUNCH recently, Omoyemi said the tool was designed to break communication barriers and empower Makaton users in classrooms, hospitals, and everyday life.

“Imagine needing to communicate a basic request but being trapped because those around you don’t understand your signs,” he said. “This tool dismantles that barrier, giving users autonomy in education, healthcare, and social interactions.”

Unlike existing symbol-based apps that require manual input or rely on pre-selected vocabulary, Omoyemi’s system uses advanced computer vision to analyse live video streams.

It captures gestures, facial expressions, and signing nuances, converting them into text instantly. The tool is equipped with core vocabulary like “help”, “hungry”, and “thank you” and offers customisable features to reflect cultural and religious communication styles.

Omoyemi noted that the innovation incorporates safeguarding alerts to detect signs of distress, such as repeated gestures indicating discomfort, and includes sensory-friendly interfaces to support neurodiverse users.

It is also built for classroom use, with the ability to sync with educational platforms to enhance learning outcomes for students with communication challenges, he said.

“By prioritising universal design principles, this tool redefines what inclusive technology can achieve,” he said. “This groundbreaking research exemplifies the power of technology to drive social change. By merging IT expertise with a commitment to accessibility, the tool not only advances Makaton’s translation but also sets a precedent for future assistive innovations.”

Omoyemi said the tool was informed by extensive consultations with educators, caregivers, and Makaton users and features context-aware error correction and adaptive vocabulary modules to ensure inclusivity across diverse communities.

“As development progresses toward prototyping, this tool promises to unlock new possibilities for millions worldwide,” the statement read. “In a digitally evolving world, Omoyemi’s vision underscores a simple truth: inclusivity begins when everyone’s voice is heard.”