麻豆传媒

BUFFALO, N.Y. – A new 麻豆传媒o-led study outlines how artificial intelligence-powered handwriting analysis may serve as an early detection tool for dyslexia and dysgraphia among young children.

The work, presented in the journal , aims to augment current screening tools which are effective but can be costly, time-consuming and focus on only one condition at a time.

It could eventually be a salve for the nationwide shortage of speech-language pathologists and occupational therapists, who each play a key role in diagnosing dyslexia and dysgraphia.

“Catching these neurodevelopmental disorders early is critically important to ensuring that children receive the help they need before it negatively impacts their learning and socio-emotional development. Our ultimate goal is to streamline and improve early screening for dyslexia and dysgraphia, and make these tools more widely available, especially in underserved areas,”  says the study’s corresponding author Venu Govindaraju, PhD, SUNY Distinguished Professor in the Department of Computer Science and Engineering at UB.

The work is part of the National AI Institute for Exceptional Education, which is a UB-led research organization that develops AI systems that identify and assist young children with speech and language processing disorders.

Builds upon previous handwriting recognition work

Decades ago, Govindaraju and colleagues did groundbreaking work employing machine learning, natural language processing and other forms of AI to analyze handwriting, an advancement the U.S. Postal Service and other organizations still use to automate the sorting of mail.

The new study proposes similar a framework and methodologies to identify spelling issues, poor letter formation, writing organization problems and other indicators of dyslexia and dysgraphia.

It aims to build upon prior research, which has focused more on using AI to detect dysgraphia (the less common of the two conditions) because it causes physical differences that are easily observable in a child’s handwriting. Dyslexia is more difficult to spot this way because it focuses more on reading and speech, though certain behaviors like spelling offers clues.

The study also notes there is a shortage of handwriting examples from children to train AI models with.

Collecting samples from K-5 students

To address these challenges, a team of UB computer scientists led by Govindaraju gathered insight from teachers, speech-language pathologists and occupational therapists to help ensure the AI models they’re developing are viable in the classroom and other settings.

“It is critically important to examine these issues, and build AI-enhanced tools, from the end users’ standpoint,” says study co-author Sahana Rangasrinivasan, a dual PhD student in UB’s Department of Computer Science and Engineering and Amrita Vishwa Vidyapeetham in India.

The team also partnered with study co-author Abbie Olszewski, PhD, associate professor in literacy studies at the University of Nevada, Reno, who co-developed the Dysgraphia and Dyslexia Behavioral Indicator Checklist (DDBIC) to identify symptoms overlapping between dyslexia and dysgraphia.

The team collected paper and tablet writing samples from kindergarten through 5th grade students at an elementary school in Reno. This part of the study was approved by an ethics board, and the data was anonymized to protect student privacy.

They will use this data to further validate the DDBIC tool, which focuses on 17 behavioral cues that occur before, during and after writing; train AI models to complete the DDBIC screening process; and compare how effective the models are compared to people administering the test.

Work emphasizes AI for public good

The study describes how the team’s models can be used to:

• Detect motor difficulties by analyzing writing speed, pressure and pen movements.
• Examine visual aspects of handwriting, including letter size and spacing.
• Convert handwriting to text, spotting misspellings, letter reversals and other errors.
• Identify deeper cognitive issues based on grammar, vocabulary and other factors.

Finally, it discusses a tool that combines all these models, summarizes their findings, and provides a comprehensive assessment.

“This work, which is ongoing, shows how AI can be used for the public good, providing tools and services to people who need it most,” says study co-author Sumi Suresh, PhD, a postdoctoral research associate at UB and assistant professor at Amrita Vishwa Vidyapeetham in India.

Additional co-authors include Bharat Jayarman, PhD, director of the Amrita Institute of Advanced Research and professor emeritus in the UB Department of Computer Science and Engineering; and Srirangaraj Setlur, principal research scientist at the UB Center for Unified Biometrics and Sensors.