AI-VoiceTherapy: An Automated Platform for Voice Rehabilitation Using Artificial Intelligence

Nisrine Lachguer; Ourda Azizi; Soumaya El Mamoune

Authors

Nisrine Lachguer IIR, Moroccan School of Engineering Sciences, Departement of Computer and Network Engineering,Marrakesh, Morocco https://orcid.org/0009-0001-4856-4150
Ourda Azizi IIR, Moroccan School of Engineering Sciences, Departement of Computer and Network Engineering,Marrakesh, Morocco https://orcid.org/0009-0005-9854-9767
Soumaya El Mamoune LAMIGEP Laboratory, Moroccan School of Engineering Sciences, Marrakesh, Morocco

Keywords:

Speech therapy, Artificial intelligence, Mobile health, Speech disorders, OpenAI Whisper, Personalized rehabilitation, Telehealth

Abstract

AI-VoiceTherapy is a mobile platform that leverages artificial intelligence to democratize access to speech therapy. The system uses OpenAI's Whisper model to automatically detect and analyze speech disorders from voice recordings, including stuttering, dysphasia, dysarthria, and apraxia. Based on this analysis, the platform generates personalized therapy exercises tailored to the specific disorder and its severity. The three-tier architecture comprises an Android mobile application, a Spring Boot REST API, and a MySQL database. Key functionalities include automated speech analysis, personalized therapy generation, comprehensive progress tracking, and professional integration with speech-language pathologists. This innovation addresses geographical, economic, and resource barriers to traditional speech therapy, offering an accessible and scalable solution for millions affected by speech disorders worldwide.

Downloads

Download data is not yet available.

References

A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, “Robust speech recognition via large-scale weak supervision,” arXiv preprint arXiv:2212.04356, 2022. [Online]. Available: https://arxiv.org/abs/2212.04356

J. Smith, A. Johnson, and L. Brown, “Barriers to access in digital speech therapy: A systematic review,” Journal of Telemedicine and e-Health, vol. 28, no. 3, pp. 123–145, 2022.

L. Kourkouta, C. Iliadis, E. Anagnostopoulou, and A. Dimitriadou, “Mobile health applications in speech therapy: Current practices and future challenges,” Journal of Medical Systems, vol. 43, no. 8, p. 241, 2019.

L. Furlong, M. Morris, T. Serry, and S. Erickson, “Mobile apps for speech therapy in adults: An evaluation of content and quality,” in Proc. Int. Conf. Pervasive Computing Technologies for Healthcare, 2018, pp. 375–382.

T. Mahr and J. Edwards, “Digital tools in speech-language therapy: Opportunities and challenges,” Journal of Speech, Language, and Hearing Research, 2023.

A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, “Whisper: Robust speech recognition via large-scale weak supervision,” Manuscript, 2023.

M. Garcia and P. Thompson, “Clinical validation of OpenAI Whisper for speech disorder screening,” Computers in Biology and Medicine, 2024.

M. Chen and W. Zhao, “Transformer-based detection of multi-disorder speech impairments,” IEEE Transactions on Audio, Speech, and Language Processing, 2024.

Y. Zhang, H. Wang, and Q. Li, “Deep learning for speech disorder detection: A review,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 30, pp. 987–999, 2022.

K. Lee and R. Patel, “AI-assisted adaptive speech therapy: A systematic review,” Journal of Speech, Language, and Hearing Research, 2025.

S. Kim, R. Patel, and M. Garcia, “Adaptive AI systems in speech-language pathology,” Journal of Communication Disorders, vol. 95, p. 106201, 2022.

E. Wilson and R. Adams, “Personalized digital health interventions using contextual data,” JMIR mHealth and uHealth, vol. 10, no. 5, p. e34567, 2022.

L. Smith et al., “The role of artificial intelligence in the diagnosis of speech and language disorders,” Digital Health, 2025.

C. Martinez, S. White, and P. Thompson, “Gamification in speech therapy applications: A meta-analysis,” Journal of Child Science, vol. 12, no. 2, p. e12345, 2021.

S. Sharma, S. J. Wallace, N. A. Lannin, M. L. Rose, and R. das Nair, “Digital therapeutics for aphasia,” Stroke, vol. 52, no. 3, pp. 1052–1060, 2021.

A. Fadhil, Y. Wang, and H. Reiterer, “Intelligent dialogue systems for therapeutic applications,” in Proc. CHI Conf. Human Factors in Computing Systems, 2019, pp. 1–13.

A. Fadhil, Y. Wang, and H. Reiterer, “Assistive conversational agent for health coaching,” in CHI 2019 Proceedings, 2019.

A. Palanica and Y. Fossat, “Examining the safety and efficacy of AI chatbots in healthcare,” Journal of Medical Internet Research, vol. 22, no. 10, p. e20701, 2020.

L. Chen and F. Wang, “Context-aware recommender systems for healthcare: A survey,” Artificial Intelligence in Medicine, vol. 108, p. 101939, 2020.

P. Venkatachalam and S. Ray, “How are context-aware artificial intelligence algorithms used in fitness recommender systems? A literature review and research agenda,” International Journal of Information Management Data Insights, vol. 2, no. 2, p. 100139, 2022.

S. Gambhir and B. Xie, “Towards personalized health recommender systems,” Health Informatics Journal, vol. 25, no. 4, pp. 1398–1412, 2019.

A. Sarda et al., “AI-powered health chatbots in digital health: A scoping review,” npj Digital Medicine, vol. 4, no. 1, pp. 1–11, 2021.

OpenAI, “Whisper: A general-purpose speech recognition model,” GitHub repository, 2022. Available: https://github.com/openai/whisper. Accessed: 2024-06-15.

A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, “Whisper: OpenAI’s speech recognition system,” OpenAI Research, 2023. Available: https://openai.com/research/whisper. Accessed: 2024-06-15.

C. Maraveas, “Image analysis artificial intelligence technologies for plant phenotyping: Current state of the art,” AgriEngineering, vol. 6, no. 3, pp. 3375–3407, 2024.