Our boutique software company was approached by a client who wanted to create a web-based language learning app for Vietnamese. The goal of the project was to develop a prototype that could accurately assess a user''s pronunciation and provide feedback on their speaking skills.
The main challenge faced by our team was capturing high-quality audio recordings of the user''s speech through the browser, and then processing it in real-time using a voice-to-text model. Additionally, we needed to ensure that the app could accurately compare the expected text with the generated text, and provide a score that reflected the user''s pronunciation accuracy.
To address these challenges, our team used a combination of cutting-edge technologies, including Web Audio API for audio recording and playback, and a cloud-based speech recognition service for voice-to-text processing. We also developed a custom algorithm to compare the expected text with the generated text, taking into account the nuances of the Vietnamese language.
Custom RESTful API for the Frontend
Node.js
Express.js
MySQL
React
HTML5
CSS3
Javascript
Open Source model deployed on cloud infrastructure
Custom RESTful API using FastAPI available only to the Backend
The prototype was successfully developed and tested with a group of users. The results showed that the app could accurately capture and process audio recordings, and provide feedback on pronunciation accuracy with an average score of 85%. User testing also revealed that the app was easy to use and provided valuable feedback for improving speaking skills.
The Vietnamese Language App prototype has the potential to revolutionize language learning for individuals around the world. By providing accurate and instant feedback on pronunciation, learners can improve their speaking skills more quickly and effectively. The app also has the potential to be used in educational institutions and language schools, providing a valuable tool for teachers and instructors.
The Vietnamese Language App prototype is an incredible tool for learning Vietnamese. The feedback on pronunciation accuracy is invaluable, and I've seen significant improvement in my speaking skills since using the app. - Jack London, Expat