Hi everyone! I created a very cool web app called Munio. The goal is to improve your English conversation skills using AI! This version of the app is fully open source, and you can check it using link below.
Motivation
Google recently launched a competition to develop something using Gemini AI. I decided to create something useful with tools that piqued my curiosity. I combined all of these tools and products to develop this web app.
Here are the main tools that I have used:
- NestJS
- Angular 18
- Knex
- WebSockets
- Google Products (Gemini, GCS, TTS and Google Infra solutions)
- various others…
How the app works
Here is a showcase video:
the app’s goal is to enhance your conversation skills through speaking exercises. Currently, there are two modes: session and conversation.
The session mode
In this mode, you choose preferences such as context and level. These preferences are used to generate phrases with AI.
After starting a session, your goal is to repeat the requested phrase. AI analyzes your audio and provides feedback.
At the end of the session, AI generates overall feedback, helping you understand what to improve and encouraging you to try again!
The conversation mode
In this mode, like in session mode, you choose preferences, and AI uses them to generate a simulated conversation. To enhance the user experience, we use WebSockets to ensure fluid interaction.
After starting a conversation, AI decides whether you or the AI will speak first.
- If it’s your turn to speak, you need to say the requested phrase. AI analyzes your audio and generates feedback.
- If it’s AI’s turn to speak, we use Google Cloud Speech To Text to generate audio with the requested phrase, which you can listen to.
- The conversation alternates between steps 1 and 2 until the end. Once the conversation is complete, AI generates overall feedback, highlighting areas for improvement.
Open Source
This version of the app is fully open source and free. You can collaborate or self-host it! =)
Me:
Thanks
Thank you for reading this post. If you have any feedback, please let me know in the comments or at feedback@gabrielsena.dev
Source link
lol
