Back to projects
Voice-Based Email for Visually Impaired Users
Abstract.An email client that visually impaired users can operate entirely by voice.
- Role
- AI Developer Intern
- Period
- Jan to Jun 2023
- Context
- Digipodium, Inc. · Lucknow, India
- Team
- Solo
| ~90% | Speech recognition accuracy |
| ~50% | Less time per task |
01From problem to approach
The problem
Standard email clients assume you can see the screen and use a keyboard.
The approach
Guide the user with speech at every step, and turn spoken commands into email actions.
02How it works
- Input Voice login The user signs in by voice with email ID and password.
- Step 02 Speech → text SpeechRecognition turns spoken commands into text.
- Step 03 Choose an action Compose, inbox, sent or trash, all chosen by voice.
- Step 04 Gmail API Send and fetch email through the Gmail API.
- Output Audio feedback Reads results aloud and guides the next step.
03What I built
- Built speech-driven compose, send and read-aloud with Google Speech and Gmail APIs on Django.
- Implemented voice login and the inbox, sent and trash views.
- Wrote ER diagrams, functional and screen specifications, and test specifications.
04Technologies
- Python
- Django
- SpeechRecognition
- Gmail API
- JavaScript
- Bootstrap
- SQLite