Back to projects

Speech · Accessibility Jan to Jun 2023

Voice-Based Email for Visually Impaired Users

Abstract.An email client that visually impaired users can operate entirely by voice.

Role
AI Developer Intern
Period
Jan to Jun 2023
Context
Digipodium, Inc. · Lucknow, India
Team
Solo
Table 1Results.
~90% Speech recognition accuracy
~50% Less time per task

01From problem to approach

The problem

Standard email clients assume you can see the screen and use a keyboard.

The approach

Guide the user with speech at every step, and turn spoken commands into email actions.

02How it works

  1. Input Voice login The user signs in by voice with email ID and password.
  2. Step 02 Speech → text SpeechRecognition turns spoken commands into text.
  3. Step 03 Choose an action Compose, inbox, sent or trash, all chosen by voice.
  4. Step 04 Gmail API Send and fetch email through the Gmail API.
  5. Output Audio feedback Reads results aloud and guides the next step.
Fig. 1Voice-Based Email for Visually Impaired Users, step by step.

03What I built

  1. Built speech-driven compose, send and read-aloud with Google Speech and Gmail APIs on Django.
  2. Implemented voice login and the inbox, sent and trash views.
  3. Wrote ER diagrams, functional and screen specifications, and test specifications.

04Technologies

  • Python
  • Django
  • SpeechRecognition
  • Gmail API
  • JavaScript
  • Bootstrap
  • SQLite

On request

Request my resume

I share my resume on request. Tell me a little about yourself, and I'll email it to you once I've reviewed your request.

I am a…

Which document?

0 / 100 words

Your details are used only to handle this request and are never shared.