Back to projects

Speech · Real-time Mar 2024 to Mar 2025

Real-Time Speech AI (ASR / TTS)

Abstract.A speech interface for a client's internal data system, built at a corporate R&D lab.

Role
AI Engineer
Period
Mar 2024 to Mar 2025
Context
Electronics manufacturer, R&D lab (via Human Resocia)
Team
5
Table 1Results.
int8 CTranslate2 inference for low latency
Hands-free Register, edit and delete by voice
Integrated Into the client's existing application

01From problem to approach

The problem

Staff needed to register, edit and delete records without a keyboard, and recognition had to feel instant.

The approach

Run Faster-Whisper on int8 CTranslate2 for low latency, map transcripts to actions with string matching, and confirm every action out loud.

02How it works

  1. Input Voice input The user speaks a command; Streamlit records live audio.
  2. Step 02 ASR · Faster-Whisper Speech to text; int8 CTranslate2 keeps inference fast and light.
  3. Step 03 Intent matching String matching maps the transcript to a data action.
  4. Step 04 Data action Register, edit or delete a record, entirely hands-free.
  5. Step 05 TTS · VITS Synthesizes a spoken confirmation of the result.
  6. Output Audio response Auto-plays the response, closing the loop.
Fig. 1Real-Time Speech AI (ASR / TTS), step by step.

03What I built

  1. Shipped a hands-free voice data-entry system (register, edit and delete by voice) with Faster-Whisper ASR on int8 CTranslate2 for low-latency recognition and VITS text-to-speech read-back.
  2. Raised input accuracy with string matching and spoken confirmation.
  3. Built a Streamlit UI with live recording and auto-play, and resolved audio-library failures under WSL.
  4. Integrated the system into the client's existing application.

04Technologies

  • Python
  • PyTorch
  • Faster-Whisper
  • CTranslate2
  • VITS
  • ESPnet
  • Conformer
  • FastSpeech2
  • HiFi-GAN
  • Parallel WaveGAN
  • Streamlit

On request

Request my resume

I share my resume on request. Tell me a little about yourself, and I'll email it to you once I've reviewed your request.

I am a…

Which document?

0 / 100 words

Your details are used only to handle this request and are never shared.