bosonai-higgs-audio-v3-stt

Higgs-Audio-v3-STT is a high-performance automatic speech recognition (ASR) model developed by BosonAI. Built on a 1.7B parameter architecture, it delivers accurate transcription across 60+ languages with an OpenAI Whisper-compatible API interface.

Key Features

• Multilingual Support: Transcribes audio in 60+ languages including English, Chinese, Japanese, Korean, French, German, Spanish, and many more
• Voice Activity Detection (VAD): Built-in Silero VAD automatically segments audio, handling long recordings and multi-speaker scenarios
• Whisper-Compatible API: Drop-in replacement for OpenAI's Whisper API via the /v1/audio/transcriptions endpoint
• High Accuracy: Achieves competitive Word Error Rate (WER) on standard benchmarks

Model Architecture

The model uses a multi-component inference pipeline:

• HiggsAudio3: Core speech-to-text model (1.7B parameters)
• Whisper-large-v3-turbo: Audio feature extraction
• Silero VAD: Voice activity detection for audio segmentation
• vLLM: High-throughput serving engine for optimized inference

Intended Use

This model is designed for:

• Real-time and batch audio transcription
• Multilingual speech-to-text applications
• Call center transcription and analysis
• Meeting transcription and summarization
• Subtitle and caption generation
• Voice-powered search and indexing

API Format

The model exposes an OpenAI Whisper-compatible REST API:

POST /v1/audio/transcriptions
Content-Type: multipart/form-data

Parameters:
  - file: Audio file (required)
  - language: Language code (optional, auto-detected if not specified)

Supported Audio Formats

WAV, MP3, FLAC, OGG, M4A, and other common audio formats.

Hardware Requirements

• Minimum: 1x NVIDIA A100 80GB GPU
• Recommended SKU: Standard_NC24ads_A100_v4