OpenAI gpt-4o-mini-audio-preview
Version: 2024-12-17
The GPT-4o-mini-audio-preview model introduces a smaller, lower cost model to power asynchronous audio applications. Like GPT-4o -audio-preview, GPT-4o-mini-audio-preview provides a richer and more engaging user experience, at a fraction of the cost.
Note: For customers interested in lower latency audio responses, gpt-4o-mini-realtime-preview may still be more suitable
These audio features can be utilized in various ways:
- Create spoken summaries from text, offering a more engaging method to present information.
- Analyze the sentiment of audio recordings, converting vocal nuances into text-based insights.
- Facilitate asynchronous speech-in, speech-out interactions
Model Versions
2024-12-17: Introducing our new multimodal AI, which now supports both text and audio modalities. As this is a preview version, it is designed for testing and feedback purposes and is not yet optimized for production traffic.
Limitations
Currently, the GPT-4o-mini-audio-preview model focuses on text and audio and does not support existing GPT-4o features such as image modality. For many tasks, the generally available GPT-4o models may still be more suitable. IMPORTANT: At this time, GPT-4o-mini-audio-preview usage limits are suitable for test and development. To prevent abuse and preserve service integrity, rate limits will be adjusted as needed.Model Provider
This model is provided through the Azure OpenAI service.Relevant Documents
The following documents are applicable:- Overview of Responsible AI practices for Azure OpenAI models
- Transparency Note for Azure OpenAI Service
Responsible AI Considerations
GPT-4o-mini-audio-preview has safety built-in by design across modalities, through techniques such as filtering training data and refining the model's behavior through post-training. We have also created new safety systems to provide guardrails on voice outputs. We've evaluated GPT-4o-mini-audio-preview according to our Preparedness Framework and in line with our voluntary commitments. Our evaluations of cybersecurity, CBRN, persuasion, and model autonomy show that GPT-4o-mini-audio-preview does not score above Medium risk in any of these categories. This assessment involved running a suite of automated and human evaluations throughout the model training process. We tested both pre-safety-mitigation and post-safety-mitigation versions of the model, using custom fine-tuning and prompts, to better elicit model capabilities. GPT-4o-mini-audio-preview has also undergone extensive external red teaming with 70+ external experts in domains such as social psychology, bias and fairness, and misinformation to identify risks that are introduced or amplified by the newly added modalities. We used these learnings to build out our safety interventions in order to improve the safety of interacting with GPT-4o-mini-audio-preview. We will continue to mitigate new risks as they're discovered.Model Specifications
Context Length128000
LicenseCustom
Training DataSeptember 2023
Last UpdatedFebruary 2025
Input TypeAudio,Text
Output TypeAudio,Text
PublisherOpenAI
Languages27 Languages