Skip to main content
Speech-to-speech

Speech-to-speech models

Choose a model for voice conversation, speech translation, or simultaneous interpretation.

Migrate from closed-source models

Map your current OpenAI Realtime or Gemini Live setup to an equivalent QwenCloud model.
Closed-source examplesQwenCloud recommendation
Real-time conversationOpenAI GPT Realtime, Gemini 3.1 Liveqwen-audio-3.1-realtime-plus
Cost-sensitive conversationOpenAI gpt-4o-mini Realtimeqwen-audio-3.0-realtime-flash
Real-time translationGemini 3.1 Liveqwen3.8-livetranslate-flash-realtime
This page covers speech-to-speech. For visual understanding, audio/video analysis, and content moderation, see Omni-modal models. For tasks that require reasoning and text output, such as video analysis and content labeling, see Qwen3.8-Omni-Flash.

S2S vs pipeline

Two ways to build voice apps:
S2SPipeline (ASR + LLM + TTS)
LatencyLow — single model, streamingHigher — 3 sequential hops
Audio understandingEnd-to-end — hears tone, emotion, responds in kindTranscribes to text first — audio nuance lost
Voice customizationPreset voices via system promptVoice cloning, voice design (CosyVoice)
  • Use S2S when interactive conversation, low latency, and audio-aware responses matter. Continue reading this page.
  • Use Pipeline when you need voice customization or want to select ASR, LLM, and TTS models independently.
This page covers the S2S single-model approach (Omni and Livetranslate series). For the pipeline approach, select each component separately:

Real-time or file-based?

  • Real-time (WebSocket) — Voice assistants, call centers, and simultaneous interpretation. Streams audio input and speech output.
  • File-based (HTTP) — Higher latency but better quality. Ideal for video dubbing, podcast translation, and offline processing. Also supports function calling, web search, thinking mode, and video context (see Companion capabilities below).

Choose a model by scenario (S2S single-model route)

All use cases below use the S2S single-model approach. For the pipeline approach, use the ASR, LLM, and TTS guides linked above.
ScenarioRecommended modelAPI
Realtime audio/video conversationqwen3.8-omni-flash-realtimeWebSocket / WebRTC / AOQ
Voice assistants and customer-service conversationsqwen-audio-3.1-realtime-plusWebSocket
Cost-sensitive conversationsqwen-audio-3.0-realtime-flashWebSocket
Simultaneous interpretation / live translationqwen3.8-livetranslate-flash-realtimeWebSocket
Video dubbing / podcast translationqwen3-livetranslate-flashHTTP
Semantic VAD voice assistants and smart customer service (with Function Calling support)qwen-audio-3.1-realtime-plusWebSocket

Companion capabilities of S2S models

The following sections cover tool calling, web search, and text reasoning in voice applications.

Function calling

To query knowledge bases, check schedules, or trigger workflows based on audio/video content, use Qwen3.8-Omni-Flash-Realtime (WebSocket / WebRTC / AOQ) or Qwen-Audio Realtime (WebSocket). For current information with spoken responses, use Qwen3.8-Omni-Flash-Realtime or Qwen3.5-Omni-Realtime for real-time conversations, or Qwen3.5-Omni (Chat Completions, both Plus and Flash) for file-based calls. The model decides autonomously whether to search. Qwen-Audio Realtime 3.0 Plus/Flash and 3.1 Plus also support web search via enable_search, which cannot be enabled at the same time as Function Calling.
Qwen3-Omni-Flash and Livetranslate models do not support this feature. Web search and function calling cannot be enabled at the same time.

Thinking mode

Use Qwen3-Omni (HTTP) when answer quality outweighs latency. Reasons step by step before replying, ideal for video analysis and batch labeling. Qwen-Audio Realtime does not support this capability.
Thinking mode does not support speech output.

Translation

All model families can translate speech:
  • Qwen3.8-Livetranslate — Supports 60 source languages, speech output in 29 languages, and audio and image input. See Model information.
  • Qwen3.5-Livetranslate — 60 languages (29 with audio+text output, 31 text-only). Covers Chinese, English, French, German, Russian, Japanese, Korean, Spanish, Portuguese, Arabic, and more.
  • Qwen3-Livetranslate — 18 languages and 5 Chinese dialects (~3 s latency). File mode accepts video input for context-aware translations. 7 languages produce text-only output.
  • Qwen3.8-Omni-Flash-Realtime — Supports real-time speech translation and the same 36 speech output languages and dialects as Qwen3.5-Omni-Realtime. See the voice list for the languages supported by each voice.
  • Qwen3.5-Omni — 29 output languages and 8 Chinese dialects. Strong audio/video understanding and web search. Inject terminology and domain context via system prompt. Real-time and file modes.
  • Qwen3-Omni-Flash — 11 output languages and 8 Chinese dialects. Inject terminology and domain context via system prompt. Real-time and file modes, at lower cost.
Quick start: Livetranslate series. Best quality and language coverage: Qwen3.5-Omni. Cost-sensitive: Qwen3-Omni-Flash.
LanguageQwen3.5-LivetranslateQwen3-LivetranslateQwen3.5-OmniQwen3-Omni-Flash
English✓✓✓✓
Chinese (Mandarin)✓✓✓✓
  + CantoneseText only✓✓✓
  + Sichuanese✓✓✓✓
  + Shanghainese✓✓✓✓
  + Beijing✓✓✓✓
  + Tianjin✓✓✓✓
  + Nanjing——✓✓
  + Shaanxi——✓✓
  + Hokkien——✓✓
French✓✓✓✓
German✓✓✓✓
Russian✓✓✓✓
Italian✓✓✓✓
Spanish✓✓✓✓
Portuguese✓✓✓✓
Japanese✓✓✓✓
Korean✓✓✓✓
Arabic✓Text only✓—
Thai✓Text only✓✓
Vietnamese✓Text only✓—
Indonesian✓Text only✓—
Turkish✓Text only✓—
Hindi✓Text only✓—
Malay✓—✓—
Dutch✓—✓—
Urdu✓—✓—
Norwegian✓—✓—
Swedish✓—✓—
Danish✓—✓—
Hebrew✓—✓—
Finnish✓—✓—
Polish✓—✓—
Icelandic✓—✓—
Czech✓—✓—
Tagalog✓—✓—
Persian✓—✓—
GreekText onlyText only——
AfrikaansText only———
AsturianText only———
BelarusianText only———
BulgarianText only———
BengaliText only———
BosnianText only———
CatalanText only———
CebuanoText only———
EstonianText only———
GalicianText only———
GujaratiText only———
CroatianText only———
HungarianText only———
JavaneseText only———
KazakhText only———
KannadaText only———
KyrgyzText only———
LatvianText only———
MacedonianText only———
MalayalamText only———
MarathiText only———
PunjabiText only———
RomanianText only———
SlovakText only———
SlovenianText only———
SwahiliText only———
TajikText only———
AzerbaijaniText only———
UkrainianText only———
"✓" = speech + text output. "Text only" = text output only, no speech.Qwen3.8-Omni-Flash-Realtime and Qwen3.5-Omni support 113 input languages/dialects total. See full list for details.Legacy qwen-omni-turbo supports Chinese and English only.
The table lists the entry-point model in each series. To pin a dated version for regression testing or stability, see All models below.
ModelAPIInputFunction callingWeb searchThinkingTranslation
qwen3.8-omni-flash-realtimeWebSocket / WebRTC / AOQText, audio, image, video✓✓——
qwen-audio-3.1-realtime-plusWebSocketText, audio✓✓——
qwen-audio-3.0-realtime-plusWebSocketText, audio✓✓——
qwen-audio-3.0-realtime-flashWebSocketText, audio✓✓——
qwen3.5-omni-plus-realtimeWebSocketText, audio, image, video✓✓—29 langs
qwen3.5-omni-plusHTTPText, audio, image, video—✓—29 langs
qwen3.5-omni-flash-realtimeWebSocketText, audio, image, video✓✓—29 langs
qwen3.5-omni-flashHTTPText, audio, image, video—✓—29 langs
qwen3-omni-flash-realtimeWebSocketText, audio, image, video———11 langs
qwen3-omni-flashHTTPText, audio, image, video✓—✓11 langs
qwen3.8-livetranslate-flash-realtimeWebSocketAudio, image———60 langs
qwen3-livetranslate-flash-realtimeWebSocketAudio———18 langs
qwen3-livetranslate-flashHTTPAudio, video———18 langs

All models

ModelAPIInputFunction callingWeb searchThinkingBatch
qwen-audio-3.1-realtime-plusWebSocketText, audio✓✓——
qwen-audio-3.0-realtime-plusWebSocketText, audio✓✓——
qwen-audio-3.0-realtime-flashWebSocketText, audio✓✓——
ModelAPIInputFunction callingWeb searchThinkingBatch
qwen3.8-omni-flash-realtimeWebSocket / WebRTC / AOQText, audio, image, video✓✓——
ModelAPIInputFunction callingWeb searchThinkingBatch
qwen3.5-omni-plus-realtimeWebSocketText, audio, image, video✓✓——
qwen3.5-omni-plus-realtime-2026-03-15WebSocketText, audio, image, video✓✓——
qwen3.5-omni-flash-realtimeWebSocketText, audio, image, video✓✓——
qwen3.5-omni-flash-realtime-2026-03-15WebSocketText, audio, image, video✓✓——
qwen3.5-omni-plusHTTPText, audio, image, video—✓——
qwen3.5-omni-plus-2026-03-15HTTPText, audio, image, video—✓——
qwen3.5-omni-flashHTTPText, audio, image, video—✓——
qwen3.5-omni-flash-2026-03-15HTTPText, audio, image, video—✓——
ModelAPIInputFunction callingWeb searchThinkingBatch
qwen3-omni-flash-realtimeWebSocketText, audio, image, video————
qwen3-omni-flash-realtime-2025-12-01WebSocketText, audio, image, video————
qwen3-omni-flash-realtime-2025-09-15WebSocketText, audio, image, video————
qwen3-omni-flashHTTPText, audio, image, video✓—✓—
qwen3-omni-flash-2025-12-01HTTPText, audio, image, video✓—✓—
qwen3-omni-flash-2025-09-15HTTPText, audio, image, video✓—✓—
ModelAPIInputLanguages
qwen3.8-livetranslate-flash-realtimeWebSocketAudio, image60
ModelAPIInputLanguages
qwen3.5-livetranslate-flash-realtimeWebSocketAudio60
qwen3.5-livetranslate-flash-realtime-2026-05-19WebSocketAudio60
ModelAPIInputLanguages
qwen3-livetranslate-flash-realtimeWebSocketAudio18
qwen3-livetranslate-flash-realtime-2025-09-22WebSocketAudio18
qwen3-livetranslate-flashHTTPAudio, video18
qwen3-livetranslate-flash-2025-12-01HTTPAudio, video18
These models are no longer updated. Use Qwen3.8-Omni-Flash-Realtime for realtime audio/video conversation, or Qwen3.5-Omni for offline speech output.
ModelInputAPI
qwen2.5-omni-7bText, audio, image, videoHTTP
qwen-omni-turboText, audio, image, videoHTTP
qwen-omni-turbo-latestText, audio, image, videoHTTP
qwen-omni-turbo-2025-03-26Text, audio, image, videoHTTP
qwen-omni-turbo-realtimeText, audioWebSocket
qwen-omni-turbo-realtime-latestText, audioWebSocket
qwen-omni-turbo-realtime-2025-05-08Text, audioWebSocket

Next steps

API documentation by model series:

Learn more