Skip to main content
Real-time voice conversation

Server events for Qwen-Audio Realtime API

Server event reference for the Qwen-Audio Realtime API. All server events include the event_id (auto-generated by the server) and type (event type) fields.

User guide: Real-time voice conversation (Qwen-Audio-Realtime). For the event interaction sequence, see WebSocket access.
This page is the event reference for Qwen-Audio-Realtime. Event definitions are based on WebSocket access. AOQ and WebRTC use their respective data channels to send and receive model events, and media tracks to transmit media. First read WebSocket access, WebRTC access, or AOQ access.
For WebSocket SDK usage, see Android SDK, iOS SDK, and HarmonyOS SDK. To select a model and protocol, see Overview.

error

Description: Returned when a request fails or a service error occurs. Client errors (invalid_request_error) keep the connection open. Server errors (server_error) terminate the connection.
{
    "event_id": "event_xxx",
    "type": "error",
    "error": {
        "type": "invalid_request_error",
        "code": "invalid_value",
        "message": "Cannot create response while another response is in progress.",
        "param": "response.create"
    }
}
ParameterTypeDescription
event_idstringUnique identifier for this event.
typestringEvent type. Always error.
errorobjectError details.
error.typestringError type, such as invalid_request_error (client error) or server_error (server error).
error.codestringError code.
error.messagestringError message.
error.paramstringThe parameter associated with the error.

session.created

Description: The first event sent by the server after the connection is established. Contains the default session configuration.
{
    "event_id": "event_KiKZC2zrhNsKFPZ5cTpyA",
    "type": "session.created",
    "session": {
        "object": "realtime.session",
        "model": "qwen-audio-3.1-realtime-plus",
        "modalities": ["text", "audio"],
        "voice": "longanqian_v3.1",
        "input_audio_transcription": {
            "model": "fun-asr"
        },
        "turn_detection": {
            "type": "server_vad",
            "threshold": 0.5,
            "silence_duration_ms": 800
        },
        "id": "sess_A1LbG2D63WELBSawRbpq8"
    }
}
ParameterTypeDescription
typestringEvent type. Always session.created.
sessionobjectSession configuration.
session.objectstringAlways realtime.session.
session.modelstringModel name.
session.modalitiesarrayOutput modalities of the model.
session.voicestringVoice used for audio generation. Either a system voice name or the voice_id of a cloned voice.
session.input_audio_transcriptionobjectAudio transcription configuration.
session.input_audio_transcription.modelstringTranscription model, such as fun-asr.
session.turn_detectionobjectTurn detection (VAD) configuration.
session.idstringUnique session identifier.

session.updated

Description: Returned after a session.update request is processed successfully. Contains the full updated session configuration. If the request fails, an error event is returned instead.
{
    "event_id": "event_FMG6kiHbILCGiqXFPA98e",
    "type": "session.updated",
    "session": {
        "id": "sess_A1LbG2D63WELBSawRbpq8",
        "object": "realtime.session",
        "model": "pre-fun-realtime-audiochat-beta-3",
        "modalities": ["text", "audio"],
        "voice": "longanqian",
        "input_audio_transcription": {
            "model": "fun-asr"
        },
        "turn_detection": {
            "type": "smart_turn",
            "threshold": 0.1,
            "silence_duration_ms": 900
        }
    }
}
ParameterTypeDescription
typestringEvent type. Always session.updated.
sessionobjectFull session configuration after the update. Shares the same structure as the session object in session.created.

input_audio_buffer.speech_started

Description: Sent when Voice Activity Detection (VAD) detects the start of speech in server_vad / smart_turn / smart_turn_v2 modes.
{
    "event_id": "event_xxx",
    "type": "input_audio_buffer.speech_started",
    "audio_start_ms": 1200,
    "item_id": "item_xxx"
}
ParameterTypeDescription
typestringEvent type. Always input_audio_buffer.speech_started.
audio_start_msintegerTimestamp in milliseconds when speech started.
item_idstringID of the item that will be created when this speech segment is committed.

input_audio_buffer.speech_stopped

Description: Sent when VAD detects the end of speech in server_vad / smart_turn / smart_turn_v2 modes.
{
    "event_id": "event_xxx",
    "type": "input_audio_buffer.speech_stopped",
    "audio_end_ms": 3400,
    "item_id": "item_xxx",
    "reason": "turn_invalid"
}
ParameterTypeDescription
typestringEvent type. Always input_audio_buffer.speech_stopped.
audio_end_msintegerTimestamp in milliseconds when speech ended.
item_idstringID of the user message item to be created.
reasonstringReturned only in smart_turn / smart_turn_v2 modes. When set to turn_invalid, indicates the current turn was classified as invalid (no semantic content) and inference will not be triggered. This field is absent for valid turns.

input_audio_buffer.committed

Description: The audio buffer has been committed as a user message, either through a push-to-talk commit or automatic VAD commit.
{
    "event_id": "event_xxx",
    "type": "input_audio_buffer.committed",
    "previous_item_id": "item_xxx",
    "item_id": "item_xxx"
}
ParameterTypeDescription
typestringEvent type. Always input_audio_buffer.committed.
previous_item_idstringID of the previous conversation item.
item_idstringID of the created user message item.

input_audio_buffer.cleared

Description: The audio buffer has been cleared (push-to-talk mode only).
{
    "event_id": "event_xxx",
    "type": "input_audio_buffer.cleared"
}
ParameterTypeDescription
typestringEvent type. Always input_audio_buffer.cleared.

conversation.item.created

Description: A new conversation item was created. Triggered when user audio is committed, the client manually creates an item, or an assistant response begins.
{
    "event_id": "event_xxx",
    "type": "conversation.item.created",
    "previous_item_id": "item_xxx",
    "item": {
        "id": "item_xxx",
        "object": "realtime.item",
        "type": "message",
        "status": "in_progress",
        "role": "assistant",
        "content": []
    }
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.created.
itemobjectThe created conversation item.
item.idstringUnique identifier for the conversation item.
item.objectstringAlways realtime.item.
item.typestringItem type: message (standard message) or function_call (function call).
item.statusstringItem status, such as in_progress or completed.
item.rolestringMessage role, such as user or assistant. Only present for message type items.
item.contentarrayMessage content list. Only present for message type items.

conversation.item.deleted

Description: A conversation item was deleted. Returned as a confirmation after the client sends a conversation.item.delete event.
{
    "event_id": "event_xxx",
    "type": "conversation.item.deleted",
    "item_id": "item_xxx"
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.deleted.
item_idstringID of the deleted conversation item.

conversation.item.retrieved

Description: A conversation item was retrieved successfully. Returned after the client sends a conversation.item.retrieve event. For audio-type content, only the transcript text is included; raw audio data isn't returned.
{
    "event_id": "event_xxx",
    "type": "conversation.item.retrieved",
    "item": {
        "id": "item_xxx",
        "object": "realtime.item",
        "type": "message",
        "role": "user",
        "content": [
            {
                "type": "input_audio",
                "transcript": "Hello"
            }
        ]
    }
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.retrieved.
itemobjectThe retrieved conversation item.
item.contentarrayMessage content list. For audio-type content, only the transcript text is included; raw audio data isn't returned.

conversation.item.input_audio_transcription.delta

Description: Incremental Automatic Speech Recognition (ASR) transcription result, streamed during speech recognition. Includes emotion and language detection information.
{
    "event_id": "event_xxx",
    "type": "conversation.item.input_audio_transcription.delta",
    "item_id": "item_xxx",
    "content_index": 0,
    "text": "Hello",
    "stash": "world"
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.input_audio_transcription.delta.
item_idstringID of the associated conversation item.
content_indexintegerIndex of the content part.
textstringFinalized transcription text.
stashstringTentative text that hasn't been finalized yet.

conversation.item.input_audio_transcription.completed

Description: Final ASR transcription result. The transcribed text is written to the transcript field of the corresponding item.
{
    "event_id": "event_xxx",
    "type": "conversation.item.input_audio_transcription.completed",
    "item_id": "item_xxx",
    "content_index": 0,
    "transcript": "Hello world"
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.input_audio_transcription.completed.
transcriptstringThe complete transcription text.

conversation.item.input_audio_transcription.failed

Description: ASR transcription failed.
{
    "event_id": "event_xxx",
    "type": "conversation.item.input_audio_transcription.failed",
    "item_id": "item_xxx",
    "content_index": 0,
    "error": {
        "type": "transcription_error",
        "code": "transcription_failed",
        "message": "ASR transcription failed"
    }
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.input_audio_transcription.failed.
error.typestringError type, such as transcription_error.
error.codestringError code, such as transcription_failed.

conversation.item.ambient_audio_transcription.delta

Description: smart_turn / smart_turn_v2 modes only. Incremental transcription result for ambient audio. When VAD detects voice activity but semantic analysis classifies the turn as invalid (for example, background noise or filler words like "hmm" or "uh"), the ASR result is forwarded to the client as an ambient event. This event isn't linked to any conversation item. The item_id is a standalone temporary ID.
{
    "event_id": "event_xxx",
    "type": "conversation.item.ambient_audio_transcription.delta",
    "item_id": "item_xxx",
    "content_index": 0,
    "text": "Hmm",
    "stash": ""
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.ambient_audio_transcription.delta.
item_idstringA standalone temporary ID, not associated with any conversation item.

conversation.item.ambient_audio_transcription.completed

Description: smart_turn / smart_turn_v2 modes only. Final transcription result for ambient audio. Paired with the corresponding delta event to mark the end of an ambient audio transcription segment. This result isn't written to the conversation context.
{
    "event_id": "event_xxx",
    "type": "conversation.item.ambient_audio_transcription.completed",
    "item_id": "item_xxx",
    "content_index": 0,
    "transcript": "Hmm",
}
ParameterTypeDescription
typestringEvent type. Always conversation.item.ambient_audio_transcription.completed.
item_idstringA standalone temporary ID, not associated with the conversation context.

response.created

Description: Sent when a model inference round starts.
{
    "event_id": "event_xxx",
    "type": "response.created",
    "response": {
        "id": "resp_xxx",
        "object": "realtime.response",
        "status": "in_progress",
        "modalities": ["text", "audio"],
        "voice": "longanqian",
        "output": []
    }
}
ParameterTypeDescription
typestringEvent type. Always response.created.
responseobjectThe response object.
response.idstringUnique identifier for the response.
response.objectstringAlways realtime.response.
response.statusstringResponse status, such as in_progress.
response.modalitiesarrayOutput modalities of the model.
response.voicestringVoice used for audio generation. Either a system voice name or the voice_id of a cloned voice.
response.outputarrayOutput items of the response. Initially an empty array.

response.output_item.added

Description: A new output item was added to the response. The output item type is message for standard replies, or function_call for Function Calling.
{
    "event_id": "event_xxx",
    "type": "response.output_item.added",
    "response_id": "resp_xxx",
    "output_index": 0,
    "item": {
        "id": "item_xxx",
        "object": "realtime.item",
        "type": "message",
        "status": "in_progress",
        "role": "assistant",
        "content": []
    }
}
Function Calling output item example: When the output item is a function call, the response.output_item.added / conversation.item.created / response.output_item.done events contain the following item structure:
{
          "id": "item_xxx",
          "object": "realtime.item",
          "type": "function_call",
          "status": "completed",
          "call_id": "call_xxx",
          "name": "get_weather",
          "arguments": "{\"city\":\"Hangzhou\"}"
      }
A single response can include multiple function_call items and may also contain standard message output alongside function_call output. The Function Calling portion isn't sent to TTS for audio playback.
ParameterTypeDescription
typestringEvent type. Always response.output_item.added.
response_idstringAssociated response ID.
output_indexintegerIndex of the output item within the response.
itemobjectThe added output item.
item.idstringUnique identifier for the output item.
item.typestringOutput item type: message (standard message) or function_call (function call).
item.statusstringOutput item status, such as in_progress.
item.rolestringMessage role. Always assistant. Only present for message type items.

response.content_part.added

Description: A new content part was added to an output item.
{
    "event_id": "event_xxx",
    "type": "response.content_part.added",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0,
    "part": {
        "type": "audio",
        "text": ""
    }
}
ParameterTypeDescription
typestringEvent type. Always response.content_part.added.
item_idstringAssociated output item ID.
content_indexintegerIndex of the content part within the output item.
partobjectThe added content part.
part.typestringContent type, such as audio or text.
part.textstringText content. Initially an empty string.

response.text.delta

Description: Text delta event in text-only mode. Streams text fragments incrementally.
{
    "event_id": "event_xxx",
    "type": "response.text.delta",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0,
    "delta": "Hello"
}
ParameterTypeDescription
typestringEvent type. Always response.text.delta.
deltastringIncremental text fragment.

response.text.done

Description: Text output complete event in text-only mode.
{
    "event_id": "event_xxx",
    "type": "response.text.done",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0,
    "text": "Hello, how can I help you?"
}
ParameterTypeDescription
typestringEvent type. Always response.text.done.
textstringThe complete text output.

response.audio_transcript.delta

Description: Transcript delta event in audio mode. Streams transcript fragments incrementally.
{
    "event_id": "event_xxx",
    "type": "response.audio_transcript.delta",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0,
    "delta": "Hello"
}
ParameterTypeDescription
typestringEvent type. Always response.audio_transcript.delta.
deltastringIncremental transcript fragment.

response.audio_transcript.done

Description: Transcript output complete event in audio mode.
{
    "event_id": "event_xxx",
    "type": "response.audio_transcript.done",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0,
    "transcript": "Hello, how can I help you?"
}
ParameterTypeDescription
typestringEvent type. Always response.audio_transcript.done.
transcriptstringThe complete transcript text.

response.audio.delta

Description: For WebSocket access, this is an incremental audio data event in audio mode. The delta field contains Base64-encoded PCM audio data.
{
    "event_id": "event_xxx",
    "type": "response.audio.delta",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0,
    "delta": "<base64-encoded audio data>"
}
ParameterTypeDescription
typestringEvent type. Always response.audio.delta.
deltastringBase64-encoded PCM audio data fragment.

response.audio.done

Description: Audio output complete event in audio mode. Contains no audio data.
{
    "event_id": "event_xxx",
    "type": "response.audio.done",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0
}
ParameterTypeDescription
typestringEvent type. Always response.audio.done.

response.content_part.done

Description: A content part within an output item has completed.
{
    "event_id": "event_xxx",
    "type": "response.content_part.done",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "content_index": 0,
    "part": {
        "type": "audio",
        "text": "Hello, how can I help you?"
    }
}
ParameterTypeDescription
typestringEvent type. Always response.content_part.done.
partobjectThe completed content part.
part.textstringText content or audio transcript text.

response.output_item.done

Description: An output item within the response has completed.
{
    "event_id": "event_xxx",
    "type": "response.output_item.done",
    "response_id": "resp_xxx",
    "output_index": 0,
    "item": {
        "id": "item_xxx",
        "object": "realtime.item",
        "type": "message",
        "status": "completed",
        "role": "assistant",
        "content": [
            {
                "type": "text",
                "text": "Hello, how can I help you?"
            }
        ]
    }
}
ParameterTypeDescription
typestringEvent type. Always response.output_item.done.
itemobjectThe completed output item with full details.
item.statusstringOutput item status, such as completed.

response.function_call_arguments.delta

Description: Function Calling argument delta. When the model decides to invoke a tool, the server first sends response.output_item.added (with item.type=function_call) and conversation.item.created, then streams argument fragments through this event.
{
    "event_id": "event_xxx",
    "type": "response.function_call_arguments.delta",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "call_id": "call_xxx",
    "delta": "{\"city"
}
ParameterTypeDescription
typestringEvent type. Always response.function_call_arguments.delta.
call_idstringUnique identifier for the function call.
deltastringIncremental fragment of the function call arguments (JSON string fragment).

response.function_call_arguments.done

Description: Sent when Function Calling argument output is complete. After receiving this event, the client should: execute the corresponding tool, write the result to the conversation via conversation.item.create with a function_call_output item, and then send response.create to trigger a follow-up inference round.
{
    "event_id": "event_xxx",
    "type": "response.function_call_arguments.done",
    "response_id": "resp_xxx",
    "item_id": "item_xxx",
    "output_index": 0,
    "call_id": "call_xxx",
    "name": "get_weather",
    "arguments": "{\"city\":\"Hangzhou\"}"
}
ParameterTypeDescription
typestringEvent type. Always response.function_call_arguments.done.
namestringName of the invoked function.
argumentsstringComplete function call arguments (JSON string).

response.done

Description: An inference round is complete. status indicates the reason for completion.
{
    "event_id": "event_xxx",
    "type": "response.done",
    "response": {
        "id": "resp_xxx",
        "object": "realtime.response",
        "status": "completed",
        "modalities": ["text", "audio"],
        "voice": "longanqian",
        "output": [
            {
                "id": "item_xxx",
                "object": "realtime.item",
                "type": "message",
                "status": "completed",
                "role": "assistant",
                "content": [
                    {
                        "type": "audio",
                        "transcript": "Hello, how can I help you?"
                    }
                ]
            }
        ]
    }
}
ParameterTypeDescription
typestringEvent type. Always response.done.
responseobjectThe complete response object.
response.idstringUnique identifier of the response.
response.statusstringCompletion status of the response. Valid values:
  • completed: Completed normally.
  • cancelled: Interrupted and cancelled. status_details.reason is turn_detected (VAD interruption) or client_cancelled (client-initiated cancellation).
  • failed: LLM or TTS error.
response.status_detailsobjectStatus details. Present only when the status is cancelled or failed.
response.status_details.typestringStatus type, such as cancelled.
response.status_details.reasonstringCancellation reason: turn_detected (VAD interruption) or client_cancelled (client-initiated cancellation).
response.outputarrayList of output items in the response, containing complete item objects.

voiceprint_audio_list.in_progress

Description: The voiceprint registration process is in progress asynchronously.
{
    "event_id": "event_PaEcN7CCrlhE8q4MM2yND",
    "type": "voiceprint_audio_list.in_progress",
    "item_id": "vp_Y12cA986j1KZ9O9YmAXOA"
}
ParameterTypeDescription
typestringEvent type. Always voiceprint_audio_list.in_progress.
item_idstringUnique identifier for the voiceprint registration task.

voiceprint_audio_list.completed

Description: The voiceprint registration process has completed successfully.
{
    "event_id": "event_PaEcN7CCrlhE8q4MM2yND",
    "type": "voiceprint_audio_list.completed",
    "item_id": "vp_Y12cA986j1KZ9O9YmAXOA"
}
ParameterTypeDescription
typestringEvent type. Always voiceprint_audio_list.completed.

voiceprint_audio_list.failed

Description: The voiceprint registration failed. Normal conversation calls are not blocked.
{
    "event_id": "event_PaEcN7CCrlhE8q4MM2yND",
    "type": "voiceprint_audio_list.failed",
    "item_id": "vp_Y12cA986j1KZ9O9YmAXOA",
    "reason": ""
}
ParameterTypeDescription
typestringEvent type. Always voiceprint_audio_list.failed.
reasonstringDescription of the failure reason.