Qwen-Audio-3.x-ASR-Flash-Streaming/Fun-ASR-Realtime Android SDK

​

Quick start

1. Obtain an API key
2. Download the SDK and run the sample code:
   • Download the latest SDK package.
   • Extract the ZIP package. The AAR-format SDK is in the app/libs directory. Add it to your project dependencies. For Android C++ integration, use android_libs and android_include from the ZIP package to get the dynamic libraries and header files.
   • Open the project in Android Studio. The sample code is in DashFunAsrSpeechTranscriberActivity.java. Replace the API key to try out the feature.

​

Call procedure

1. Initialize the SDK.
2. Set the parameters for your use case. Use the parameters argument of the initialize method to set the Connection and control parameters, and use the setParams method to set the Speech recognition parameters.
3. Call startDialog to start recognition.
4. In the onNuiAudioStateChanged callback, start the recording device based on the audio state.
5. Continuously supply recording data in the onNuiNeedAudioData callback, or actively push recording data by calling updateAudio.
6. In the onNuiEventCallback callback, listen for events and get the speech recognition results.
7. Call stopDialog to stop recognition, and listen for the EVENT_TRANSCRIBER_COMPLETE event to confirm that recognition has ended.
8. When you no longer need recognition, call release to release the SDK resources.

​

Request parameters

​

Connection and control parameters

• Example: The following is a JSON string example. Not all parameters are listed. Add others as needed when you write your code:

{
    "url": "wss://maas.qwencloudapi.com/api-ws/v1/inference",
    "apikey": "st-****",
    "device_id": "my_device_id",
    "service_mode": "1"
}

• Parameters

​

Speech recognition parameters

• Example: The following is a JSON string example. Not all parameters are listed. Add others as needed when you write your code:

{
    "service_type": 4,
    "nls_config": {
        "model": "qwen-audio-3.0-asr-flash-streaming",
        "sr_format": "pcm",
        "sample_rate": "16000"
    }
}

• Parameters

​

Key interfaces

​

NativeNui

​

initialize

• Method signature

public synchronized int initialize(final INativeNuiCallback callback,
                                   String parameters,
                                   final Constants.LogLevel level,
                                   final boolean save_log)

• Parameters

• Return value An error code. See Error code reference.

​

setParams

• Method signature

public synchronized int setParams(String params)

• Parameters

• Return value An error code. See Error code reference.

​

startDialog

• Method signature

public synchronized int startDialog(VadMode vad_mode, String dialog_params)

• Parameters

{
  "apikey": "st-****",
  "input_context": [
    {
      "role": "user",
      "content": [
        {
          "text": "xxxxx",
          "type": "input_text"
        }
      ]
    }
  ]
}

• Return value An error code. See Error code reference.

​

stopDialog

• Method signature

public synchronized int stopDialog();

• Return value An error code. See Error code reference.

​

cancelDialog

• Method signature

public synchronized int cancelDialog();

• Return value An error code. See Error code reference.

​

updateAction

• Method signature

public synchronized int updateAction(String params);

• Parameters

{
  "context": [
    {
      "role": "user",
      "content": [
        {
          "text": "xxx",
          "type": "input_text"
        }
      ]
    }
  ]
}

• Return value An error code. See Error code reference.

​

updateAudio

• Method signature

public synchronized int updateAudio(byte[] data, int len,
                                    boolean first_pack);

• Parameters

• Return value An error code. See Error code reference.

​

updateRefAudio

• Method signature

public synchronized int updateRefAudio(byte[] data, int len,
                                       boolean first_pack);

• Parameters

• Return value An error code. See Error code reference.

​

release

• Method signature

public synchronized int release();

• Return value An error code. See Error code reference.

​

GetVersion

• Method signature

public synchronized String GetVersion();

• Return value The current SDK version information.

​

INativeNuiCallback: listener callbacks

​

onNuiEventCallback

• Method signature

void onNuiEventCallback(NuiEvent event, final int resultCode, final int arg2, KwsResult kwsResult, AsrResult asrResult);

• Parameters

​

onNuiAudioStateChanged

• Method signature

void onNuiAudioStateChanged(AudioState state);

• AudioState states

​

onNuiNeedAudioData

• Method signature

int onNuiNeedAudioData(byte[] buffer, int len);

• Parameters

• Return value The number of bytes actually filled.

​

onNuiAssistEventCallback

• Method signature

void onNuiAssistEventCallback_(int event, byte[] info, int info_len,
                               byte[] data);

• Parameters

​

onNuiLogTrackCallback

default void onNuiLogTrackCallback(Constants.LogLevel level, String log)

​

NuiEvent: event types