Skip to main content
Integrations

MLOps & observability

Production AI monitoring

Overview

The Analytics page provides observability for your pay-as-you-go usage, including token consumption, request counts, latency, success rates, and per-model performance metrics.

Analytics

Go to the Analytics page to view usage and analytics for your workspace.

Filters

  • Time range: Select the time window (such as 7 days).
  • Models: Filter by specific model or view all models.
  • API Keys: Filter usage by a specific API key.
  • Granularity: Choose the aggregation interval (By Day or By Hour).

Tabs

  • Usage: Displays usage trend charts and per-model metrics.
  • Logs: View detailed request logs with filtering by source, status, and more.

Metrics

The page shows the following usage metrics:
MetricDescription
TokensTotal token consumption
CountTotal number of API requests
SecondsUsage for models billed by duration (audio/video)
CharactersUsage for models billed by character count
API CallsTotal API call count
Below the usage metrics, trend charts show requests, average TTFT (time to first token), average latency, and success rate over time.
Only pay-as-you-go usage is shown. Token Plan and other subscription usage is not included. Refer to billing data for cost details.

Usage units by model type

TypeSubcategoryUnitBilling basis
Large language modelText generation, Deep thinking, Vision understandingTokenBilled by input and output token count
Vision modelImage generationImage (count)Billed by successfully generated images
Vision modelVideo generationSecondsBilled by successfully generated video duration
Speech modelTTS, Realtime TTS, File ASR, Realtime ASR, Audio/video translationSeconds, characters, or tokensVaries by model -- may bill by audio duration, text characters, or token count
Omni-modal modelOmni-modal, Realtime multimodalTokenText billed by tokens; other modalities (audio, image, video) billed by corresponding token count

Per-model metrics

Below the usage charts, a per-model table shows model code, average TPM and RPM, total and successful requests, average success rate, average time to first token, and average latency for each model. Use this to identify underperforming models or unexpected error spikes.

Request logs

Go to the Logs page, or select the Logs tab on the Analytics page, to inspect individual API requests. Only pay-as-you-go call logs are shown, and they are retained for the last 14 days. Logs are scoped to the current workspace and region: switch the workspace in the console sidebar or the region in the console to view other data.

Filters

  • Time range: Narrow the log window to a specific period.
  • Model: Filter by a specific model.
  • API Keys: Filter by a specific API key. Each option shows the API key ID and its description.
  • Sources: Distinguish between API calls and web-based calls (such as the Try AI page) to pinpoint traffic sources.
  • Status: Filter by status bucket: Canceled (0), Success (200), Client Error (4XX), or Server Error (5XX).
  • Request ID: Search for a specific request by its ID.

Log table

Each row shows:
ColumnDescription
Request IDUnique identifier for the request
TimestampWhen the request was made
ModelModel used for the request
SourceAPI call or web-based call
API KeyAPI key ID and description used for the request
UsageToken breakdown (total, input, output)
TTFTTime to first token
LatencyTotal response time
StatusHTTP status code

Request details

Click Details to open a side panel with the request record. You can view the data in List or JSON format:
  • List: request ID, start time, model, usage (total, output, and input tokens), and performance (TTFT, total latency, and status code).
  • JSON: the full request record, including fields that are not shown in the list.
JSON fieldDescription
request_idUnique identifier for the request
start_time / start_unix_timestampRequest start time (readable format / Unix timestamp in milliseconds)
modelModel used for the request
status_codeHTTP status code
durationTotal duration in milliseconds
first_output_durationTime to first token in milliseconds
usageToken usage details, including input_tokens, output_tokens, total_tokens, reasoning_tokens, and cached_tokens
workspace_idWorkspace that the request belongs to, such as llm-xxxxxxxxxxxx
apikey_idAPI key ID used for the request
uidAccount ID
client_ipClient IP address
regionRegion that processed the request
sourceRequest source, such as model for API calls
channelCall channel, default by default
extrasProtocol and model details, including protocol (such as SSE or HTTP), sub_protocol, model_type, and encrypt
Click Export to download the logs as a file for offline analysis.

What request logs do not include

Request logs contain request-level metadata only. They do not record or show HTTP headers, the request body (prompts, images, audio, and other inputs), or the response body (model output). Request details also do not include an error code or error message. To troubleshoot parameter or output issues, use the error code and message returned by the client together with your application logs.
To reproduce a failing request, capture the following on your side and retry:
  • Request parameters, request body, and response content (never log API keys or other secrets).
  • SDK debug logs: set DASHSCOPE_LOGGING_LEVEL=debug for Python; for HTTP calls, use curl -v or a local proxy to capture the request.
  • The Request ID returned in the response, so you can locate the call in Request logs.

Find the workspace ID

Request logs are scoped to a workspace, and workspace_id is shown only in Details > JSON. For other ways to find the ID, see Workspaces.

Information to include in a support ticket

If the logs do not contain enough information to diagnose the issue, open a support ticket and include:
  • Request ID
  • Workspace ID (workspace_id)
  • Region (region), model, and request time
  • Status code, plus the error code and error message returned to the client
  • A minimal reproducible request (code or request body that can be copied after redaction)

Alerts

Set up custom alert rules to monitor API call metrics and receive real-time notifications when anomalies occur. Alerts are available only in Singapore. For details, see Monitoring alerts.