Skip to main content
Administration

Dynamic rate limiting

QwenCloud applies dynamic rate limiting to some models. The TPM rate limit value is adjusted monthly based on your historical consumption, and the actual available TPM is no lower than the rate limit value.

Dynamic rate limiting mechanism

QwenCloud applies a dynamic rate limiting mechanism to some models. The key points are as follows:
  • Rate limit value: Determined by tier based on your monthly consumption amount on QwenCloud. It serves as the guaranteed baseline for throughput and is adjusted every month.
  • Soft rate limiting: When the call volume reaches the rate limit value, if the platform still has spare resources, rate limiting is not triggered. Therefore, the actual available TPM is no lower than the rate limit value. The actual rate limit value observed during calls may be higher than this rate limit value, which is expected behavior.
  • Rate limit granularity: By account + model. The call volumes of all workspaces and API keys under one account are aggregated and counted toward the TPM quota for that account for that model, sharing the same limit.
  • Workspace: You can set a separate rate limit value for a model in a workspace. Workspaces without a separate setting share the account-level quota.
  • RPM: Under the dynamic rate limiting mechanism, a model has a relatively large RPM limit. You do not need to set it separately, and RPM rate limiting is not triggered during normal use.
  • More information: For the basic concepts of RPM/TPM and details by dimension, see Rate limits. For workspace rate limit settings, see Workspaces.

Models and rate limit tiers

QwenCloud sets your TPM rate limit tier based on your historical consumption. For the actual rate limit value, refer to the model details page.
If the TPM rate limit value cannot meet your business requirements, contact your account manager to apply for a quota increase.
Supported modelsTPM rate limit tiers
qwen3.8-max2,000,0005,000,00010,000,000
qwen3.8-max-09021,500,0001,500,0001,500,000
qwen3.8-flash2,500,0005,000,00010,000,000
kimi-k31,200,0005,000,00010,000,000
qwen3.8-27b5,000,0005,000,0005,000,000
qwen3.8-2.4t-a95b5,000,0005,000,0005,000,000
qwen3.8-omni-flash2,000,0005,000,00010,000,000
deepseek-v4-pro-08131,200,0005,000,00010,000,000
glm-5.35,000,0005,000,0005,000,000

Dynamic rate limit adjustment strategy

Rate limit tiers are dynamically adjusted according to the following rules:
  • Tiering basis: QwenCloud platform consumption amount.
  • Calculation cycle: Calculated by calendar-month billing cycle.
  • Notification: A notification is sent to the affected users on the 10th of each month.
  • Effective time: The new tier takes effect on the 15th of each month.
  • Adjustment direction: Lower tier → higher tier (upgrade) or remain unchanged.