The LLM Token Based Rate Limit policy rate limits model proxy usage based on token consumption.
For configuration details, see LLM Token Based Rate Limit Policy.
The LLM Token Based Rate Limit policy rate limits model proxy usage based on token consumption.
For configuration details, see LLM Token Based Rate Limit Policy.