Model Based Round Robin

The model-based round-robin policy distributes requests across multiple LLM backends based on a specified AI model. It uses a round-robin strategy to balance requests among available backends and supports weighted configurations to control how many requests each backend receives.

For instructions on configuring Model Based Round Robin in WSO2 API Manager, refer to the linked documentation.

Note

This policy is applicable only to AI APIs.