Skip to main content

Routing Settings

Routing Settings manages the Auto Routing Model Pool. Models in this pool are eligible when a Tenant request sends model="auto"; the router chooses among them using current health and cost. The page requires the Provider Models permission and is hidden for system tenants (banSystem).

Before You Start​

  • Add and verify the required entries in Provider Models.
  • Record the current pool before changing production routing.
  • Prepare a controlled Tenant API request using model="auto" for verification.

Add a model to the pool​

  1. Open Router Monetization → Routing Settings.
  2. Search for a model in Search and select a model to add.
  3. Check the capability badges and select the intended model ID.
  4. Select Add.
  5. Confirm that the model appears in Auto Routing Model Pool and that the model count increases.

To remove a model, select the close icon on its pool tag and wait until it disappears. Removing a model from the pool does not delete its Provider Model definition.

Verify the Result​

Send a controlled request with model="auto", then inspect Tenant History to confirm that routing completed. Do not assume that a particular pool model will always be selected: current health and cost influence the choice.

Troubleshooting​

  • A model already in the pool is intentionally excluded from the add list.
  • If search returns no result, verify the Provider Model exists and that the correct administrator tenant is selected.
  • An empty pool means model="auto" has no eligible model from this configuration.
  • If the add or remove action fails, reload the current pool before retrying to avoid acting on stale state.

Next Step​

Validate the routed model from Tenant Console and monitor the request in Usage and History.