LiteLLM AutoRouter Gets Four New Updates for Production Traffic

LiteLLM (YC W23) ·

Key Info

LiteLLM has announced four new updates to AutoRouter, including custom routing dimensions, automatic router configuration, per-model output limits, and updated presets for the latest models.

Highlights

  • Tune routing to production traffic using custom routing dimensions.
  • Auto-configure the best router for the models you have available.
  • Set per-model output limits to avoid truncated responses.
  • Updated presets support the latest models.
Loading...