LiteLLM 1.102.0rc1: OCR Now Runs on Rust with ~1.7x Throughput Boost

Key Info

LiteLLM v1.102.0rc1 now runs OCR on Rust by default, achieving ~1.7x higher OCR throughput on CPU-bound proxies while keeping the same API and requiring no code changes.

Highlights

• Rust-based OCR engine delivers ~1.7x throughput improvement on CPU-bound proxy workloads.
• Drop-in upgrade: same API interface, no code changes required.
• Users are invited to join the beta testers community (with free stickers) to try the new release candidate.