Anthropic Uses Claude to Speed Up 30+ Open-Source Biology Models by 4x

Key Info

Anthropic used Claude to optimize inference for more than 30 open-source models used in biology, achieving an average 4x speedup by writing custom GPU software. The optimizations are being open sourced.

Highlights

• Targets specialized open-source models for molecular structure modeling, drug-like molecule design, and genetic mutation effect prediction.
• Claude wrote custom GPU software to accelerate inference, reducing the high compute cost that can limit these models' impact.
• Anthropic is releasing the optimizations to the community, making the speedups broadly available.