Amazon Bedrock Shows Unexplained Model Hosting Issues, Developer Reports

Key Info

An AI developer reports that Amazon Bedrock sometimes exhibits problematic model behavior that isn't seen when using the same models through their native providers. The issue also appears for some customers whose inference traffic is not routed through Bedrock.

Highlights

• The developer observed "bad model behavior" on Bedrock that did not occur with direct access to native providers.
• They say the issue isn't isolated: some customers using inference requests not routed to Bedrock see it too.
• The exact cause is unclear, and the team isn't sure what's going on behind the scenes.