AI Tools & Models HOTFeaturedAll
AWS Machine Learning BlogOfficialScore85

Use prompt caching with open-weight models on Amazon Bedrock

Summary

On Bedrock, prompt caching lets open-weight models reuse the long context that generative AI apps otherwise resend with every request, cutting input costs and latency.

Why this matters

Official source · Covers model and prompt · Published within 24 hours

Open original ↗

Source: AWS Machine Learning Blog · aws.amazon.com

Topics

Related items