Categories
Content Management System

AWS brings RAG evaluation and LLM-as-a-judge feature to Amazon Bedrock [Video]

AWS has also added support for custom connectors and reranking models within Bedrock Knowledge Bases.

Credit: Shutterstock

Amazon Web Services (AWS) has updated Amazon Bedrock with features designed to help enterprises streamline the testing of applications before deployment.

Announced during the ongoing annual re:Invent conference, the new features include a retrieval augmented generation (RAG) evaluation tool within Bedrock Knowledge Bases.

[ Related: AWS re:Invent 2024 news and insights ]

Bedrock Knowledge Bases are typically used by enterprises to use their own data to drive more context for large language models (LLMs) for better model responses. Enterprises can also use them to implement the entire RAG workflow of an application from ingestion to retrieval and prompt augmentation without having to build custom integrations to data sources and manage data flows.

“You can now run an automatic knowledge base evaluation to assess and optimize RAG applications using Amazon Bedrock Knowledge Bases,” the company wrote in a blog post, adding that the evaluation process uses …

Watch/Read More