Short CourseBeginner1 Hour 55 Minutes

Building and Evaluating Advanced RAG Applications

Instructor: Jerry Liu and Anupam Datta

TruEra and LlamaIndex
  • Beginner
  • 1 Hour 55 Minutes
  • 6 Video Lessons
  • 4 Code Examples
  • Instructor: Jerry Liu and Anupam Datta
    • TruEra
    • LlamaIndex
    TruEra, LlamaIndex

What you'll learn

  • Learn methods like sentence-window retrieval and auto-merging retrieval, improving your RAG pipeline’s performance beyond the baseline.

  • Learn evaluation best practices to streamline your process, and iteratively build a robust system.

  • Dive into the RAG triad for evaluating the relevance and truthfulness of an LLM’s response:Context Relevance, Groundedness, and Answer Relevance.

About this course

Retrieval Augmented Generation (RAG) stands out as one of the most popular use cases of large language models (LLMs). This method facilitates the integration of an LLM with an organization’s proprietary data.

To successfully implement RAG, it is essential to enhance retrieval techniques for obtaining coherent contexts and employ effective evaluation metrics.

In this course, we’ll explore:

  • Two advanced retrieval methods: Sentence-window retrieval and auto-merging retrieval that perform better compared to the baseline RAG pipeline. 
  • Evaluation and experiment tracking: A way evaluate and iteratively improve your RAG pipeline’s performance. 
  • The RAG triad: Context Relevance, Groundedness, and Answer Relevance, which are methods to evaluate the relevance and truthfulness of your LLM’s response.

Who should join?

Anyone with basic Python knowledge interested in how to effectively employ the latest methods in Retrieval Augmented Generation (RAG).

Course Outline

6 Lessons・4 Code Examples
  • Introduction

    Video4 mins

  • Advanced RAG Pipeline

    Video with code examples15 mins

  • RAG Triad of metrics

    Video with code examples42 mins

  • Sentence-window retrieval

    Video with code examples29 mins

  • Auto-merging retrieval

    Video with code examples21 mins

  • Conclusion

    Video1 mins

  • [Beta] Quiz

    Reading

Instructors

Jerry Liu

Jerry Liu

Co-founder and CEO of LlamaIndex

Anupam Datta

Anupam Datta

Co-founder and chief scientist of TruEra

Course access is free for a limited time during the DeepLearning.AI learning platform beta!

Want to learn more about Generative AI?

Keep learning with updates on curated AI news, courses, and events, as well as Andrew’s thoughts from DeepLearning.AI!