Multimodal Retrieval Augmented Generation (RAG) using the Vertex AI Gemini API

About this course

This is a self-paced lab that takes place in the Google Cloud console. In this lab, you learn how to perform multimodal retrieval augmented generation (RAG) using Vertex AI Gemini API.

What you will learn

• Extract and store metadata of documents containing both text and images, and generate embeddings the documents.
• Search the metadata with text queries to find similar text or images.
• Search the metadata with image queries to find similar images.Using a text query as input, search for contextual answers using both text and images.