For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
BlogLog InRequest Demo
HomeProductDevelopersSelf-HostingChangelog
HomeProductDevelopersSelf-HostingChangelog
  • Getting Started
    • Overview
  • Agent Builder
    • Using the Agent Builder
  • Prompts
    • Prompt Engineering
    • Collaboration
    • Custom Models
    • Multimodality
    • Prompt Caching
  • Workflows
    • Introduction
    • Experimenting
    • Integrating
      • Overview
      • RAG System
      • Escalation to a Human
      • Prompt Retry Logic
      • PDF Content Summarization
      • Fallback Models
    • Function Calling
  • Evaluation & Test Suites
    • Quantitative Evaluation
    • Evaluating RAG Pipelines
    • Online Evaluations
  • Metrics
    • Out of the Box Metrics
    • Custom Metrics
    • Reusing Metrics in Test Suites
  • Deployments
    • Deployment Lifecycle Management
    • Observability in Production
    • Environments
    • Release Tags
    • Release Reviews
  • Monitoring
    • Monitoring Production Trends
    • Track Workflow Execution Costs
    • Datadog Integration
    • Webhook Integration
    • Execution URLs
  • Documents
    • Uploading Documents
    • Integrating w/ Search API
    • Metadata Filtering
  • Security
    • Data Privacy and Storage
    • HMAC Authentication
    • Role-Based Access Control (RBAC)
    • Static IPs
  • Organizations
    • Manage Organization Access
    • Data Retention Policies
LogoLogo
BlogLog InRequest Demo
On this page
  • Implementation Steps
WorkflowsCommon Architectures

RAG System Architecture

Was this page helpful?
Previous

Escalation to a Human

Next
Built with

LLM applications often require specific context from a Vector DB which is added into the prompt. Forget signing up for multiple systems and being stuck on various micro decisions, with Vellum you can prototype a RAG system in minutes.

Implementation Steps

1

Create a Document Index and upload your documents

Follow this article for tips: Uploading Documents)

2

Add a Search Node in your Workflow

Place this anywhere and connect it to the “entrypoint”

3

Add a Prompt Node

The prompt node should take the results of your Search Node as an input variable

4

Link to a Final Output or other downstream node

For example, if the Prompt Node result is a certain value branch execution based on a Conditional Node)

5

Set up input variables and hit Run!

Retrieval Augmented Generation (RAG) system