June 2025

OpenAI Chat Completions Web Search Tool Support

June 24th, 2025

We now support two of OpenAI’s Search Preview models, GPT 4o Search Preview and GPT 4o Mini Search Preview, within Vellum to make use of two new Web Search tools that OpenAI has released for their Chat Completions Web Search models:

  • Search Context Size: Giving you the ability to set whether you would like to use low, medium, or high search context.
  • User Location: Giving you the ability to restrict the models search scope to a specific users location.

Draggable Custom Nodes from Side Panel

You can now drag and drop Custom Nodes directly from the side panel into your Workflow graph on any SDK-enabled Workflows that use a Custom Docker Image with Custom Nodes. To enable this feature, ensure your Custom Docker Image includes a vellum_custom_nodes folder containing your Node. Once you build and push the image to Vellum, your Custom Nodes will automatically appear in the UI side panel. This makes it significantly easier for non-engineers in your Workspace to build Workflows that feature reusable logic as its own Node!

Custom Images for Running Workflows

Workflows that are SDK enabled can now be run in a Docker Image of your choice! By default, all Workflows run in our base image, vellumai/python-workflow-runtime:latest. You can now extend that base image to define a new Docker image, push it up to Vellum, then associate it with your Workflow:

Custom Docker Image

Pushing up your own Docker Image is most valuable for those who want to give their Workflows access to custom packages or libraries. For more information on how to set this up for your Workspace, check out our docs.

Custom Nodes Run in Vellum

June 18th, 2025

The Workflows SDK has support for defining Custom Nodes. You can now run vellum workflows push [module] on any Workflow that features a Custom Node, and that Node will be runnable in the UI!

Custom Node Chain

You can use Custom Nodes to execute any logic you want, allowing Sandbox users a simple interface for configuring what goes into the node. They also support all of the other features now common to Workflow Nodes:

  • Ports
  • Adornments
  • Trigger behavior
  • Expressive Attributes
  • and more!

Custom Nodes in the UI have the following limitations that we are hoping to alleviate soon:

  • run method is not yet editable from the UI
  • Initiating a new Custom Node from the graph

Support for Codex Mini (Latest)

June 17th 2025

We’ve added support for OpenAI’s codex-mini-latest model.

Support for new Gemini 2.5 models

June 17th 2025

We’ve added support for the following new Gemini 2.5 models:

  • Gemini 2.5 Pro (Stable)
  • Gemini 2.5 Flash (Stable)
  • Gemini 2.5 Flash Lite (06/17 Preview)

Support for Gemini 2.5 Pro Preview 06-05

June 13th 2025

We’ve added support for Gemini API’s newest version of Gemini 2.5 Pro, the the June 5th Gemini 2.5 Pro Preview.

Support for OpenAI’s Responses API released with O3 Pro

June 11th 2025

We’ve added support for OpenAI’s new Responses API endpoint, unlocking the ability to integrate with OpenAI models that are invokable via the Responses API. Along with support for Responses API, the first model we’ve chosen to integrate is the newly released O3 Pro model.

GPT-4o Audio Preview (2025-06-03)

June 4th, 2025

We’ve added the new gpt-4o-audio-preview-2025-06-03 model from OpenAI to Vellum.

Duplicate Test Cases in Evaluation Reports

You can now duplicate Test Cases directly from the Evaluation Report UI — making it much faster to create slight variations without starting from scratch.

After selecting one or more Test Cases in the table, a Duplicate button will appear in the toolbar. Clicking it will instantly create copies of the selected Test Cases with all values duplicated.

Evaluation Report showing Duplicate button in toolbar with selected Test Cases
Duplicate button appears in toolbar when Test Cases are selected

This is especially useful when you’re adding a few new Test Cases that are mostly the same as existing ones — no need to manually recreate them or switch to CSV import just to save time.

Bulk Apply Value to Test Cases

You can now efficiently apply a cell’s value to multiple Test Cases at once. A new icon button appears in each Test Case cell that, when clicked, opens a confirmation modal asking whether you want to apply the current cell’s value to:

  • All Test Cases if none are selected
  • Only selected Test Cases if one or more are selected
Test Suite interface showing bulk apply functionality with icon button
Bulk apply value feature showing the new icon button

This feature significantly reduces repetitive manual edits when you need to set the same value across multiple Test Cases. Helpful tooltip and modal messages clearly indicate whether the action will affect all Test Cases or just the selected ones, making it easy to understand the scope of your changes before applying them.

Edit Test Cases in a Resizable Side Drawer

June 4th, 2025

We’ve updated the Evaluation Report table to make editing Test Cases smoother and more intuitive.

Side Drawer for Editing

Click on any editable cell to open a right-side drawer where you can:

  • Edit variable values and row details
  • Switch between “Values” and “Details” tabs
  • Save or reset your changes
  • Navigate between rows with Next/Previous buttons
Test Case editing side drawer with Values tab showing variable editing interface
Test Case editing side drawer showing Values tab

Cleaner, Focused UI

Editing is now more spacious and organized with resizable drawer and inputs—no more cramped inline inputs.

Better Keyboard & Focus Handling

Fields auto-focus when selected, and scroll into view with enhanced keyboard shortcuts:

  • ⌘ + S (or Ctrl + S) – Save current edits
  • ⌘ + ↑ / ⌘ + ↓ (or Ctrl + arrow) – Move to previous/next row

This update makes it easier to view and edit full Test Cases—especially helpful when working with complex inputs or many variables.

Updated Deployment Flow

We’ve redesigned the Deployment Flow for Prompt and Workflow Sandboxes to provide a cleaner, more intuitive experience. The Create and Update Deployment forms have been streamlined with improved organization and clearer visual hierarchy.

New Create Deployment form showing cleaner layout with Create New and Update Existing tabs
Redesigned Create Deployment form with improved layout

Additionally, the Releases tab in the Deployment Details page has been redesigned for better usability and visual clarity, making it easier to manage Release Tags and track Deployment history.

Redesigned Releases tab showing cleaner deployment information and release management interface
Improved Releases tab in Deployment Details

Condensed Node View

June 4th, 2025

You can now enable Condensed Node View from the Navigation Settings to streamline your workflow interface. This feature displays all Nodes in a more compact format, significantly reducing visual clutter and making it easier to navigate complex workflows with many Nodes.

This is particularly useful when working with large, multi-step workflows where the standard Node view can become overwhelming. The condensed view helps you maintain a clear overview of your entire workflow structure while still preserving full functionality—simply click on any Node to expand it and make changes as needed.

Deployment Release Descriptions

You can now add descriptions to your Prompt and Workflow Deployments during the Deployment process. This new feature allows you to document the purpose, changes, or context for each Deployment directly within the platform.

When creating a new Deployment, you’ll see an optional description field where you can provide details about what this specific Deployment includes, why it was created, or any other relevant information for your team.

Deploy Prompt modal showing Release Description field
Release Description field in the Deploy Prompt modal

Once deployed, the Release Description will be visible in the Deployment Details page, providing valuable context about what changed in each release.

Deployment Details page showing Release Description
Release Description displayed in Deployment Details

This feature helps teams maintain better documentation of their Deployment history and understand the evolution of their Prompts and Workflows. Coming soon: You will also be able to add and edit descriptions after a Deployment has been created.

Prompt & Workflow Descriptions

June 3rd, 2025

You can now specify a description for a Prompt or Workflow. To add a description, click on “Edit Details” from within the More Menu.

Edit Details option in the More Menu
Edit Details option in the More Menu

This will open a modal where you can edit the Prompt/Workflow’s label as well as description.

Edit Details modal showing label and description fields
Edit Details modal for adding descriptions

Upon specifying a description, an info icon will appear where you and others can hover over to see a tooltip explaining what the Prompt/Workflow is intended to do. Descriptions are also shown in the List View of Prompt/Workflow index pages.

Specifying descriptions can serve as a helpful reminder for what the Prompt or Workflow is meant to do, as well as provide documentation for others on your team.