2024

Changelog | February, 2024

Add Entity to Folder API

February 29th, 2024

We’ve exposed a new API endpoint to add an existing entity to an existing folder. This is useful if you want to programmatically organize your entities in Vellum. You can find the new endpoint and details on how to invoke it in our API documentation.

Vellum is SOC 2 Type 2 Compliant

February 28th, 2024

Vellum is now SOC 2 Type 2 compliant! This means that an independent auditor has verified that Vellum’s information security practices, policies, and procedures meet the SOC 2 standards for security, availability, processing integrity, confidentiality, and privacy. If you’d like to learn more about Vellum’s security practices or request a copy of our SOC 2 report, please reach out to us at security@vellum.ai.

Save Workflow Execution from Details Page

February 23rd, 2024

Previously you were able to save your workflow execution to a test suite or sandbox scenario from the executions table. Now you can do the same from each execution’s details page! Both the “Save As Test Case” and “Save As Scenario” buttons should now appear on the top right of the execution:

Save Workflow Execution Details

Workflow Builder UI Settings

February 21st, 2024

Have you ever wanted to pan around workflows using the W-A-S-D keys? Looking for more control over your screen real estate?

Good news! You can now adjust these settings and more in the new workflow UI settings! Access the settings by clicking the new gear icon in the top right of your workflow builder.

Workflow Builder Settings

Custom Release Tags

February 21st, 2024

You can now manage your Prompt and Workflow release process with greater flexibility and control using Custom Release Tags! Pin your Vellum API requests to tags you define for a given Prompt/Workflow Deployment. These tags can be easily re-assigned within the Vellum app so you can update your production, staging or other custom environment to point to a new version of a prompt or workflow — all without making any code changes!

Going forward, new customers of Vellum will no longer see the legacy “Environment” tags in Vellum’s UI. Custom Release Tags are the new, first-class mechanism for managing different releases of the same prompt/workflow in Vellum. We will slowly be deprecating and removing the legacy “Environment” tags for existing customers.

Learn more about Managing Releases in our Help Center article or watch the video walkthrough below:

Better Function Call Display

February 15th, 2024

We’ve beautified the display of model function calls in both prompt sandboxes and workflow prompt nodes! Say goodbye to the hard to read and mundane JSON strings.

Fireworks Function Call Model

Evaluation Reports

February 12th, 2024

Test Suite Runs have received a big upgrade, and now live in its own tab - Evaluations. You are now able to compare a Prompt or Workflow Variant against a Deployment, and view aggregate metrics like Median or P90.

See a demo of the complete set of updates here:

Fireworks Function Calling Model

February 5nd, 2024

OpenAI’s GPT models have traditionally led the way in supporting structured data generation through function calling. But late last year Fireworks AI splashed in with their own function calling model! This model is now available in Vellum for those interested in an open source alternative to GPT.

Fireworks Function Call Model


Cloning Workflow Nodes

February 2nd, 2024

When you hover over any node in your Workflow editor, you will see a new Duplicate Node icon. Clicking on this will create a new copy of a node! Never again will you need to start a node from scratch when you want to just tweak a field or two.

Clone Nodes


Prompt Node Retries

February 1st, 2024

You can now detect when a Prompt Node within a Workflow errors by using a Conditional Node. Using this, you can now build out retry logic around Prompt Nodes within your Workflow! This is useful if you want to catch retryable errors (like rate limit errors from an LLM provider) and try making the call to the LLM again.

See a demo of it in action here: