Changelog | February, 2024
Add Entity to Folder API
February 29th, 2024
We’ve exposed a new API endpoint to add an existing entity to an existing folder. This is useful if you want to programmatically organize your entities in Vellum. You can find the new endpoint and details on how to invoke it in our API documentation.
Vellum is SOC 2 Type 2 Compliant
February 28th, 2024
Vellum is now SOC 2 Type 2 compliant! This means that an independent auditor has verified that Vellum’s information security practices, policies, and procedures meet the SOC 2 standards for security, availability, processing integrity, confidentiality, and privacy. If you’d like to learn more about Vellum’s security practices or request a copy of our SOC 2 report, please reach out to us at security@vellum.ai.
Save Workflow Execution from Details Page
February 23rd, 2024
Previously you were able to save your workflow execution to a test suite or sandbox scenario from the executions table. Now you can do the same from each execution’s details page! Both the “Save As Test Case” and “Save As Scenario” buttons should now appear on the top right of the execution:
Workflow Builder UI Settings
February 21st, 2024
Have you ever wanted to pan around workflows using the W-A-S-D keys? Looking for more control over your screen real estate?
Good news! You can now adjust these settings and more in the new workflow UI settings! Access the settings by clicking the new gear icon in the top right of your workflow builder.
Custom Release Tags
February 21st, 2024
You can now manage your Prompt and Workflow release process with greater flexibility and control using Custom Release Tags! Pin your Vellum API requests to tags you define for a given Prompt/Workflow Deployment. These tags can be easily re-assigned within the Vellum app so you can update your production, staging or other custom environment to point to a new version of a prompt or workflow — all without making any code changes!
Going forward, new customers of Vellum will no longer see the legacy “Environment” tags in Vellum’s UI. Custom Release Tags are the new, first-class mechanism for managing different releases of the same prompt/workflow in Vellum. We will slowly be deprecating and removing the legacy “Environment” tags for existing customers.
Learn more about Managing Releases in our Help Center article or watch the video walkthrough below:
Better Function Call Display
February 15th, 2024
We’ve beautified the display of model function calls in both prompt sandboxes and workflow prompt nodes! Say goodbye to the hard to read and mundane JSON strings.
Evaluation Reports
February 12th, 2024
Test Suite Runs have received a big upgrade, and now live in its own tab - Evaluations. You are now able to compare a Prompt or Workflow Variant against a Deployment, and view aggregate Metrics like Median or P90.
See a demo of the complete set of updates here:
Fireworks Function Calling Model
February 5nd, 2024
OpenAI’s GPT models have traditionally led the way in supporting structured data generation through function calling. But late last year Fireworks AI splashed in with their own function calling model! This model is now available in Vellum for those interested in an open source alternative to GPT.
Cloning Workflow Nodes
February 2nd, 2024
When you hover over any node in your Workflow editor, you will see a new Duplicate Node icon. Clicking on this will create a new copy of a node! Never again will you need to start a node from scratch when you want to just tweak a field or two.
Prompt Node Retries
February 1st, 2024
You can now detect when a Prompt Node within a Workflow errors by using a Conditional Node. Using this, you can now build out retry logic around Prompt Nodes within your Workflow! This is useful if you want to catch retryable errors (like rate limit errors from an LLM provider) and try making the call to the LLM again.
See a demo of it in action here: