Changelog | September, 2024

Interactive Pages in Single Editor Mode

September 7th, 2024

It used to be that when two people were on the same Prompt/Workflow Sandbox, only one person could edit and interact with the page. If you were a Viewer, you were unable to interact with the page at all and were blocked with a big page overlay.

Now, the page overlay is gone and Viewers can interact with the page in a read-only mode and perform actions that don’t affect the state of the page. This includes things like scrolling, opening modals, copying text, etc.

Expand Cost in Execute Prompt APIs

September 4th, 2024

You can now opt in to receive the cost of a Prompt’s execution in the response of the Execute Prompt and Execute Prompt Stream APIs.

This is helpful if you want to capture the cost of executing a Prompt in your own system or if you want to provide cost transparency to your end users.

To opt in, you can pass the expand_meta field in the request body with the cost key set to true.

1{
2 ...,
3 "expand_meta" : {
4 "cost": true
5 }
6}

You can expect a corresponding value to be included in the meta field on the response:

1{
2 ...,
3 "meta": {
4 "cost" : {
5 "value" : 0.000450003,
6 "unit" : "USD"
7 }
8 }
9}

This functionality is available in our SDKs beginning v0.8.9.

Default Block Type Preference

September 4th, 2024

You can now set a default Block type to use when defining Prompts in Vellum. Whenever you see the “Add Block” or “Add Message” options in a Prompt Editor, your preferred Block type will be used.

By default, the Block type is set to “Rich Text,” the newer option that supports Variable Chips. You can still switch between Block types for individual Blocks within the Prompt Editor.

default block type toggle

New and Improved Code Editor

September 3rd, 2024

We now use Monaco Editor for our code editor that is used by Workflow Code Nodes and custom Code Evaluation Metrics. Monaco is the same editor that Visual Studio Code uses under the hood.

This offers a number of improvements including IntelliSense, semantic validation and syntax validation. Additionally we now inject Vellum Value types into the editor, so you can now have fully typed input values for things such as Chat History. Some of these improvements are currently only available for TypeScript and not Python.

VPC Disable gVisor Option for Code Execution

September 3rd, 2024

VPC customers of Vellum can now disable gVisor sandboxing for code execution in self-hosted environments to significantly improve the performance of Code Nodes in Workflows. gVisor is needed for secure sandboxing in our Managed SASS platform, but in a self hosted environment where you’re the only organization, it’s not strictly required if you trust that users within your org won’t run malicious code.

gVisor self hosted flag

Download Original Document from UI

September 2nd, 2024

You can now download a file that was originally uploaded as a Document to a Document Index from the UI. You’ll find a new “Download Original” option in a Document’s ••• More Menu.