Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
138 changes: 111 additions & 27 deletions build/invent/invent.mdx → _snippets/invent.mdx
Original file line number Diff line number Diff line change
@@ -1,35 +1,117 @@
---
title: "Build with Invent"
sidebarTitle: "Build with Invent"
description: "Invent is a forward deployed agent that builds, manages, and improves the specialist Agents that run your business processes."
---
Invent is a forward deployed AI Agent built into Relevance AI. You say how the work should run, and Invent builds and manages the Agent team that does it. It works across your entire project rather than inside any one Agent or Tool, so it can create, edit, and understand almost anything in the platform.

<img src="/images/what-is-invent.png" alt="The Invent panel in Relevance AI" />
<img src="/images/invent-panel.png" alt="The Invent panel showing its greeting, suggested actions, and the message composer" />

## What is Invent
## What can Invent do?

Invent is a forward deployed agent built into Relevance AI. Give it a business process and it works with you to understand how that process runs, including the systems involved and the decisions that require judgment.
Each area below is something Invent can reach directly. In all of them it acts with your own permissions, inside the project you have open.

It then creates and coordinates the Agents, Tools, Triggers, and Workforces needed to carry out the process, with performance requirements in place before real work begins.
<AccordionGroup>
<Accordion title="Agents" icon="robot">
Invent builds and runs your Agents end to end.

- Create, update, publish, and delete an Agent
- Read, search, and edit its system prompt
- Attach and detach the Tools it can use
- Trigger a run and poll the result
- Read a task's summary, messages, and metadata
- Cancel a running task
</Accordion>
<Accordion title="Tools" icon="screwdriver-wrench">
Invent assembles Tools a step at a time, or starts from one that already exists.

- Create, update, publish, delete, and bulk delete Tools
- Add, update, reorder, and remove steps
- Set what the Tool returns
- Trigger a run, poll the result, and cancel one mid-flight
- Read the latest run or look back through previous runs
- Search and clone public Tools and Marketplace listings
- Browse the Tool step library, check what a step needs, and build a Tool from one
</Accordion>
<Accordion title="Workforces" icon="users-gear">
Invent wires Agents into a Workforce and runs it.

- Create, update, publish, and delete a Workforce
- Turn its Trigger on or off
- Trigger a run and poll the result
- Read a task's messages and metadata
- Cancel a running task
</Accordion>
<Accordion title="Knowledge" icon="brain">
Invent manages the Knowledge tables your Agents read from.

Its job continues after launch. Invent reviews live performance, detects quality problems, and proposes and tests improvements. You bring the process knowledge; Invent builds and manages the Agent team underneath it.
- Create, update, and delete Knowledge tables
- Add, update, and delete rows
- Read a whole table or a single row
- Export the contents
</Accordion>
<Accordion title="Triggers" icon="bolt">
Invent sets up what starts an Agent without you.

## What can Invent do?
- List the Triggers already on an Agent
- Create a Trigger
- Enable or disable one
- Delete one
</Accordion>
<Accordion title="Evals and performance" icon="gauge">
Invent can build the whole quality setup, run it, and watch it.

- Build and maintain the reusable Checks library
- Create scenarios, and attach or detach Checks on them
- Configure how a scenario is simulated
- Group scenarios into test sets
- Run an evaluation, poll it, and cancel or delete a run
- Read run summaries and individual test results
- Create Performance dashboards and attach Checks to them
- Read a dashboard's time series and its run history
- Create, update, and delete alarms
- Configure the pre-publish check and poll its status
</Accordion>
<Accordion title="Version control" icon="clock-rotate-left">
Agents, Tools, and Workforces all keep a version history, and Invent can move through it. It asks before restoring, and the live published version stays untouched until you publish.

<CardGroup cols={2}>
<Card title="Understand your process" icon="magnifying-glass">
Invent works through your process with you, including its inputs, systems, judgment calls, exceptions, and definition of success. It can read the process back to you, identify missing information, and help determine which parts should become Tools, Agents, or Workforces.
</Card>
<Card title="Build and connect the Agent team" icon="diagram-project">
Invent creates the Agents needed for the process, equips them with the required Tools and context, connects the systems where the work happens, and wires the Triggers and Workforces that coordinate the process from end to end.
</Card>
<Card title="Set and maintain the quality bar" icon="gauge">
Invent defines the checks each Agent must pass before launch and samples live runs after deployment. When quality drops, it diagnoses the problem and proposes changes to prompts, Tools, examples, models, or orchestration. It can test those changes against the same requirements before you approve them.
</Card>
<Card title="Review performance and find opportunities" icon="chart-line">
Invent reviews Agent activity, errors, Evals, and performance dashboards to diagnose problems and recommend improvements. Describe a recurring process, and it can help identify where Agents, Tools, or Workforces could automate it.
</Card>
</CardGroup>
- List the versions of an Agent, Tool, or Workforce
- Read any single version
- Rename a version
- Restore an earlier version into the current draft
</Accordion>
<Accordion title="Analytics and monitoring" icon="chart-line">
Invent reads the same numbers you do when something looks wrong.

- Pull a scorecard for an Agent, Tool, or Workforce
- Read the error records behind a problem
- Chart usage over time, or break it down by resource
- Chart Agent activity over time
- Read the current task counts, including what is waiting for review, escalated, or errored
- List the tasks themselves
</Accordion>
<Accordion title="Integrations and MCP" icon="plug">
Invent uses what you have already connected; authenticating an account stays yours to do.

- See which accounts are connected and which providers are available
- Check whether a Tool has the integrations it needs
- Check whether an API key is available
- List the Slack channels it can post to
- List your project's MCP servers and the Tools they expose, and call them
</Accordion>
<Accordion title="Working with you" icon="comments">
Invent works in the open rather than silently.

- Ask you questions before it builds
- Read a plan back and confirm it with you
- Spawn subagents to work in parallel
- Read, write, edit, list, and delete the files in a conversation
</Accordion>
<Accordion title="Project setup" icon="folder-tree">
Invent keeps the project around the work tidy.

- Read your project's details
- Create, rename, and delete folders
- List the LLM models available to you
- Set and clear task priority on a resource
- File a bug report to the Relevance AI engineering team
</Accordion>
</AccordionGroup>

## Where to find Invent

Expand Down Expand Up @@ -89,7 +171,7 @@

<AccordionGroup>
<Accordion title="Project isolation">
Invent's access to Relevance AI is scoped to the active project at the API-key and fine-grained authorization layers, not only in the interface. Each internal platform request uses the active project ID and the caller's API key, then passes through the standard authorization checks. Enabling Invent in a sandbox project does not grant it access to assets in a production project.

Check warning on line 174 in _snippets/invent.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

_snippets/invent.mdx#L174

Did you really mean 'Invent's'?
</Accordion>

<Accordion title="Integration reach">
Expand Down Expand Up @@ -187,12 +269,14 @@
</AccordionGroup>
</Tab>
<Tab title="Manage performance">
Invent's job continues after launch. It watches live performance, spots where quality slips, and proposes improvements it has already tested.

<AccordionGroup>
<Accordion title="Scheduled check-ins" icon="calendar-clock">
<img src="/images/invent-scheduled-check-ins.png" alt="A scheduled check-in in Invent" />

<Note>
Before setting up a scheduled check-in, add an email or Slack notification channel in [Alerts](/build/invent/invent#alerts) so Invent can notify you about the result.
Before setting up a scheduled check-in, add an email or Slack notification channel in [Alerts](#alerts) so Invent can notify you about the result.
</Note>

#### Schedule a check-in
Expand Down Expand Up @@ -291,7 +375,7 @@

#### Turn on auto-diagnosis

Turn on **Auto-diagnosis by Invent** to investigate the first breach and send a diagnosis and proposed fix to the alarm creator's [Invent alert channels](/build/invent/invent#alerts). Invent still shares its findings if the cause is unclear and never applies changes without your approval.
Turn on **Auto-diagnosis by Invent** to investigate the first breach and send a diagnosis and proposed fix to the alarm creator's [Invent alert channels](#alerts). Invent still shares its findings if the cause is unclear and never applies changes without your approval.

<Note>
Alarms are configured in an Agent or Workforce's **Evaluate → Monitor** area, not in Invent settings.
Expand Down
7 changes: 7 additions & 0 deletions admin/invent.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
---
title: "Use Invent"
sidebarTitle: "Use Invent"
description: "Meet your personal forward deployed agent built into Relevance AI."
---

<Snippet file="invent.mdx" />
2 changes: 1 addition & 1 deletion build/agents/build-your-agent/version-history.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ The panel lists every saved version with its name, who saved it, and its descrip
The three-dot menu only lists **Versions** in the builder. It's hidden on an Agent's Use tab, when you're not on the Workforce Build tab, and in the Tool builder embedded inside the Agent builder, where you need to open the Tool on its own page instead.
</Note>

To restore a version, click the three-dot menu on that version in the panel, then select **Restore this version**. You can also ask [Invent](/build/invent/invent) in plain language. Either way the restored state lands in draft, so you review it and publish when ready.
To restore a version, click the three-dot menu on that version in the panel, then select **Restore this version**. You can also ask [Invent](/build/invent) in plain language. Either way the restored state lands in draft, so you review it and publish when ready.

### With Invent

Expand Down
6 changes: 3 additions & 3 deletions build/introduction.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -18,9 +18,9 @@

Invent is one of the main ways to build in Relevance AI. Describe a business process in plain language and work with Invent to define its inputs, systems, decisions, exceptions, and measures of success.

Invent creates and connects the Agents, Tools, Triggers, Knowledge, and Workforces needed to run the process. After launch, it can review Evals and live performance, diagnose quality problems, and propose tested improvements for your approval.

Check warning on line 21 in build/introduction.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

build/introduction.mdx#L21

Did you really mean 'Evals'?

<Card title="Explore Invent" icon="wand-magic-sparkles" href="/build/invent/invent">
<Card title="Explore Invent" icon="wand-magic-sparkles" href="/build/invent">
Learn how Invent helps you understand a process, build the Agent team, and maintain its quality after launch.
</Card>

Expand Down Expand Up @@ -48,7 +48,7 @@
You can work with Invent or configure each component directly:

<CardGroup cols={2}>
<Card title="Build with Invent" icon="wand-magic-sparkles" href="/build/invent/invent">
<Card title="Build with Invent" icon="wand-magic-sparkles" href="/build/invent">
Describe a business process in plain language. Invent builds and connects the Agents, Tools, Knowledge, Triggers, and Workforces needed to run it, then helps monitor and improve performance after launch.
</Card>
<Card title="Build directly" icon="hammer" href="/build/agents/create-an-agent">
Expand All @@ -58,4 +58,4 @@

## What's next?

Start with [Invent](/build/invent/invent) to build and manage a process with natural language. To configure each component directly, begin with [building an agent's prompt](/build/agents/build-your-agent/prompt), then explore how to create [custom tools](/build/tools/customize-tool/tool-style-guide), connect [knowledge sources](/build/knowledge/create-knowledge), and wire it all together in a [workforce](/build/workforces/build-an-ai-workforce/add-triggers).
Start with [Invent](/build/invent) to build and manage a process with natural language. To configure each component directly, begin with [building an agent's prompt](/build/agents/build-your-agent/prompt), then explore how to create [custom tools](/build/tools/customize-tool/tool-style-guide), connect [knowledge sources](/build/knowledge/create-knowledge), and wire it all together in a [workforce](/build/workforces/build-an-ai-workforce/add-triggers).
7 changes: 7 additions & 0 deletions build/invent.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
---
title: "Use Invent"
sidebarTitle: "Use Invent"
description: "Meet your personal forward deployed agent built into Relevance AI."
---

<Snippet file="invent.mdx" />
2 changes: 1 addition & 1 deletion changelog.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -12,9 +12,9 @@

The newest version of Invent is now available.

Invent can create and edit Agents, Tools, Workforces, Knowledge tables, Triggers, and Evals, run tasks, pull your analytics, and much, much more. It has context over everything in your project and acts as a specialist who can help you create almost anything inside of Relevance AI.

Check warning on line 15 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L15

Did you really mean 'Evals'?

Open Invent from the badge tucked into the right edge of the screen, from the button in the bottom-right corner of the Home page, or from Invent in the left navigation menu. Invent is enabled per project: an organization admin opens Settings → Projects, selects the project, clicks Manage settings, and turns on the Invent toggle. See [Build with Invent](/build/invent/invent) for more information on using and configuring Invent.
Open Invent from the badge tucked into the right edge of the screen, from the button in the bottom-right corner of the Home page, or from Invent in the left navigation menu. Invent is enabled per project: an organization admin opens Settings → Projects, selects the project, clicks Manage settings, and turns on the Invent toggle. See [Use Invent](/build/invent) for more information on using and configuring Invent.

</Update>

Expand All @@ -22,27 +22,27 @@

## Concurrency visibility for project and organization admins

![Concurrency panel showing a seven-day usage chart with queued runs stacked in red above the limit line, 20 of 20 slots in use with 6 tasks waiting, and a live capacity by project bar with other projects anonymized](/images/changelog/changelog-concurrency-visibility.png)

Check warning on line 25 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L25

Did you really mean 'anonymized'?

Concurrency monitoring on the Analytics page now covers queued runs, live slot counts, and a per-project capacity breakdown.

Queued runs now stack in red above the limit line on the usage chart, live counters show slots in use and tasks waiting, and a per-project bar attributes running slots to the projects holding them. Between them you can see whether you're at the limit, how much is queued behind it, and which project is consuming the capacity. Project admins see the same charts with other projects' names and task details anonymized.

Check warning on line 29 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L29

Did you really mean 'anonymized'?

Project admins find the chart on the Analytics page; organization admins can also view it on the Plan & Billing page.

</Update>

<Update label="June 29, 2026" description="Eval cost breakdowns and Workforce evaluations">

Check warning on line 35 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L35

Did you really mean 'Eval'?

## Eval cost breakdowns and Workforce evaluations

![Eval run cost breakdown panel showing total credits and actions, with per-component rows for Scenario Runner, Agent Execution, and Checks broken down by AI Judge model and Tool Usage](/images/changelog/changelog-eval-cost-breakdown.png)

Check warning on line 39 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L39

Did you really mean 'Eval'?

Eval runs now show exactly where their cost goes, itemized per check, and cover full Workforce runs including sub-agent and tool calls.

Check warning on line 41 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L41

Did you really mean 'Eval'?

Each completed Eval run renders a cost breakdown panel that itemizes credit and action consumption per component. Checks account for 1 action per run across every check type, including LLM as Judge and Tool Usage, so the panel's totals reconcile to the exact source of every credit and action. Workforce runs that fan out to sub-agents or call tools record and evaluate each of those interactions, the same as individual Agent runs.

Check warning on line 43 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L43

Did you really mean 'Eval'?

To see the breakdown, open any completed Eval run; the panel appears alongside the results. See the [Evals documentation](/build/agents/evals/introduction) for full details.

Check warning on line 45 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L45

Did you really mean 'Eval'?

</Update>

Expand Down Expand Up @@ -80,7 +80,7 @@

![Microsoft Teams trigger settings showing the new Outreach replies only toggle enabled](/images/changelog/changelog-teams-outreach.png)

Microsoft Teams triggers now support an **Outreach replies only** mode that limits responses to direct replies on the Agent's own outbound DMs.

Check warning on line 83 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L83

Did you really mean 'DMs'?

The trigger distinguishes between inbound replies (replies to messages your Agent sent) and channel mentions. In outreach-only mode, only inbound replies route to the Agent — channel chatter doesn't trigger a run.

Expand Down Expand Up @@ -134,7 +134,7 @@

You can now manage public sharing settings for all agents, workforces, and tools from one central location!

Project-Level Public Agent Controls give admins the power to disable public cloning and embeddability across their entire workspace with a single setting. When you disable these features at the project level, they’re automatically turned off for all agents, workforces, and tools—and individual users can’t re-enable them.

Check warning on line 137 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L137

Did you really mean 'embeddability'?

➡️ Centralized control – Manage security settings for all assets from one place

Expand Down Expand Up @@ -182,7 +182,7 @@

![Agent Performance Observability](/images/changelog/changelog-observability.webp)

You can now track how your agents perform in real-world scenarios with comprehensive production monitoring! Just like software development has build → test → monitor stages, agent development now has the same complete lifecycle. After building your agents and testing them with Evals, you need visibility into production performance at scale.

Check warning on line 185 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L185

Did you really mean 'Evals'?

➡️ **Automatic evaluation** – Set up LLM judges to continuously assess your agents on custom criteria like summary quality, hallucination detection, and workflow execution

Expand All @@ -194,7 +194,7 @@

With Agent Performance Observability, you can catch performance degradations immediately—like when a model update changes behavior or agents start hallucinating—instead of discovering issues weeks later.

🔐 **Permissions required:** Available exclusively for select Enterprise customers. Evals delivers the advanced testing capabilities needed for mission-critical AI deployments. This feature is not available on non-Enterprise plans.

Check warning on line 197 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L197

Did you really mean 'Evals'?

To access Agent Performance Observability, enterprise users can go to their agent’s dashboard and select the “Monitor” tab, then navigate to the “Test Suites” section. If you’re on an Enterprise plan and don’t yet have access, contact your Relevance AI sales representative to register interest.

Expand Down Expand Up @@ -253,13 +253,13 @@

</Update>

<Update label="March 10, 2026" description="Monitor organization concurrency usage with detailed analytics and timeseries data">

Check warning on line 256 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L256

Did you really mean 'timeseries'?

![Monitor organization concurrency usage with detailed analytics and timeseries data](/images/changelog/changelog-concurrency.webp)

**Org Concurrency Timeseries: Track Your Organization’s Performance Analytics**

Check warning on line 260 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L260

Did you really mean 'Timeseries'?

You can now monitor your organization’s concurrency usage and limits with detailed timeseries data!

Check warning on line 262 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L262

Did you really mean 'timeseries'?

View comprehensive analytics directly from your organization settings page under the Plan & Billing section, giving you complete visibility into how your team uses Relevance AI’s resources.

Expand All @@ -269,9 +269,9 @@

➡️ Usage limit monitoring – Keep track of your current usage against your plan limits to avoid unexpected throttling

➡️ Visual timeseries charts – Easy-to-read graphs show your concurrency patterns, helping you identify optimization opportunities

Check warning on line 272 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L272

Did you really mean 'timeseries'?

With Org Concurrency Timeseries, you can make data-driven decisions about your AI operations, ensuring optimal performance and resource allocation across your entire organization.

Check warning on line 274 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L274

Did you really mean 'Timeseries'?

🔐 Permissions required: Organization Admin access to view billing and usage analytics

Expand Down Expand Up @@ -507,11 +507,11 @@

![Claude Opus 4.6 model now available in Relevance AI](/images/changelog/68faec2d3ffbd34e9c9295b9-changelog-claude.webp)

**Claude Opus 4.6: Anthropic's Most Advanced AI Model Now Available**

Check warning on line 510 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L510

Did you really mean 'Anthropic's'?

You can now access Anthropic's flagship Claude Opus 4.6 model directly in the platform, with an optional 1M context window variant for handling massive documents!

Check warning on line 512 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L512

Did you really mean 'Anthropic's'?

Claude Opus 4.6 delivers exceptional performance on complex reasoning, coding, and advanced agentic tasks. This latest version brings Anthropic's most powerful AI capabilities to your workflows, with both standard and extended context options to match your specific needs.

Check warning on line 514 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L514

Did you really mean 'agentic'?

Check warning on line 514 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L514

Did you really mean 'Anthropic's'?

➡️ Standard 200K token context window – Process lengthy documents and conversations with ease

Expand All @@ -519,7 +519,7 @@

➡️ Adaptive thinking support – Tackle complex reasoning and multi-step problem solving

➡️ Advanced image processing – Work with jpg, jpeg, gif, webp, and png files

Check warning on line 522 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L522

Did you really mean 'jpeg'?

Check warning on line 522 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L522

Did you really mean 'gif'?

Check warning on line 522 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L522

Did you really mean 'webp'?

➡️ Exceptional output quality – Benefit from improved reasoning and response generation

Expand Down Expand Up @@ -563,15 +563,15 @@

</Update>

<Update label="February 9, 2026" description="Test and validate AI agents with Evals: Enterprise-grade agent testing">

Check warning on line 566 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L566

Did you really mean 'Evals'?

![Test and validate AI agents with Evals](/images/changelog/698a6f9d99180607d34d642c-changelog-evals.webp)

**Evals: Test and Validate Your AI Agents with Confidence**

Check warning on line 570 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L570

Did you really mean 'Evals'?

You can now thoroughly test your AI agents with our powerful Evals feature, ensuring they perform exactly as expected in real-world scenarios!

Check warning on line 572 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L572

Did you really mean 'Evals'?

Evals provides a structured testing framework for your AI agents, allowing you to create test suites with multiple scenarios to validate functionality. Create golden test examples, simulate user interactions, and evaluate agent performance without triggering actual tool executions or external actions.

Check warning on line 574 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L574

Did you really mean 'Evals'?

➡️ Create organized test suites – Group related tests together for better organization and management

Expand All @@ -583,9 +583,9 @@

➡️ Coming soon: Tool simulations – Test workflows with sensitive or expensive tools without triggering actual executions

With Evals, you can confidently deploy agents knowing they've been thoroughly tested against a variety of scenarios, ensuring reliability and consistent performance for your users.

Check warning on line 586 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L586

Did you really mean 'Evals'?

**Available exclusively for select Enterprise customers**, Evals delivers the advanced testing capabilities needed for mission-critical AI deployments. To access Evals, enterprise users can go to their agent's dashboard and select the "Monitor" tab, then navigate to the "Test Suites" section. If you’re on an Enterprise plan and don’t yet have access, contact your Relevance AI sales representative to register interest. This feature is not available on non-Enterprise plans.

Check warning on line 588 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L588

Did you really mean 'Evals'?

Start building more reliable AI agents with comprehensive enterprise-grade testing today!

Expand Down Expand Up @@ -665,11 +665,11 @@

Workforce Trigger Controls give you granular management over your automation workflows. Quickly pause specific triggers when issues arise, cancel problematic workflows, or pause an entire workforce at once—then resume operations when you're ready.

➡️ Pause individual triggers – Temporarily stop specific automations without affecting others

Check warning on line 668 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L668

Did you really mean 'automations'?

➡️ Cancel active workflows – Immediately terminate problematic processes

➡️ Resume paused triggers – Restart automations when issues are resolved

Check warning on line 672 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L672

Did you really mean 'automations'?

➡️ Pause entire workforces – One-click solution to halt all triggers during maintenance

Expand Down Expand Up @@ -783,11 +783,11 @@

![Control your meeting agent in real time with chat commands](/images/changelog/695a95a2a931a05c425b7b72-changelog-meeting-bot-real-time-commands.webp)

**Meeting Agent Realtime Commands: Control Your AI Agent During Live Meetings**

Check warning on line 786 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L786

Did you really mean 'Realtime'?

You can now trigger your AI meeting agent with custom commands during live meetings without interrupting the flow of conversation!

Meeting Agent Realtime Commands lets you interact with your meeting bot during meetings by simply typing trigger words in the chat. Your agent springs into action when it detects these keywords, performing tasks like searching information, controlling recordings, or creating meeting artifacts—all while your meeting continues uninterrupted.

Check warning on line 790 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L790

Did you really mean 'Realtime'?

➡️ Use custom trigger words – Define specific phrases that activate your agent during meetings

Expand All @@ -799,7 +799,7 @@

➡️ Extend with any Relevance AI capability – Connect to Notion, Slack, or other tools for seamless workflows

With Meeting Agent Realtime Commands, you can enhance your meeting productivity by leveraging AI assistance exactly when you need it, without disrupting the conversation flow.

Check warning on line 802 in changelog.mdx

View check run for this annotation

Mintlify / Mintlify Validation (relevanceai) - vale-spellcheck

changelog.mdx#L802

Did you really mean 'Realtime'?

To set up your own meeting agent with custom commands, create a new agent from scratch, add the "Relevance AI Meeting Bot" under Triggers, add and configure your desired meeting bot tools (such as 'Pause Recording' and 'Resume Recording') and more general tools (such as 'Google Search' and 'Slide Builder') and trigger words.

Expand Down
Loading
Loading