FutureAGI and Zapier connect so you can monitor evaluation groups, run searches against your workspace, and automate creating or applying evaluation groups, simulator test runs, and log lookups.
Prerequisites
To use the FutureAGI app on Zapier, you must have:
- A FutureAGI account with API access.
- An API key and a secret key for your FutureAGI account.
Find your FutureAGI API key and secret key
Open Keys in the FutureAGI dashboard to create or copy your API key and secret key. Zapier sends them as the X-Api-Key and X-Secret-Key headers on each request.
Connect FutureAGI to Zapier
To create an app connection to FutureAGI on Zapier:
- Go to the Apps page.
- Click + Add connection.
- A new dialog box will appear. Search for and select FutureAGI.
- Click Add connection.
- A Connect an Account page will open in a browser tab or window.
- Complete the following fields: - API Key: Enter your FutureAGI API key. - Secret Key: Enter your FutureAGI secret key.
- Click Yes, Continue to FutureAGI (or the button shown to finish the connection).
Your FutureAGI account is now successfully connected to Zapier.
About FutureAGI's app
Triggers, searches, and actions
Triggers
- New Eval Group (Polling) - Triggers when a new evaluation group appears in your Future AGI workspace (polls the eval groups list).
Searches
- Find Eval Group - Finds evaluation groups by ID or name.
- Get Evals for Dataset - Retrieves evaluations available for a dataset (Get Evals List API).
Actions
- Create Eval Group - Creates an evaluation group with one or more evaluation templates.
- Apply Eval Group - Applies an evaluation group to your data (Apply Eval Group API).
- Edit Eval Group Members - Adds or removes evaluation templates from an evaluation group.
- Get Eval Log Details - Fetches evaluation logs for a template (Get Eval Log Details API).
- Create Test Run - Creates a simulator test run (Create Run Test API).
- Execute Test Run - Starts execution for a simulator test run.
- API Request (Beta) - This is an advanced action which makes a raw HTTP request that includes this integration's authentication.
Limitations
- Some steps accept JSON in text fields (for example filters or sort arrays). Invalid JSON can cause the step to fail.
Templates
View all of FutureAGI's templates