Articles in this section

Preview an AI agent

The AI agent (create/edit) panel features two main sections: the left side for configuring the agent and the right side for execution and performance preview. To see how import requests will look during configuration, click within the Input tab.

Agent_input.jpg

Note

A functioning preview is available only when the agent is inserted into a flow, and the input panel displays the output received from the previous flow step.

Within the Preview pane, you can supply mock input data. The Mock response tab works similarly throughout the Celigo platform; see Provide mock response data for imports.

Agent output

The system uses the same configuration that will run in the flow. It lets you safely test agent behavior before running it in production. When you open an agent, click the Agent output at the right.

Agentoutput.jpg

Test agent

Test-drive your AI agent before using it in a live flow. You can review the output to see if the agent behaves as expected and decide whether you need to adjust the instructions, model, or other  settings.

You can see the Celigo AI credits (estimated per-record cost) the agent used only if the selected Type is Celigo AI.

You can stop the testing process at any time after it has started by clicking Stop.

testagent.jpg

Note

If configured as Bring your own key (BYOK), the test runs through that connection.

Model response

Once you click Test agent, you’ll get a response based on the input you provided.

Model_response.jpg

Agent trace

Agent trace shows execution details such as the request, response, and tool calls when enabled to help you debug and refine instructions.

Agenttrace.jpg

Compare model

You can run comparisons using other models for evaluation of quality, latency, and cost. Agent output always uses the agent’s saved configuration for that aspect. Once you understand the details, make edits to fine-tune their instruction or try changing other settings.

AIagent_comparison_screen.jpg

Debug your agent

In the Flow builder, for each agent, you can enable debugging to track requests and responses between integrator.io and the connected application. The logs can assist you when troubleshooting by enabling you to view errors that caused a particular record to fail. You can also access information that may help you determine what you need to fix in your agent to avoid errors or optimize your integration's performance. It is now available for all agent step types.

The debug functionality is similar to the debug mode in a flow.

Start debug

Perform the following actions to start collecting debug logs for an agent:

  1. Open an agent in a flow step you want to debug.

    Note

    To view the View debug logs option, you must first save and close an agent as this option is not available in Create an agent page.

  2. In the Edit an agent, click View debug logs in the upper right corner of the page.

  3. Click Start debug to turn on the debugger. Debug logs will be collected for the period of time you choose from the drop-down list. Choose one of the following time increments for debug log collection and click Apply:

    • Next 15 minutes

    • Next 30 minutes

    • Next 45 minutes

    • Next 60 minutes

For more information, see Debug flow steps.