> ## Documentation Index
> Fetch the complete documentation index at: https://docs.domino.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Monitor agentic systems

After deploying your agentic system to production, monitor its performance with real user interactions. Domino automatically collects production traces and provides dashboards to track performance, usage, and quality over time.

## Monitor agent performance

Access monitoring views from your deployed agent’s dashboard. These views show how your agent performs with real user interactions:

| View        | What it shows                                                                                                                                                                  |
| ----------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| Overview    | Deployment status and configuration details.                                                                                                                                   |
| Performance | Evaluation metrics as visualizations alongside production traces. Review metrics over time to spot trends and identify patterns in successful versus problematic interactions. |
| Usage       | User invocations and interaction tracking.                                                                                                                                     |

The agent dashboard gives you an at-a-glance view of production performance, including evaluation metrics over time and a list of recent traces:

<img src="https://mintcdn.com/dominodatalab-e871cec4/sWsDNA0WMBmjE2BE/images/genai/agent-dashboard.png?fit=max&auto=format&n=sWsDNA0WMBmjE2BE&q=85&s=70e750830adea9f42d33b3098e7d754e" alt="The agent dashboard" width="1269" height="1148" data-path="images/genai/agent-dashboard.png" />

Click any trace to inspect the full execution path: every LLM call, tool invocation, and decision point, along with inputs, outputs, and evaluation scores:

<img src="https://mintcdn.com/dominodatalab-e871cec4/sWsDNA0WMBmjE2BE/images/genai/trace-data-view.png?fit=max&auto=format&n=sWsDNA0WMBmjE2BE&q=85&s=e16e4caae088d1a54be45423d27dcac7" alt="The trace data view" width="1047" height="652" data-path="images/genai/trace-data-view.png" />

## Evaluate production traces

Production evaluations run out-of-band from your real-time agent app. Rather than evaluating inside the live request path, you write a separate evaluation script that fetches production traces, scores them, and logs the results back. This script runs as a [Domino Job](/cloud/platform-capabilities/core-concepts/jobs), typically on a schedule, so your agent’s latency is never affected by evaluation overhead.

How it works:

* Your agent serves users in real time and collects traces automatically.

* A separate scheduled Job fetches those traces, runs your evaluation logic, and logs scores back to each trace.

This gives you continuous quality monitoring without impacting production performance.

### Find your agent ID and version

To fetch production traces programmatically, you need the **agent ID** and **agent version**.

Find these in the Domino UI after deploying your agent:

<img src="https://mintcdn.com/dominodatalab-e871cec4/sWsDNA0WMBmjE2BE/images/genai/evaluation-setup-button.png?fit=max&auto=format&n=sWsDNA0WMBmjE2BE&q=85&s=5a855db2efdc594445672288bc2e3652" alt="Use the Evaluation setup button to find the agent ID and version" width="1279" height="611" data-path="images/genai/evaluation-setup-button.png" />

### The production evaluation script

Use `search_agent_traces()` to fetch traces for a specific agent version. Then evaluate and log results back with `log_evaluation()`:

```python theme={null}
from domino.agents.tracing import search_agent_traces
from domino.agents.logging import log_evaluation

AGENT_ID = "69432f1be3cd202576bec1b1"
VERSION = "69b42b68746e4f13257c492b"

# 1. Fetch traces for this agent version
traces = search_agent_traces(
    agent_id=AGENT_ID,
    agent_version=VERSION,
)

# 2. Evaluate each trace and log results
for trace in traces.data:
    inputs = trace.spans[0].inputs
    outputs = trace.spans[0].outputs

    score = my_evaluate(inputs, outputs)

    # 3. Log evaluation results back to the trace
    log_evaluation(
        trace_id=trace.id,
        name="my_eval_metric",
        value=score,
    )
```

Schedule this script as a recurring Domino Job to continuously monitor quality as your agent handles real user requests.

The [simple\_domino\_agent](https://github.com/dominodatalab/simple_domino_agent) repository has a complete working example in [prod\_eval\_simplest\_agent.py](https://github.com/dominodatalab/simple_domino_agent/blob/main/prod_eval_simplest_agent.py).

## Iterate on configurations

When you identify issues or opportunities for improvement, relaunch your production agent’s configuration into a workspace.

[Track and monitor experiments](/cloud/platform-capabilities/features/development/track-monitor) has details on relaunching runs.

This workflow lets you:

* Reproduce the exact production configuration.

* Debug issues identified in production traces.

* Maintain clear lineage between production agents and their source experiments.

## Next steps

* [Develop agentic systems](/cloud/platform-capabilities/features/genai/agent-development-lifecycle/develop-agentic-systems): Iterate on your agent configuration based on production insights.

* [Experiment Manager](/cloud/platform-capabilities/features/genai/agent-development-lifecycle/experiment-with-agentic-systems): Test improvements before redeploying.

* [Python SDK for agents](/cloud/reference/experiment-agent-sdk/python-sdk-agents): A full API reference for `search_agent_traces`, `log_evaluation`, and trace data classes.
