Documentationbreadcrumb arrow Grafana Cloudbreadcrumb arrow AI and machine learningbreadcrumb arrow Grafana AI Observabilitybreadcrumb arrow Configurebreadcrumb arrow Tune plugin settings
Grafana Cloud

Configure the AI Observability plugin

Note

AI Observability plugin configuration is currently in public preview. Grafana Labs offers limited support, and breaking changes might occur prior to the feature being made generally available.

The Grafana AI Observability plugin provides the UI for browsing conversations, managing agents, configuring evaluation, and viewing dashboards. This article covers plugin configuration and access control.

Plugin roles

AI Observability defines five plugin roles that control access to features:

RolePermissions
Sigil ViewerLanding page and tutorial.
Sigil Data ReaderRead access to dashboards, traces, model cards, and evaluation pages without conversation access.
Sigil ReaderDashboards, conversations, traces, model cards, and evaluation results.
Sigil Feedback WriterWrite conversation feedback (ratings and annotations).
Sigil AdminFull access including feedback, evaluation configuration, alert rules, and data source settings.

Assign roles

Assign AI Observability roles to Grafana roles or teams using RBAC:

  1. Navigate to Administration > Users and access > Roles.
  2. Find or create the role you want to assign AI Observability permissions to.
  3. Add the appropriate grafana-sigil-app.* permissions.

Connect data sources

The AI Observability plugin queries Prometheus (metrics), Tempo (traces), and the AI Observability API (generations). In Configuration, set:

  • The AI Observability API endpoint.
  • The Prometheus data source for metrics dashboards.
  • The Tempo data source for trace drilldown.

For Grafana Cloud deployments, data sources are configured automatically.

Edit the AI Observability API connection

In some Grafana Cloud stacks, Admin users can edit the AI Observability API URL and authentication token from the plugin Configuration page. Use this when your stack must point the plugin at a different AI Observability API endpoint or rotate the token used by the plugin proxy.

If editable connection settings aren’t enabled on your stack, the page shows the current connection values as read-only. For Grafana Cloud deployments, the managed defaults are usually sufficient.

Plugin pages

PagePathDescription
Analytics/a/grafana-sigil-app/analyticsActivity, latency, error, token, and cost dashboards.
Conversations/a/grafana-sigil-app/conversationsBrowse and search conversations.
Tools/a/grafana-sigil-app/analytics/toolsTool usage analytics.
Agents/a/grafana-sigil-app/agentsAgent catalog with version history.
Evaluation/a/grafana-sigil-app/evaluationEvaluation rules, evaluators, and scores.
Setup/a/grafana-sigil-app/setupOnboarding wizard and demo data seeding.
Configuration/plugins/grafana-sigil-appPlugin settings (Admin only).

Command palette

AI Observability registers its pages in the Grafana command palette. Press Cmd+K (Mac) or Ctrl+K (Linux/Windows) and type “AI Observability” to quickly navigate to any AI Observability page.

Next steps