AI Observability

In this section, we'll walk you through the Sumo Logic AI Observability solution, from data collection and app installation to monitoring and troubleshooting your AI and LLM applications. The solution analyzes OpenTelemetry trace spans that carry GenAI semantic convention (gen_ai.*) attributes, so you can track request volume, latency, errors, token usage, cost, agent workflows, and conversations across LLM providers and frameworks.

AI Observability App

Set up collection, install the app, and use prebuilt dashboards and monitors for your AI and LLM applications.

Send GenAI Traces with OpenTelemetry

Instrument your LLM application with the official OpenTelemetry GenAI packages and send traces to Sumo Logic.

Send GenAI Traces with OpenLLMetry

Instrument your LLM application with the open-source Traceloop SDK and send traces to Sumo Logic.

Troubleshoot AI Observability

Resolve common problems with data collection, missing traces, and empty dashboards in AI Observability.