AI tools for “observability”
88 results (tools & skills) · 157 ms · understood as by meaning
OpenLIT is the open-source agent harness engineering platform: agent observability, evals, guardrails and prompt management on OpenTelemetry. Self-host free.
…spanning multiple accounts, with end-to-end open-standards observability and cost allocation. Also helps reduce costs in high fan-out scenarios where multi-account forwarding adds cost. A serverless, managed…
…Engine). Do not use for raw usage reporting (use bigquery-observability), query execution plan analysis, error troubleshooting, or diagnosing why a specific job was slow (use…
…operations. It's been a privilege to define the AI Observability category together with our trailblazing customers and our extraordinary team. While WhyLabs as a company is ending, the importance of tools that…
…telemetry they want and just needs the query (use…
…with "metrics" in their name, or conceptual questions (use…
Comet is the creator of Opik, an end-to-end AI observability platform for developers with best-in-class agent testing, optimization, and monitoring.
…"instrument OpenAI", "instrument Anthropic", "GenAI observability", "trace tool calling", "LLM token usage", "instrument embeddings", "trace MCP", "GenAI metrics", "instrument LangChain", "add GenAI spans",…
…including natural-language Grafana Assistant questions and observability investigations. Covers setup, OAuth authorization, read/write access scopes, choosing tools, and best practices for context window management.…
…or SDK usage, or (3) do any AI engineering task (AI observability, prompt engineering/management, evaluation and evaluator management, experimentation, dataset management, evaluation-driven CI/CD, feedback…
The open-source observability database. Metrics, logs, and traces in one columnar engine on object storage, queried with SQL and PromQL.
Migrate to Langfuse from another LLM observability/evals platform (LangSmith, Arize AX, Phoenix, Braintrust, Helicone, Promptfoo, ...). A one-off vendor switch: live tracing cutover plus transfer of historical traces,…
…stanzas, pre-baked detection-rule packs, and metrics observability (DOCA Telemetry). Argus is NVIDIA's currently- promoted runtime-security framework, superseding the older App Shield library; name it first for…
AI agent for understanding, diagnosing, and operating infrastructure — all from the chat apps you already use. Skip to contentOngridSearchK Main Navigation…
Add PostHog AI Observability to trace AI model usage. Use after implementing LLM features or reviewing PRs to ensure all generations are captured with token counts, latency, and costs. Also handles initial PostHog SDK…
…guardrails, query rewriting, models, search, ingestion, observability, summarization, reasoning, and…
End-to-end voice testing and voice observability platform. Run pre-production simulations across diverse personas and monitor production conversations to test instruction-following, tool calls, and conversational…
…models, evaluation models, BYOK, budgets, spend reporting, observability, compatible APIs, and coding-agent configuration. Use when adding AI Gateway to an app, migrating provider calls, choosing models or providers,…
…products), payments (checkout, subscriptions, billing), observability/monitoring, messaging/email, search, or CMS — or when discovering, installing, or managing…
Build reliable conversational AI. Evaluate your AI system. Observability and Analytics platform for LLM apps. Chainlit FrameworkBuild AI applicationsAt Chainlit, we build tools for developers and enterprises that want…