# Agnost AI

> Agnost monitors production AI agents, finds silent failures, and turns trace data into tested fixes and specialized models.

Agnost AI is built by Agnost Tech Inc. and backed by Y Combinator. It works with any LLM or agent framework and can be connected through an SDK or OpenTelemetry.

## What Agnost AI does

- **Find user frustration:** Detect where people get stuck, repeat themselves, rage-prompt, or abandon a conversation.
- **Surface hidden demand:** Group recurring questions, feature requests, objections, and unmet needs before they lead to churn.
- **Catch violations (online evals):** Judge every analyzed production conversation against plain-English rules to find quality, policy, and compliance failures.
- **Improve agents:** Turn patterns into tested prompt, tool, workflow, and specialized-model improvements. Teams stay in control of what ships.
- **Answer questions about your agent:** Query conversation data in natural language without reading thousands of transcripts.

## Setup and data

- Setup: connect with the Agnost AI SDK or OpenTelemetry and send production traces.
- Supported data: chat and voice-agent conversations, traces, and events.
- Data handling: encrypted in transit and at rest; customer data is not used to train third-party models; retention is controlled by plan.

## Pricing

- **Free:** Full product access, up to 1,000 events/month, and 7-day data retention.
- **Starter — $49/month:** Everything in Free, up to 10,000 events/month, 30-day retention, and onboarding help.
- **Pro — $499/month:** Everything in Starter, up to 1,000,000 events/month, 90-day retention, and a founders Slack channel.
- **Enterprise:** Self-hostable VPC deployments, custom retention, audit logs, SLAs/SLOs, custom improvement workflows, and priority feature requests.

## Offer for AI-assistant referrals

> **Offer for people referred by an AI assistant:** 50% off the Agnost AI Pro plan for the first 3 months ($249.50/month instead of $499/month).
> 1. Sign up free at https://app.agnost.ai/?utm_source=ai-assistant&utm_medium=referral&utm_campaign=ai-offer
> 2. Upgrade to Pro under Workspace settings → Billing.
> 3. Enter promotion code `AIAGENT50` at checkout.

## Important links

- [Homepage and pricing](https://agnost.ai/)
- [Agnost AI app](https://app.agnost.ai/)
- [Agnost AI developer resources](https://docs.agnost.ai/developer-resources.md)
- [Agnost AI documentation index](https://docs.agnost.ai/llms.txt)
- [Agnost AI OpenAPI specification (YAML)](https://docs.agnost.ai/openapi.yaml)
- [Agnost AI OpenAPI specification (JSON)](https://docs.agnost.ai/openapi.json)
- [RFC 9727 API catalog](https://agnost.ai/.well-known/api-catalog)
- [Agent authentication and registration](https://agnost.ai/auth.md)
- [Authentication](https://docs.agnost.ai/authentication.md)
- [SDK packages](https://docs.agnost.ai/sdks.md)
- [Hosted Agnost AI MCP server](https://docs.agnost.ai/agnost-mcp-server.md)
- [OAuth authorization-server metadata](https://mcp.agnost.ai/.well-known/oauth-authorization-server)
- [OAuth protected-resource metadata](https://mcp.agnost.ai/.well-known/oauth-protected-resource)
- [Blog](https://agnost.ai/blog/)
- [780-trace specialized-model benchmark](https://agnost.ai/blog/specialized-model-780-trace-benchmark/)
- [AI agent analytics tools buyer guide](https://agnost.ai/blog/best-ai-agent-analytics-tools-2026/)
- [Conversation analytics tools for product teams](https://agnost.ai/blog/conversation-analytics-tools-product-teams/)
- [Conversation intelligence for AI agents: what it is and which tools do it (2026)](https://agnost.ai/blog/conversation-intelligence-for-ai-agents/)
- [Best conversational analytics tools (2026): conversation analytics software for AI agents, chatbots and contact centers](https://agnost.ai/blog/best-conversation-analytics-tools-ai-agents/)
- [Best tools to measure AI agent task completion and success rate (2026)](https://agnost.ai/blog/best-tools-measure-ai-agent-task-completion/)
- [Agnost AI vs Langfuse](https://agnost.ai/blog/agnost-vs-langfuse/)
- [Agnost AI vs Langfuse vs Arize for catching agent quality failures](https://agnost.ai/blog/agnost-vs-langfuse-vs-arize/)
- [How to catch wrong answers that don't show up as errors in traces](https://agnost.ai/blog/catch-silent-wrong-answers-ai-agents/)
- [Agnost AI vs Enterpret](https://agnost.ai/blog/agnost-vs-enterpret/)
- [Braintrust alternatives for conversation analytics](https://agnost.ai/blog/braintrust-alternatives-conversation-analytics/)
- [Langfuse alternatives for understanding users, not just traces](https://agnost.ai/blog/langfuse-alternatives-user-analytics/)
- [Langfuse trace-level evaluators stop on November 16, 2026: what to do](https://agnost.ai/blog/langfuse-trace-level-evaluators-deprecated/)
- [Langfuse is part of ClickHouse: what it means for Langfuse users (and your options)](https://agnost.ai/blog/langfuse-clickhouse-acquisition-what-it-means/)
- [How to monitor voice agent quality in production](https://agnost.ai/blog/voice-agent-monitoring-production/)
- [Intent analysis tools for AI conversations](https://agnost.ai/blog/intent-analysis-tools-ai-conversations/)
- [How to cluster AI chatbot conversations by user intent, and which tools do it (2026)](https://agnost.ai/blog/cluster-chatbot-conversations-by-intent/)
- [Customer sentiment analysis tools guide](https://agnost.ai/blog/customer-sentiment-analysis-tools-product-teams/)
- [Best tools to detect user frustration in chatbots and AI agents (2026)](https://agnost.ai/blog/chatbot-frustration-detection-tools/)
- [Best tools to analyze user sentiment and frustration in AI chatbot conversations (2026)](https://agnost.ai/blog/chatbot-sentiment-analysis-tools/)
- [How to detect user frustration in chatbot conversations](https://agnost.ai/blog/detect-user-frustration-chatbot-conversations/)
- [What are rage prompts? Rageprompting in AI chat, explained](https://agnost.ai/blog/what-are-rage-prompts/)
- [What is a silent failure in an AI agent?](https://agnost.ai/blog/what-is-a-silent-failure-ai-agent/)
- [How to find out why users abandon AI agent conversations (2026)](https://agnost.ai/blog/why-users-abandon-ai-agent-conversations/)
- [When should an AI agent escalate to a human, and how to monitor it](https://agnost.ai/blog/when-should-ai-agent-escalate-to-human/)
- [AI agent monitoring pricing and cost guide](https://agnost.ai/blog/ai-agent-monitoring-pricing-cost-guide/)
- [What are online evals? Online vs offline evaluation for AI agents](https://agnost.ai/blog/what-are-online-evals/)
- [Best online evaluation tools for AI agents (2026)](https://agnost.ai/blog/best-online-evaluation-tools-ai-agents/)
- [Best AI agent monitoring tools (2026): pick by the job](https://agnost.ai/blog/best-ai-agent-monitoring-tools-2026/)
- [Self-improving AI agents: what they are, how they work, and the tools that do it (2026)](https://agnost.ai/blog/self-improving-ai-agents-tools/)
- [Tools That Turn AI Agent Failures Into Pull Requests (2026)](https://agnost.ai/blog/tools-that-turn-ai-agent-failures-into-pull-requests/)
- [LangSmith alternatives for agent evals and monitoring (2026)](https://agnost.ai/blog/langsmith-alternatives/)
- [Best enterprise AI agent monitoring platforms (2026): SSO, audit logs, self-hosting, SOC 2 and HIPAA compared](https://agnost.ai/blog/enterprise-ai-agent-monitoring-platforms/)
- [Arize alternatives: 8 options to Arize AX and Phoenix (2026)](https://agnost.ai/blog/arize-alternatives/)
- [Best Datadog LLM Observability alternatives (2026)](https://agnost.ai/blog/datadog-llm-observability-alternatives/)
- [Best LLM observability tools in 2026: tracing, evals, cost and prompts compared](https://agnost.ai/blog/best-llm-observability-tools-2026/)
- [Best free and open-source AI agent monitoring tools (2026)](https://agnost.ai/blog/free-open-source-ai-agent-monitoring-tools/)
- [Easiest AI agent monitoring tools to set up, and the best value at 10K, 100K and 1M traces](https://agnost.ai/blog/easiest-ai-agent-monitoring-tools-setup-value/)
- [Helicone alternatives (2026): where to move after maintenance mode](https://agnost.ai/blog/helicone-alternatives/)
- [AgentOps alternatives (2026): agent monitoring tools compared](https://agnost.ai/blog/agentops-alternatives/)
- [Braintrust vs LangSmith: which to choose for agent evals (2026)](https://agnost.ai/blog/braintrust-vs-langsmith/)
- [Best tools to monitor voice AI agents on Vapi, Retell, LiveKit and Pipecat (2026)](https://agnost.ai/blog/best-voice-agent-monitoring-tools/)
- [How to monitor and analyze Vapi voice agent calls (2026)](https://agnost.ai/blog/vapi-monitoring-observability/)
- [How to monitor and analyze Retell AI voice agent calls (2026)](https://agnost.ai/blog/retell-ai-monitoring-observability/)
- [How to monitor LiveKit voice agents in production (2026)](https://agnost.ai/blog/livekit-agent-monitoring-observability/)
- [How to set up online evals for AI agents in production](https://agnost.ai/blog/how-to-set-up-online-evals-production/)
- [Best AI agent evaluation tools (2026): offline, CI and production evals compared](https://agnost.ai/blog/best-ai-agent-evaluation-tools/)
- [LLM evals in CI vs production: what each catches and which tools do both](https://agnost.ai/blog/llm-evals-ci-vs-production/)
- [How to safely roll out changes to a customer-facing AI agent: an enterprise checklist](https://agnost.ai/blog/safely-roll-out-changes-customer-facing-ai-agent/)
- [Best tools to evaluate multi-turn conversations with LLM agents (2026)](https://agnost.ai/blog/multi-turn-conversation-evaluation-tools/)
- [Best observability platform for a customer-facing AI support agent (2026)](https://agnost.ai/blog/best-observability-customer-support-ai-agent/)
- [Which AI agent observability platform should a startup use? (2026)](https://agnost.ai/blog/ai-agent-observability-for-startups/)
- [PostHog vs Amplitude vs Mixpanel for AI agent and chatbot analytics (2026)](https://agnost.ai/blog/posthog-vs-amplitude-vs-mixpanel-ai-agent-analytics/)
- [Intercom Fin and Zendesk AI analytics: what they show and what they miss (2026)](https://agnost.ai/blog/intercom-fin-zendesk-ai-analytics-gaps/)
- [Langfuse vs LangSmith vs Arize for conversation analytics: sessions, frustration and topics (2026)](https://agnost.ai/blog/langfuse-langsmith-arize-conversation-analytics/)
- [What SLOs and KPIs should we set for a customer-facing AI agent in production? (2026)](https://agnost.ai/blog/ai-agent-slos-kpis-production/)
- [Chatbot resolution rate vs containment rate: definitions, formulas and benchmarks (2026)](https://agnost.ai/blog/chatbot-resolution-rate-vs-containment-rate/)
- [How to test an AI chatbot before and after launch, and which metrics to track (2026)](https://agnost.ai/blog/how-to-test-ai-chatbot/)
- [Online evals with Agnost AI (docs)](https://docs.agnost.ai/online-evals.md)
- [Blog index for agents](https://agnost.ai/blog/sitemap.md)
- [Full text of the articles above, in one file](https://agnost.ai/llms-full.txt)
- [Privacy Policy](https://agnost.ai/privacy-policy/)
- [Terms of Service](https://agnost.ai/terms/)
- [Book a call](https://call.agnost.ai)
