Telemetry
Telemetry provides a data feedback loop for AI coding agents: ingest structured events via the Log API, query real outcomes with SQL, and use dashboards and alerts to weigh trade-offs across releases, models and costs.
About Telemetry
Telemetry is a telemetry service for coding agents and applications: it provides a Log API for ingesting application events, user activity, metrics or structured logs; events pass through validation and buffering, are stored in S3 in Parquet format, and support running SQL queries that combine fresh and historical data. Users can create dashboards based on Explore and SQL query results, and can also pair result events with OpenTelemetry traces, metrics and logs via secure correlation IDs. Its core use case is building a feedback loop for AI agents: record agent telemetry and query real outcomes with SQL to determine whether a given release, prompt version or model choice actually improves success rates, handoff rates or costs.
Best for
Best use cases
Evaluate whether a release improved agent run success rates without increasing handoff rates or costs
Compare the cost-effectiveness of different models by the number of acceptable outcomes produced per dollar
Confirm that a new version reduces error rates without increasing tail latency
Analyze background jobs and business metrics using structured events and SQL
Compare before choosing
Per the official comparison page: Datadog is a broad observability and security platform; when a small team needs structured application events, SQL dashboards and threshold alerts without first adopting a full infrastructure and APM suite, Telemetry is a focused alternative.
Per the official comparison page: Honeycomb targets high-cardinality observability and distributed systems debugging (wide events and traces); when the primary need is custom application and business events, SQL analytics and simple dashboards or alerts, Telemetry is the lighter-weight choice.
Features
Structured event ingestion
Ingest application events, user activity, metrics or structured logs via the Log API; JSON objects are automatically normalized before ingestion, e.g. with timestamps added and null values cleaned up.
SQL queries
Data is stored in S3 in Parquet format, and SQL queries run over a combination of fresh and historical data; the query process is inspectable.
Dashboards and alerts
Build dashboards from Explore and SQL query results, arranging components to support fast operational decisions; threshold alerts are supported.
Works with OpenTelemetry
Use OpenTelemetry traces, metrics and logs alongside result events, linked via secure correlation IDs while keeping signal boundaries clear.
Test instrumentation in CI
Test structured event contracts, privacy boundaries, delivery failures and SQL results in CI, without sending production data or relying on live APIs.
Pros
- Provides a complete feedback loop for AI agents: capture telemetry, query real outcomes with SQL, and compare releases, prompt versions, models, routing and workflows against the results users actually received
- Offers inspectable SQL and operations dashboards that agents can install, making it easy for teams to verify analytical conclusions directly
- Offers a free plan; the official site says no credit card is required to sign up
- Can be used alongside OpenTelemetry traces, metrics and logs via correlation IDs, and instrumentation can be tested in CI without sending production data
Cons
- The security page explicitly states: the public pages do not declare at-rest encryption design, key ownership and rotation, technical tenant isolation models, nor backup frequency, recovery testing, recovery objectives, availability commitments or disaster recovery architecture.
- The security page explicitly states: no independent assurance claims such as SOC 2, ISO 27001, penetration testing, vulnerability disclosure or audit reports are published, nor enterprise-grade access controls such as SAML SSO, SCIM, configurable RBAC, tamper-proof audit logs, IP allowlisting or customer-managed keys.
- The documentation notes: plan quotas and current limits may change, so the limits shown in the product and billing settings should be treated as authoritative; undocumented global request rates should not be hardcoded.
Pricing Plans
Free
- 1 GB of storage
- Unlimited users
- 10 hours of query runtime per month
- Priority support
Business
- 10 GB of storage
- Unlimited users
- 10 hours of query runtime per month
- Priority email support
Enterprise
- 1 TB of storage
- Unlimited users
- 100 hours of query runtime per month
- Custom retention policies
- Dedicated account manager
* Pricing information is for reference only. Please refer to the latest announcement on Telemetry's official website.