Respan

What is Respan?

Respan, formerly Keywords AI, is an LLM engineering platform that unifies observability, evaluations, prompt optimization, and an AI gateway. Teams route model calls through a single endpoint, trace agent execution, monitor cost and latency, and run evaluations. It processes billions of logs monthly for AI startups and enterprise teams.

Top Features:

• AI gateway: route calls through one endpoint to over 500 supported models.
• Observability: trace trees, real-time dashboards, and metrics for tokens, cost, and errors.
• Evaluations: combine rule checks, LLM judges, and human review in one workflow.

Use Cases:

• Production monitoring: watch live traffic and get alerts when metrics cross thresholds.
• Quality testing: run evaluations on sampled traffic before and after deployment.
• Cost control: set per-key spend limits and cache prompts to reduce spending.

Who Can Use Respan?

• AI engineers: trace agent paths and debug latency across each operation step.
• ML teams: evaluate model quality with judges, code checks, and human review.
• Startups: manage spend and reliability while scaling LLM features in production.

Pricing

• Free ($0): full platform with 100k logs, 5 datasets, and 2 evaluators.
• Team ($199/mo): unlimited datasets, evaluators, prompts, private Slack, and SOC 2 report.
• Enterprise (contact sales): custom packages, SLAs, dedicated support, and HIPAA BAA compliance.

Pros and Cons

Pros:

• All in one: gateway, observability, evals, and prompts live in a single platform.
• Broad model support: a single API reaches over 500 different models.
• Strong compliance: meets ISO 27001, SOC 2, GDPR, and HIPAA standards.

Cons:

• Team price jump: the step from free to $199 monthly is steep.
• Technical product: aimed at developers, not non-technical users.
• Log add-ons: heavy usage adds extra cost for additional logs and scores.

FAQs:

1) What was Respan called before?

Respan was formerly known as Keywords AI before its rebrand.

2) How many models does it support?

The gateway routes requests to more than 500 different models through one endpoint.

3) Is there a free plan?

Yes, the free plan includes full platform access with 100k logs monthly.

4) Is it compliant for healthcare?

Yes, enterprise plans include HIPAA BAA along with SOC 2 and ISO 27001.

5) Can it manage spend?

Yes, you can set per-key spend limits and get alerts on thresholds.