Dashboard
Cost, speed, and call volume on one screen
Single OpenRouter bill + 4 key metrics + today's alerts + trends by model and time
Edit on the web and it ships to production in 5 minutes
Cost, quality, and access — all on one screen
Product screens
Dashboard
Single OpenRouter bill + 4 key metrics + today's alerts + trends by model and time
Prompts
Per-environment separation + model and version control + weekly call-volume trend
Editor
System message · model selection · fill variables and run, all on one screen
Version control
Separate deploys for production, staging, and dev + system prompt change comparison
Cost analysis
Monthly budget + daily trend + by time of day + model comparison, all on one screen
Sign up in a minute — the web editor auto-detects {{variables}} and runs them instantly
npm install @promptops/sdk — one line in your existing code picks up new versions automatically
Just save in the web app — cost, evaluation, and rollback all live on one dashboard
Core features
See latency and cost for every prompt at a glance — switch to a faster, cheaper model without touching your code
Last 24 hours · support-reply
Add just 50 sample inputs and AI grades them across 7 criteria (accuracy, clarity, tone, safety, format, relevance, helpfulness) — verify quality before you ship
support-reply v13 · 50 LLM-graded samples
Separate edit, approve, and deploy permissions by role — every change is logged with who, when, and what
Who it's for
Edit prompts on the web without knowing code — changes go live instantly
Use new versions automatically with one SDK line, no code changes
Manage tone and voice in one place — verify quality with automatic Korean eval
A/B test response templates — verify answer quality before deploying to production
How it works
The moment you edit on the web, the SDK picks up the new version and cost, latency, and eval scores accumulate automatically
If quality drops, roll back in one click
And more
One CLI command scans your existing code for prompts — migrate them all into PromptOps at once
When LLM scoring is ambiguous, people label cases by hand and verify RAG source grounding (Team).
OpenRouter call costs are included in your subscription — bring your own API key to use it with no credit deduction
Use it with confidence
For evaluation / personal experiments
For solo PMs and developers
3-person team (+₩30,000/seat from the 4th)
FAQ
Free is for evaluation with up to 250 calls/month, while Starter is built for real operations with up to 4,400 LLM calls/month
Register your own OpenAI · Anthropic · Google API key and LLM call costs are billed directly to your account — available even on the Free plan
One CLI command auto-extracts them (`npx @promptops/cli scan`) — it recognizes yaml · json · Markdown · and even strings inside code
The Team plan includes 3 people for ₩99,000/month, with each additional person from the 4th costing ₩30,000
AI grades automatically across 7 criteria (accuracy, clarity, tone, safety, format, relevance, helpfulness) — and you can also have a person review ambiguous answers