PLATFORM
AI-powered IVR testing and monitoring
Define flows, run them on schedule, and get evidence with AI-powered analysis — from semantic assertions to root cause diagnosis to compliance scanning.
HOW IT WORKS
1
Configure your flow
Define prompts, DTMF inputs, speech steps, and hangup rules manually — or let AI generate test cases from a plain-language description.
2
Execute runs
Single ad-hoc runs, scheduled campaigns, data-driven execution across CSV inputs, or load tests — with execution time windows and concurrency controls.
3
Evidence routes to you
Step outcomes, per-step audio clips, recording, transcript, quality metrics, AI root cause analysis, and compliance badges — delivered via webhook.
AI Intelligence Layer
10 AI features built into the platform. Write tests in plain English, auto-generate suites, diagnose failures, scan compliance, and predict outages — all powered by AI.
Semantic Assertions
Write test rules in plain English like 'verify the IVR confirms the balance.' AI evaluates whether the transcript matches intent — no regex needed.
AI Test Case Generator
Describe what you want to test. AI builds the complete test case — steps, prompts, DTMF inputs, expected outcomes, and assertion rules.
AI Suite Builder
Describe your IVR once in natural language. AI generates 3–8 test cases covering all paths, edge cases, and language combinations.
Smart IVR Discovery
AI reads IVR prompts and probes only actual menu options — significantly fewer calls than brute-force DTMF scanning. Maps the full IVR topology automatically.
Failure Root Cause Analysis
When tests fail, AI analyzes the evidence — recording, transcript, timing, quality metrics — and diagnoses the root cause with actionable fix suggestions.
IVR Change Detection
Compares discovery scans over time and generates human-readable changelogs. Know exactly what changed in your IVR before customers notice.
Call Quality Scoring
AI grades every call A–F across five dimensions: clarity, efficiency, completeness, accessibility, and reliability. Track quality trends over time.
Compliance & Accessibility Auditor
Auto-scans IVR flows against PCI-DSS, ADA, and TCPA requirements. Flags violations with specific evidence and remediation guidance.
Predictive Monitoring
Analyzes run history to spot degradation patterns. Alerts you to trends that indicate an upcoming outage — before it happens.
Virtual Agent Testing
Test conversational AI agents and chatbot IVR flows with AI-driven dynamic responses. Goes beyond static DTMF/speech — tests real conversations.
CORE CAPABILITIES
Everything you need to test and monitor IVR
Execution modes
Use the same flows across multiple execution patterns.
- Single runs for ad-hoc validation
- Scheduled campaigns for continuous monitoring
- Data-driven runs for multi-input execution
- Load tests for capacity validation
- Execution time windows and concurrency controls
Evidence per run
Every run produces layered artifacts for escalation.
- Three-state results — Pass, Warning, Fail
- Full call recording and transcript
- Per-step audio clips with isolated playback
- Call quality metrics (MOS, jitter, RTT, packet loss)
- AI root cause analysis and compliance badges
- Exportable PDF run report
Alert routing
Failures route to your existing tools.
- Slack, Microsoft Teams, Webex, PagerDuty
- OpsGenie, ServiceNow, Jira, or any webhook
- SLA threshold alerts per test case
- Escalation flows and configurable rules
Run history and traceability
Complete audit trail of what ran, when, and what it found.
- Full run history per flow
- Version history with snapshot and restore
- Baseline regression — mark passing runs as reference
- Full audit log with actor, IP, timestamp
Dashboard overview
Run report detail
Campaigns and history
PROMPT MATCHING
Seven ways to validate what your IVR says
Each step uses one of seven match strategies — from AI-powered semantic matching to strict character-level verification. Choose the right one for each prompt.
Semantic (AI)
AIPlain-English assertions. AI evaluates whether the transcript matches your intent, handling natural language variation.
Contains
Flexible substring matching. The transcript must include the expected phrase anywhere in the response.
Wildcard
Variable prompt matching. Use patterns like "balance is * dollars" to validate dynamic values.
Phonetic
Sound-alike matching for names, numbers, and account identifiers. Handles speech recognition variation.
Regex
Full regular expression matching for complex validation patterns when other modes aren't precise enough.
Exact
Strict character-level verification. The transcript must match the expected phrase exactly.
Accept Any
Presence check only — the step passes as long as the IVR produces audio. No text validation applied.
ENTERPRISE OPERATIONS
Built for operations teams at scale
Multi-region calling
Monitor IVR flows across multiple regions. Global dial-out to any destination.
CI/CD release gates
Trigger runs from any CI/CD tool via webhook. Gate releases on a green IVR test result.
Data-driven testing
Upload CSV datasets with template variables. Run flows across hundreds of inputs automatically.
SLA threshold alerts
Configurable alert rules per test case. Get notified when IVR performance drops below thresholds.
Scheduled PDF reports
Weekly or monthly automated report delivery. Share IVR health with stakeholders via email.
Signal Board
Live ops wallboards showing real-time pass/fail status. Built for wall displays in operations centers.
ANALYTICS & INTELLIGENCE
See patterns, not just failures
RunSentry surfaces trends that individual pass/fail results hide — before they become incidents.
Flaky flow detection
Scores test cases by how often they flip between pass and fail. Know which IVR paths are genuinely unreliable.
IVR discovery graph
Automatically maps your IVR topology from run data — node pass rates, step aggregations, and diffs between runs.
Carrier scorecard
Pass rates broken down by carrier and region. Know whether a failure is routing-specific before escalating.
ALSO INCLUDED
Flow capture
Dial your IVR from the browser. RunSentry records the session and auto-generates a test case.
Call quality metrics
MOS score, jitter, RTT, and packet loss recorded on every call.
Role-based access
Viewer, Standard, and Admin roles. Compliance observers get read-only access.
API keys
Programmatic access for automation and integration with external systems.
Folder organization
Nested folders by client, project, or team. Built for managing dozens of IVR flows.
Per-step language override
Different speech recognition language per step. Test bilingual IVR flows in a single test case.
Auto-detect language
Set a step to auto and RunSentry identifies the language from the audio.
Post-change validation
Run your test suite immediately after an IVR config change — before customers report failures.
Version history
Every test case change is snapshotted. Restore any previous version instantly.
DEPLOYMENT
SaaS or dedicated — your choice
SaaS multi-tenant is available on all plans. Dedicated single-tenant is available on Enterprise and Global tiers for teams with strict isolation or compliance requirements.
COVERAGE
Monitor any IVR globally.
Dial any IVR number globally. 20+ languages with auto-detect mode for multilingual flows.
See it against your IVR
Tell us your region, voice platform, and what you want to validate. We'll confirm coverage and show you the AI features in action.